STM Research Integrity Master Class

08:00

Registration, breakfast & networking

09:00

An update from the STM Integrity Hub

Joris van Rossum, Product Director, STM Integrity Hub
Hylke Koers, Chief Information Officer, STM Solutions

09:30

(Mass) retractions: experiences, lessons learned, and improvements ahead

Moderated by: Tony Alves, Senior Vice President, HighWire Press

Several publishers have had to retract (large numbers of) publications once paper mills were discovered as the source behind these articles. Hear from the experts that were involved in these retractions about their experiences and lessons learned. Also, an update will be given on progress of a NISO Working Group on the dissemination of retraction information.

Sarah Jenkins, Acting Senior Director, Research Integrity & Publishing Ethics, Elsevier
Using data science to aid large-scale ethics investigations

Investigations into ethical concerns are increasingly complex and present a particular challenge when cases involve many papers. The time taken to investigate these cases to enable Editors to make decisions on the correction of the scientific record is frustrating for the scientific and medical communities. Recently, Elsevier’s Research Integrity and Legal Teams have partnered with the Data Science team to investigate misconduct by gathering and analysing data more swiftly, facilitating communications with the authors and - ultimately - decisions by the Editors. The work is being refined with each investigation and is leading to faster investigations which maintain their precision and the integrity of the process.

Mike Streeter, Director, Research Integrity & Publishing Ethics, Wiley
Tamara Welschot, Head of Research Integrity, Prevention, Springer Nature
Caitlin Bakker, Discovery Technologies Librarian, Dr. John Archer Library, University of Regina

11:00

Refreshment break & networking

11:30

Lightning talks - tools & services for supporting research integrity

Moderated by: Hylke Koers, Chief Information Officer, STM Solutions

Adam Day, Director, Clear Skies (Paper Mill Alarm)

Daniel Acuna, Associate Professor, Department of Computer Science University of Colorado at Boulder

Quality Control for ChatGPT using the Scientific Literature
Josh Nicholson, Co-founder and CEO, Scite

Online presentations from:

Chuanjiang He, Figcheck
Dror Kolodkin-Gal, Proofig
Markus Zlabinger, ImageTwin
David Shawah, Imachek

12.45

Lunch and networking

13:45

ORCID’s Trust Markers

Moderated by: Deborah Kahn, COPE Trustee, and Research Integrity Consultant

Chris Shillum, Executive Director, ORCID

In the aftermath of the explosion of rapidly published research in response to the COVID pandemic, and with the increasing proliferation of cases of fraudulent authorship, along with worries about impact of a new generation of AI-enabled chatbots, research integrity is a growing concern across the entire research enterprise. Screening submissions to check they meet basic research integrity criteria is an increasingly time-consuming and difficult tasks for editors and editorial office staff. ORCID records contain much data that can help with this process, such as validated researcher affiliations, publications records, and records of peer review activity.

Currently, this information can be complex and time-consuming for editors to discover and assess. ORCID believes that this process could be made easier and quicker by providing editors with a simple-to-understand summary of ‘trust markers’ in context within the editorial system, making it easier to identify fraudulent and low-quality submissions. We are seeking partners from the publishing and editorial system vendor communities to conduct a joint pilot to explore the value, usability, and feasibility of this concept.

14.30

ChatGPT: Detection & Policy considerations

Moderated by: Joris van Rossum, Product Director, STM Integrity Hub

George Tsatsaronis, Vice President Data Science, Research Content Operations, Elsevier
Text-to-Text Generative AI: Risks & Opportunities for the Scientific Publishing Industry
The quick evolution and re-birth of brain-inspired Artificial Intelligence in the last 10 years has led to some fascinating breakthroughs that have affected academia and industry both. The area of Generative AI is flourishing, and text-to-text generative AI applications are gradually making their appearance in every aspect of our everyday life. For the scientific publishing industry, this means plenty of new opportunities, but in parallel a number of threats; indicatively, one of the key open questions is: Are we able to detect text that is generated by Large Language Models? An overview of the latest technical developments will be given, opening up the discussion on some possibilities, as well as limitations and risks faced by all users and beneficiaries of this fascinating technology.

Aaron Yaverski, Regional Vice President of EMEA, Turnitin

Sabina Alam, Director of Publishing Ethics and Integrity, Taylor & Francis
After the introduction of GPT-3, many publishers have developed author policies for the use of Generative AI tools. In this session, Sabina will provide an overview of these policies, including the one at Taylor & Francis.

15.15

Refreshment break & networking

15:45

Experience with using detection software for image manipulation

Moderated by: Tony Alves, Senior Vice President, HighWire Press

Eric Pesanelli, Publisher, Art, American Physiological Society

Shay O'Neill, Peer Review & Research Integrity Manager, Dove Medical Press 

Atul Udgata, Research Integrity Manager, Taylor & Francis Group

16:15

Blue sky thinking session: What other things can we do to protect research integrity?

Moderated by: Joris van Rossum, Product Director, STM Integrity Hub
Hylke Koers, Chief Information Officer, STM Solutions

Break-out session

17:15

Meeting wrap-up and close