Research repository ArXiv will ban authors for a year if they let AI do all the work

ArXiv, the prominent open-access repository for preprint research, is intensifying its efforts to tackle the irresponsible application of large language models (LLMs) in scientific publications. Despite being a platform for unreviewed submissions, ArXiv has gained significant traction as a key conduit for research dissemination in fields such as computer science and mathematics. It also serves as a vital source of insights into research trends. To address the increasing prevalence of subpar, AI-generated papers, ArXiv has implemented measures like requiring new contributors to obtain endorsements from established authors. Following over two decades of hosting by Cornell University, ArXiv is transitioning to an independent nonprofit organization, which aims to enhance funding opportunities to mitigate issues related to AI-generated content. In a recent announcement, Thomas Dietterich, chair of ArXiv's computer science section, stated that submissions demonstrating clear evidence of negligence regarding LLM outputs would raise significant trust concerns. Such evidence might include fabricated references or misleading comments generated by the LLM. Under these guidelines, authors found guilty of such negligence could face a one-year ban from submitting to ArXiv, and future submissions would necessitate acceptance from a recognized peer-reviewed publication. While this policy does not outright ban the use of LLMs, it emphasizes the need for authors to take complete responsibility for their content, regardless of its origin. According to Dietterich, if researchers incorporate any inappropriate, plagiarized, or erroneous content from an LLM, they remain accountable for those issues. He described the enforcement as a 'one-strike' policy, although moderators will need to verify concerns and section chairs must confirm any evidence before penalties are applied. Authors will also have the option to appeal such decisions. Recent studies have indicated a rise in fabricated citations within biomedical research, a trend that can be attributed to LLMs. However, it is important to note that scientists are not the only group facing scrutiny for utilizing fabricated citations created by AI.