arXiv Bans Authors for Unchecked AI Content for One Year

arXiv will now ban authors for one year if they submit papers with unverified AI writing. This is a new rule to stop fake information in science papers.
By Newsroom | Science, Technology |

arXiv, the widely-used preprint repository for academic research, has implemented a new policy: authors submitting papers with "incontrovertible evidence" of unchecked AI-generated content will face a one-year ban from the platform. This move targets what is being termed "AI slop," including fabricated citations and leftover AI instructions, aiming to uphold the integrity of the scientific preprint ecosystem. The core of the new enforcement targets submissions where authors fail to verify results generated by large language models (LLMs), leading to the inability to trust any part of the submitted work.

arXiv imposes one-year ban for unchecked LLM output | Let's Data Science - 1

The repository’s chair for the computer science section, Thomas Dietterich, communicated this stance on X (formerly Twitter), emphasizing author responsibility. If generative AI tools produce inappropriate language, plagiarized content, bias, errors, or misleading information, and this output is included in scientific works without proper vetting, the authors are accountable. Examples of "incontrovertible evidence" cited include "hallucinated references" and direct meta-comments from AI, such as prompts asking for revisions or indicating illustrative data.

Read More: Liquid Crystals: New Discovery Could Lead to Energy-Saving Tech

arXiv imposes one-year ban for unchecked LLM output | Let's Data Science - 2

While arXiv has not published a formal, separate policy update on its main pages, reports indicate this enforcement measure is now in effect. This policy shift appears to be a reaction to an increasing volume of low-quality, automated submissions. The stated primary goal is to "reduce the volume of low-quality, automated submissions that threaten the reliability of the preprint ecosystem." The implementation of such a strict ban signals a significant step in content moderation for academic platforms and is expected to set a precedent for other journals and preprint servers navigating the rise of AI in research workflows.

Frequently Asked Questions

Q: What new rule has arXiv put in place regarding AI content?
arXiv will now ban authors for one year if their submitted papers show clear signs of unchecked AI writing, such as fake references or AI instructions.
Q: Why has arXiv made this change to its policy?
The platform wants to stop the growing number of low-quality, automated submissions that hurt the trust in scientific research papers.
Q: Who is responsible if AI-generated content in a paper has errors or bias?
Authors are fully responsible for any AI content they include in their work, even if it contains errors, bias, or fake information, and must check it carefully.
Q: What counts as 'incontrovertible evidence' of unchecked AI output?
This includes things like fake citations that do not exist and direct comments from the AI tool itself, like notes on how to change the text.