Beyond memorization: Text generators may plagiarize beyond 'copy and paste'
Language models, possibly including ChatGPT, paraphrase and reuse ideas from training data without citing the source, raising plagiarism concerns
Peer-Reviewed PublicationUNIVERSITY PARK, Pa. — Students may want to think twice before using a chatbot to complete their next assignment. Language models that generate text in response to user prompts plagiarize content in more ways than one, according to a Penn State-led research team that conducted the first study to directly examine the phenomenon.
“Plagiarism comes in different flavors,” said Dongwon Lee, professor of information sciences and technology at Penn State. “We wanted to see if language models not only copy and paste but resort to more sophisticated forms of plagiarism without realizing it.”
The researchers focused on identifying three forms of plagiarism: verbatim, or directly copying and pasting content; paraphrase, or rewording and restructuring content without citing the original source; and idea, or using the main idea from a text without proper attribution. They constructed a pipeline for automated plagiarism detection and tested it against OpenAI’s GPT-2 because the language model’s training data is available online, allowing the researchers to compare generated texts to the 8 million documents used to pre-train GPT-2.
The scientists used 210,000 generated texts to test for plagiarism in pre-trained language models and fine-tuned language models, or models trained further to focus on specific topic areas. In this case, the team fine-tuned three language models to focus on scientific documents, scholarly articles related to COVID-19, and patent claims. They used an open-source search engine to retrieve the top 10 training documents most similar to each generated text and modified an existing text alignment algorithm to better detect instances of verbatim, paraphrase and idea plagiarism.
The team found that the language models committed all three types of plagiarism, and that the larger the dataset and parameters used to train the model, the more often plagiarism occurred. They also noted that fine-tuned language models reduced verbatim plagiarism but increased instances of paraphrase and idea plagiarism. In addition, they identified instances of the language model exposing individuals’ private information through all three forms of plagiarism. The researchers will present their findings at the 2023 ACM Web Conference, which takes place April 30-May 4 in Austin, Texas.
“People pursue large language models because the larger the model gets, generation abilities increase,” said lead author Jooyoung Lee, doctoral student in the College of Information Sciences and Technology at Penn State. “At the same time, they are jeopardizing the originality and creativity of the content within the training corpus. This is an important finding.”
The study highlights the need for more research into text generators and the ethical and philosophical questions that they pose, according to the researchers.
“Even though the output may be appealing, and language models may be fun to use and seem productive for certain tasks, it doesn’t mean they are practical,” said Thai Le, assistant professor of computer and information science at the University of Mississippi who began working on the project as a doctoral candidate at Penn State. “In practice, we need to take care of the ethical and copyright issues that text generators pose.”
Though the results of the study only apply to GPT-2, the automatic plagiarism detection process that the researchers established can be applied to newer language models like ChatGPT to determine if and how often these models plagiarize training content. Testing for plagiarism, however, depends on the developers making the training data publicly accessible, said the researchers.
The current study can help AI researchers build more robust, reliable and responsible language models in future, according to the scientists. For now, they urge individuals to exercise caution when using text generators.
“AI researchers and scientists are studying how to make language models better and more robust, meanwhile, many individuals are using language models in their daily lives for various productivity tasks,” said Jinghui Chen, assistant professor of information sciences and technology at Penn State. “While leveraging language models as a search engine or a stack overflow to debug code is probably fine, for other purposes, since the language model may produce plagiarized content, it may result in negative consequences for the user.”
The plagiarism outcome is not something unexpected, added Dongwon Lee.
“As a stochastic parrot, we taught language models to mimic human writings without teaching them how not to plagiarize properly,” he said. “Now, it’s time to teach them to write more properly, and we have a long way to go.”
The National Science Foundation supported this work.
ARTICLE TITLE
Do Language Models Plagiarize?
ARTICLE PUBLICATION DATE
13-Feb-2023
Adapting intellectual property law for AI
governance
AMERICAN ASSOCIATION FOR THE ADVANCEMENT OF SCIENCE (AAAS)
The rapidly evolving and expanding use of artificial intelligence (AI) technology is outpacing regulatory and policy efforts to guide its ethical use. In a Policy Forum, Cason Schmit and colleagues propose a new approach to AI regulation, which involves leveraging two existing legal tools used to manage intellectual property (IP) rights – copyleft licensing and patent trolling. They call their approach CAITE (Copyleft AI with Trusted Enforcement). The swift development and widespread adoption of AI technology have consistently outpaced regulatory oversight, which has largely resulted in insufficient policy. However, given AI’s potential impact on nearly every aspect of daily life, regulation ensuring its appropriate and ethical use is sorely needed. To address this need, Schmit et al. propose adapting legal frameworks and mechanisms borrowed from IP law to produce a new and nuanced system of enforcement of ethics in AI applications and training datasets. By combining “copyleft licensing,” which is traditionally used to enable widespread sharing of created content, and the “patent troll” model, which is often criticized for stifling technological development, Schmit et al. develop the CAITE governance model for ethical AI. Under the CAITE model, AI products and any derivatives based upon them would be bound by a set of ethical terms and conditions. Enforcement of Ethical Use Licenses would be assigned to a central trusted entity, which ideally would be led by a community-designated, nongovernment group of AI developers and users. According to the authors, the CAITE system both incentivizes and enforces ethical AI practices in a way that is flexible and community-driven, which could provide soft law support for traditional government oversight.
As a supplement to the Policy Forum, Schmit asked ChatGPT (an AI chatbot) to provide insights into how ethical AI use should be governed. While the output provided a reasonable summary of important considerations, the AI glossed over the more difficult questions, like how governance should be implemented. An image of the results from the query is available in the multimedia section of the press package.
JOURNAL
Science
ARTICLE TITLE
Leveraging IP for AI governance
ARTICLE PUBLICATION DATE
17-Feb-2023
No comments:
Post a Comment