Journal of Data and Information Science · 2024

Detecting LLM-assisted writing in scientific communication: Are we there yet?

Teddy Lazebnik, Ariel Rosenfeld

Affiliations
  1. Department of Mathematics, Ariel University, Ariel, Israel
  2. Department of Cancer Biology, Cancer Institute, University College London, London, UK
  3. Department of Information Science, Bar Ilan University, Ramat Gan, Israel
Download PDF Read the paper
ACML authorsTeddy LazebnikPI

The paper at a glance

Researchers are expected to acknowledge when large language models (LLMs) such as ChatGPT help write their papers, yet such acknowledgment remains rare. We evaluated four leading detectors of LLM-generated text and compared them with a simple ad-hoc detector that looks for abrupt changes in writing style around the time LLMs spread. The existing detectors performed worse than the simple one, so we argue that dedicated detectors built specifically for LLM-assisted writing are needed.

Key findings

  • Four cutting-edge detectors of LLM-generated text showed suboptimal performance.
  • A simple ad-hoc detector of abrupt writing style changes around the time of LLM proliferation outperformed them.
  • We argue for specialized detectors dedicated to LLM-assisted writing to encourage more authentic acknowledgment of LLM use in science.
Figure 1. A schematic view of the LLM-Assisted Writing (LAW) detector. The detection process consists of two phases: First, during training, manuscripts are converted into vectors representing the author’s writing style using the technique provided in (Lazebnik & Rosenfeld, 2023). The average change and standard deviation of the presented writing style are measured to capture the dynamics in one’s writing style. Then, during inference, for each manuscript, we examine whether the change in its author’s writing style is substantial enough to be considered an anomaly and whether this anomaly is aligned with the style of an LLM-generated manuscript of the same title and abstract. If both conditions are met, the manuscript is deemed as an LLM-assisted manuscript.
Figure 1. A schematic view of the LLM-Assisted Writing (LAW) detector. The detection process consists of two phases: First, during training, manuscripts are converted into vectors representing the author’s writing style using the technique provided in (Lazebnik & Rosenfeld, 2023). The average change and standard deviation of the presented writing style are measured to capture the dynamics in one’s writing style. Then, during inference, for each manuscript, we examine whether the change in its author’s writing style is substantial enough to be considered an anomaly and whether this anomaly is aligned with the style of an LLM-generated manuscript of the same title and abstract. If both conditions are met, the manuscript is deemed as an LLM-assisted manuscript. See it in the paper
On this page
  1. Abstract
  2. 1 Introduction
  3. 2 Methods and materials
  4. 2.1 Data
  5. 2.2 LLM-generated text detectors
  6. 2.3 Alternative detector
  7. 3 Results
  8. 4 Discussion
  9. Funding information
  10. Data availability
  11. Author contributions
  12. Statement of using AIGC
  13. Appendix
  14. 3 Further statistical analysis
  15. Agreement levels
  16. Notes
  17. Article notes
  18. References

Abstract

Large Language Models (LLMs), exemplified by ChatGPT, have significantly reshaped text generation, particularly in the realm of writing assistance. While ethical considerations underscore the importance of transparently acknowledging LLM use, especially in scientific communication, genuine acknowledgment remains infrequent. A potential avenue to encourage accurate acknowledging of LLM-assisted writing involves employing automated detectors. Our evaluation of four cutting-edge LLM-generated text detectors reveals their suboptimal performance compared to a simple ad-hoc detector designed to identify abrupt writing style changes around the time of LLM proliferation. We contend that the development of specialized detectors exclusively dedicated to LLM-assisted writing detection is necessary. Such detectors could play a crucial role in fostering more authentic recognition of LLM involvement in scientific communication, addressing the current challenges in acknowledgment practices.

1 Introduction

Sophisticated Large Language Models (LLMs), such as ChatGPT, have become highly effective in comprehending and generating human-like texts and have become pivotal in various applications, including writing assistance (Seßler et al., 2023). From an ethical standpoint, appropriately acknowledging the use of LLMs is conscientious as Journal of Data and Information Science it underscores a commitment to transparency, honesty, and integrity in writing (Sallam, 2023). In scientific communication, where the pursuit and dissemination of knowledge are deeply guided by these principles (Sikes, 2009), clearly articulating the involvement of these models in the writing process is of great importance (Bin- Nashwan et al., 2023). Indeed, such acknowledgment is mandated by most publishers (Nature editorial, 2023). Unfortunately, the current landscape presents a formidable challenge in terms of enforcing the explicit acknowledgment of LLMs in general and in scientific communication in particular. First, the evolving capabilities of LLMs and their intricate role in the writing process introduce uncertainty and ambiguity, thus estimating the extent of LLM influence and establishing clear boundaries for acknowledgment can be elusive. In addition, certain authors may hesitate to overtly admit their use of LLM for various reasons, including a traditional authorship viewpoint, concerns about potential negative perceptions, or the lack of established guidelines in this regard, to name a few (Draxler et al., 2023).

One promising strategy to promote genuine disclosure of LLM usage involves the development of automated tools for LLM use detection. Indeed, various detectors were created for distinguishing between human and LLM- generated texts (Tang et al., 2023). Nevertheless, these detectors need not necessarily be proficient in detecting LLM-assisted writing, as they were not originally designed for this purpose. To our knowledge, the automated detection of LLM-assisted writing in scientific communication has yet to be explicitly considered by the scientific community.

In this work, we investigate the viability of using four state-of-the-art LLM-generated text detectors for detecting LLM-assisted writing in scientific communication. Our findings reveal subpar performance, raising substantial concerns regarding the practical value of using these models to detect potentially undisclosed LLM-assisted writing. To make the case for the viability of the LLM-assisted writing detection challenge, we present and evaluate an alternative detector designed for identifying abrupt “writing style changes” occurring around the period of LLM proliferation, which can reasonably be associated with LLM writing. While our proposed approach need not claim optimality and is limited in several respects, it does demonstrate a noteworthy improvement compared to existing detectors, indicating that the challenge of detecting LLM-assisted writing remains unsolved.

2 Methods and materials

2.1 Data

Journal of Data and Information Science For our evaluation, we curated two data sets: First, an assessment set consisted of a meticulously garnered set of twenty-two scientific publications in the form of eleven matched samples. Specifically, we manually identified and extracted eleven publications where ChatGPT was either listed as a co-author or appropriately acknowledged in the text. As these publications self-evidently belong to the “LLM-Assisted” category, for each of these publications, a counterpart publication that was authored by the leading human author (i.e. first author) during the 2021- 2022 period was matched, resulting in eleven paired samples. Note that the publications chosen from the 2021- 2022 period are assumed to be free of any LLM influences given that this period predates LLM proliferation (Lund & Wang, 2023). The full list of publications considered is provided in Appendix 1. Second, a false-positive set was assembled, comprising of a varied compilation of 1,094 publications published in or before 2022 (i.e. devoid of any LLM influences). The curation process, which is detailed in Appendix 2, follows a similar technique to that presented in recent literature (Alexi et al., 2024; Zargari et al., 2023). The resulting false-positive set consists of full-text manuscripts from established authors across diverse academic institutions, disciplines, and ranks.

2.2 LLM-generated text detectors

We consider four state-of-the-art open-access LLM-generated text detectors: DetectLLM (Su et al., 2023), Zippy, LLMDet (Wu et al., 2023), and ConDA (Bhattacharjee et al., 2023). These four detectors exemplify the two predominant approaches in detecting LLM-generated text: zero-shot, represented by the first two detectors, meaning they do not necessitate additional input during inference other than the provided text of interest; and few-shot, represented by the latter two detectors, re- quiring a small number of reference samples for their inference. We utilized the implementations of these detectors as originally published by their authors for our analysis. It is worth noting that two of the detectors offer a “soft classification”, meaning they provide a continuous measure that requires conversion into a “hard classification”, i.e. a binary label of “LLM-assisted” or not. We tune these decision threshold parameters using a simple grid search approach with the assessment set.

2.3 Alternative detector

We further evaluate a simple writing style-based approach for detecting LLM-assisted writing. The approach is based on the premise that a sudden change in one’s writing style around the time of LLM proliferation could potentially indicate LLM-assisted writing, especially if the change aligns with LLM writing style. Our detector, which we term the LLM-Assisted Writing (LAW) detector for simplicity, works as illustrated in Figure 1: First, for training, we adopt the writing style modeling technique provided by (Lazebnik & Rosenfeld, 2023), and for a given author a, we Journal of Data and Information Science use the most recent publications made in or before 2022 (i.e. free of LLM influences) for modeling the author’s writing style dynamics. Specifically, since one’s writing style may vary over time regardless of LLM influences (Lazebnik & Rosenfeld, 2023), we measure the average change in the presented writing style from one publication to the next, and the standard deviation of this change, for the most recent six LLM-free publications, denoted Avg(a) and STD(a), respectively. Then, at the inference phase, for a given publication made in 2023 by a, we use a naive anomaly detection approach and consider the publication anomalous if its writing style significantly differs from a’s earlier publications by at least Avg(a) + STD(a). Note that slight variations to the above definitions, such as relying on a different number of prior publications (i.e. between 2 and 10) for computing Avg(a) and STD(a) and/or using a Avg(a) + k ‧ STD(a) (with k instead of k=1) bring about highly similar outcomes using our data and thus are not considered separately. For an identified anomaly, we compute the difference between its writing style vector and the average writing style vector computed for earlier works, resulting in a so-called “delta vector”. Intuitively, this vector represents the unique characteristics of the given publication compared to earlier publications. To attribute these changes to LLM assistance we follow (Semrl et al., 2023), and provide an LLM of interest with the title and abstract of the publication, asking it to generate an academic manuscript, using the following query: “You are a scholar working on a new academic manuscript. The title of the manuscript is: <title-goes-here>. The abstract of the Journal of Data and Information Science manuscript is: <abstract-goes-here>. Please write the entire manuscript.” Once the LLM-written manuscript was obtained, we computed the cosine similarity between the delta vector and the writing style vector of the LLM-written text. Finally, if the similarly is higher than a given decision threshold parameter θ, the anomaly is classified as LLM-assisted writing. We tune this parameter using a grid search, as before.

A schematic view of the LLM-Assisted Writing (LAW) detector
Figure 1. A schematic view of the LLM-Assisted Writing (LAW) detector. The detection process consists of two phases: First, during training, manuscripts are converted into vectors representing the author’s writing style using the technique provided in (Lazebnik & Rosenfeld, 2023). The average change and standard deviation of the presented writing style are measured to capture the dynamics in one’s writing style. Then, during inference, for each manuscript, we examine whether the change in its author’s writing style is substantial enough to be considered an anomaly and whether this anomaly is aligned with the style of an LLM-generated manuscript of the same title and abstract. If both conditions are met, the manuscript is deemed as an LLM-assisted manuscript.

3 Results

Table 1 presents the results of each model in terms of accuracy, F1 score, recall, precision, and false positive rate. Starting with the assessment data, the LAW detector favorably compares to the LLM-generated text detectors by providing a marginal improvement between 0.09 and 0.181 in accuracy, between 0.1 and 0.414 in terms of F1 score, between 0.073 and 0.366 in terms of recall and between 0.125 and 0.45 in terms of precision. Similarly, for the false-positive set, the LAW detector favorably compares to the baseline detectors by providing a marginal improvement between 5.7% and 14.1% in the false positive rate.

Statistically, the five detectors do not differ significantly on the assessment set given its very limited size (11 paired samples). Nevertheless, the detectors statistically differ in their performance on the false positive set χ2 = 133, p < 0.001 with the LAW detector statistically outperforming three out of the four detectors at p < 0.001 following a Bonferroni post-hoc correction. The complete pair-wise comparison between the detectors, along with their agreement levels, are provided in Appendix 3.

Table 1. The performance of the examined detectors (columns) on the assessment set (first row) and the false- positive set (second row). The performance is presented as the accuracy with the F1-score in brackets (for the assessment set) and as the false positive rate (for the false-positive set).
ModelLLMDetDetectLLMZipPyConDALAW
Accuracy0.5460.5910.6370.6370.727
F1-score0.2860.4710.6000.6000.700
Recall0.3340.5340.6270.6270.700
Precision0.2500.4210.5750.5750.700
False Positive17.2%13.8%9.7%8.8%3.1%

4 Discussion

The observed results suggest that existing state-of-the-art LLM-generated text detectors are suboptimal, at the very least, for the task of detecting LLM-assisted writing in scientific communication. This subpar performance is manifested as low Journal of Data and Information Science accuracy, F1-scores, and high false positive rate, particularly when contrasted with the simple writing style change detector we implemented in this study. We contend that these results should prompt a call for the development of specialized detectors, exclusively dedicated to LLM-assisted writing detection, aiming for more robust performance in the near future. We are of the opinion that such development is warranted and could play a pivotal role in fostering more authentic recognition of LLM-assisted writing and, consequently, it has the potential to enhance transparency, honesty, and integrity in scientific communication.

Our study is not without limitations. First, our ad-hoc writing style-based detector is consciously developed to detect an unexpected change in writing style during the time of LLM proliferation. As such, authors with a limited number of publications made prior to that period could not be considered by the detector. Moreover, mild changes in writing style from one publication to the next would likely not be detected, allowing for more substantial undetected LLM-assisted writing over time. In general, applying our detector for future publications would entail a major challenge of determining how and if to use current publications, be they classified by the detector as LLM-assisted or not, for future inference. Regarding our evaluation, it relies on two data sets with the first being relatively small. Unfortunately, at least in the realm of scientific communication, gathering more unsolicited instances of LLM-assisted writing is highly challenging since, as currently believed, most authors who practice LLM-assisted writing avoid explicitly reporting it for a variety of reasons (Dergaa et al., 2023; Yuan et al., 2022).

Funding information

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Data availability

The data that has been used in this study is available by a formal request from the authors.

Author contributions

Teddy Lazebnik (lazebnik.teddy@gmail.com): Conceptualization, Methodology, Software, Formal analysis, Investigation, Visualization, Project administration, Writing - Review & Editing.

Journal of Data and Information Science Ariel Rosenfeld (ariel.rosenfeld@biu.ac.il): Conceptualization, Methodology, Investigation, Validation, Writing - Original Draft, Writing - Review & Editing.

Statement of using AIGC

The authors used ChatGPT-4 during the writing of the manuscript to improve the wording of the text.

Appendix

1 Assessment set: List of publications

Table A1. List of manuscripts included in the assessment set.

LLM-assisted Writing Counterpart Osterrieder, J., GPTChat, A Primer on Deep Finance, F., Osterrieder, J., Generative Adversarial Reinforcement Learning for Finance, SSRN (2023) Networks in finance: an overview, arXiv (2021) Biswas, S., Will ChatGPT take my Job? Replies and Biswas, S., Role of Sonography in Ocular Advice by ChatGPT, SSRN (2023) Trauma: A Study, ARC Journal of Surgery (2021) Askr, H., Darwish, A., Hassanien, A.E., ChatGPT, The Gad, I., Hassanien, A. E., A wind turbine fault Future of Metaverse in the Virtual Era and Physical identification using machine learning approach World: Analysis and Applications. Studies in Big Data based on pigeon inspired optimizer, Tenth (2023) International Conference on Intelligent Computing and Information Systems (2021) King, M. R., chatGPT, A Conversation on Artificial King, M. R., CMBE Moves to the Structured Intelligence, Chatbots, and Plagiarism in Higher Abstract Format: A Note from the Editor, Cellular Education, Cellular and Molecular Bioengineering and Molecular Bioengineering (2017) (2023) Kung et al., Performance of ChatGPT on USMLE: Kung, H. K., Host physician perspectives to Potential for AI-Assisted Medical Education Using improve predeparture training for global health Large Language Models, medRxiv (2022) electives, medical education (2017) O’Connor S., Open artificial intelligence platforms in O’Connor S., Exoskeletons in Nursing and nursing education: Tools for academic progress or Healthcare: A Bionic Future, Clinical nursing abuse?, Nurse Education in Practice (2022) research (2021) Rossoni, L., A inteligencia artificial e eu: escrevendo o ˆ Rossoni, L., Editorial: A RECADM no Redalyc e editorial juntamente com o ChatGPT, Revista Eletronica o Dilema das Bases e Indexadores, Revista ˆ de Ciencia Administrativa (2022) Eletronica de ˆ Ciencia Administrativa (2021) chatGPT, Zhavoronkov, A., Rapamycin in the context of Zhavoronkov, A., The inherent challenges of Pascal’s Wager: generative pre-trained transformer classifying senescence, Science (2020) perspective, Oncoscience (2022) Biswas, S., ChatGPT and the Future of Medical Writing, Biswas, S., Biswas, S., A Study on penile doppler, Radiology (2023) MedCrave Online Journal of Surgery (2017) Lazebnik, T., ChatGPT, The Impact of Fruit and Lazebnik, T., Bunimovich-Mendrazitsky, S., The Vegetable Consumption and Physical Activity on Signature Features of COVID-19 Pandemic in a Diabetes Risk among Adults, arXiv (2022) Hybrid Mathematical Model—Implications for Optimal Work–School Lockdown Policy, Advanced Theory and Simulations (2021) BaHammam, A. S., Trabelsi, K., Pandi-Perumal, S. R., Akhtar, N., Ravi Gupta, S.R. Pandi-Perumal, Jahrami, H., Adapting to the Impact of AI in Scientific Ahmed S. BaHammam: Clinical Atlas of Writing: Balancing Benefits and Drawbacks while Polysomnography: A Book Review, Sleep and Developing Policies and Regulations, Journal of Nature Vigilance (2021) and Science of Medicine (2023)

Journal of Data and Information Science 2 False-positive set: Curation process

We utilized 359 Google Scholar (GS) profiles, originally retrieved and analyzed by Zargari et al. (2023) for different research purposes. These profiles were sampled by the original authors from the top 200 U.S.-based institutions (based on the Shanghai Academic Ranking of National Universities ranking of 2022), covering five disciplines (Life Sciences, Exact Sciences, Law, Humanities, and Social Sciences) and five academic ranks (Adjunct Professor, Assistant Professor, Associate Professor, Full Professor, and Professor Emeritus). For the curation of the false-positive set, these 359 scholars served as “seed” points for a breadth-first search retrieval process through which we extracted these scholars’ GS profiles, their co-authors’ GS profiles, and their co-authors’ co-authors’ GS profiles. Through this process, a set of roughly 120 thousand GS profiles were retrieved. For evaluation purposes, we focus on profiles for which we have full access① to at least six publications made in or before 2022 (for training) and at least one additional publication made in or before 2022 (for inference). Overall, 1,094 profiles met the above requirements. For each of these profiles, the most recent publication made in or before 2022 was included in the false-positive set.

3 Further statistical analysis

Pair-wise comparisons

Table A2. Pairwise comparison between the five detectors. The results are shown as p value with the statistics in brackets. Each cell contains the results for the assessment set on the left, and the results for the false positive set on the right.
LLMDetDetectLLMZipPy ConDA
DetectLLM0.66(0.19)/< 0.01(10.45)
ZipPy0.38(0.78)/< 0.01(69.63)0.66(0.20)/< 0.01(20.96)
ConDA0.06(3.67)/< 0.01(95.71)0.66(0.20)/< 0.01(34.21)1.0(0.0)/0.28(1.13)
LAW0.01(0.03)/< 0.01(729.19)0.15(2.06)/< 0.01(34.21)0.34(0.92)/< 0.01(161.74) 0.34(0.92)/< 0.01(120.46)

Agreement levels

The Fleiss’ κ calculated between the five detectors in question is 0.78. Table A3 reports the pairwise Cohan’s κ.

Journal of Data and Information Science assessment set on the left, and the results for the false positive set on the right.

Table A3. Pairwise Cohan’s κs calculated for the five detectors. Each cell contains the results for the
DetectLLMZipPyConDALAW
LLMDet0.86 / 0.820.68 / 0.740.67 / 0.720.63 / 0.69
DetectLLM0.72 / 0.760.67 / 0.750.59 / 0.62
ZipPy0.86 / 0.960.77 / 0.88
ConDA0.81 / 0.90

Notes

① Through our institutions’ publisher agreements or open access.

Article notes

Publication history
Received 6 March 2024 · Accepted 26 June 2024
Keywords
  • LLM-assisted writing
  • Scientific communication
  • Writing style

References

  • Alexi, A., Lazebnik, T., & Rosenfeld, A. (2024). The scientometrics and reciprocality underlying co-authorship panels in Google Scholar profiles. Scientometrics, 1–11. doi:10.1007/s11192-024-05026-y
  • Bhattacharjee, A., Kumarage, T., Moraffah, R., & Liu, H. (2023). Conda: Contrastive domain adaptation for AI-generated text detection. In Proceedings of the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (pp. 598–610). Association for Computational Linguistics.
  • Bin-Nashwan, S. A., Sadallah, M., & Bouteraa, M. (2023). Use of ChatGPT in academia: Academic integrity hangs in the balance. Technology in Society, 75, 102370.
  • Dergaa, I., Chamari, K., Zmijewski, P., & Ben Saad, H. (2023). From human writing to artificial intelligence generated text: Examining the prospects and potential threats of ChatGPT in academic writing. Biology of Sport, 40(2), 615–622.
  • Draxler, F., Werner, A., Lehmann, F., Hoppe, M., Schmidt, A., Buschek, D., & Welsch, R. (2023). The AI ghostwriter effect: When users do not perceive ownership of AI-generated text but self-declare as authors. arXiv:2303.03283
  • Editorial. (2023). Tools such as ChatGPT threaten transparent science; here are our ground rules for their use. Nature, 613.
  • Lazebnik, T., & Rosenfeld, A. (2023). A computational model for individual scholars’ writing style dynamics. arXiv:2305.04900
  • Lund, B. D., & Wang, T. (2023). Chatting about ChatGPT: How may AI and GPT impact academia and libraries? Library Hi Tech News, 40(3), 26–29.
  • Sallam, M. (2023). ChatGPT utility in healthcare education, research, and practice: Systematic review on the promising perspectives and valid concerns. Healthcare, 11(6), 887.
  • Seßler, K., Xiang, T., Bogenrieder, L., & Kasneci, E. (2023). Peer: Empowering writing with large language models. In O. Viberg, I. Jivet, P. Muñoz-Merino, M. Perifanou, & T. Papathoma (Eds.), Responsive and sustainable educational futures (pp. 755–761). Lecture Notes in Computer Science, vol 14200. Springer, Cham. doi:10.1007/978-3-031-42682-7_73
  • Semrl, N., Feigl, S., Taumberger, N., Bracic, T., Fluhr, H., Blockeel, C., & Kollmann, M. (2023). AI language models in human reproduction research: Exploring ChatGPT’s potential to assist academic writing. Human Reproduction, 38(12), 2281–2288.
  • Journal of Data and
  • Information Science
  • Journal of Data and Information Science
  • Perspectives Sikes, P. (2009). Will the real author come forward? Questions of ethics, plagiarism, theft and collusion in academic research writing. International Journal of Research & Method in Education, 32(1), 13–24. Su, J., Zhuo, T. Y., Wang, D., & Nakov, P. (2023). DetectLLM: Leveraging log rank information for zero-shot detection of machine-generated text. arXiv:2306.05540 Tang, R., Chuang, Y.-N., & Hu, X. (2023). The science of detecting LLM-generated texts. arXiv:2303.07205 Wu, K., Pang, L., Shen, H., Cheng, X., & Chua, T.-S. (2023). LLMDet: A third party large language models generated text detection tool. In H. Bouamor, J. Pino, & K. Bali (Eds.), Findings of the Association for Computational Linguistics: EMNLP 2023 (pp. 2113–2133). Association for Computational Linguistics. Yuan, A., Coenen, A., Reif, E., & Ippolito, D. (2022). Wordcraft: Story writing with large language models. In Proceedings of the 27th International Conference on Intelligent User Interfaces (IUI '22). Association for Computing Machinery, New York, NY, USA, 841–852. Zargari, H., Rosenfeld, A., & Elmalech, A. (2023). Online self-presentation: Examining gender differences in academic scholars’ personal web-pages. In Proceedings of iConference 2023. Copyright: © 2024 Teddy Lazebnik, Ariel Rosenfeld. Published under a Creative Commons Attribution 4.0 International (CC BY 4.0) license. doi:10.1145/3490099.3511105
  • Journal of Data and
  • Information Science

This page reproduces the article Lazebnik et al. (2024), Journal of Data and Information Science, with the permission of the publisher. Text, tables and figures were extracted from the PDF and the layout adapted for the web; the PDF is the version of record.

Research projectA Biologically-Informed and Data-Driven Approach to ScientometricsLeveraging biological principles and advanced analytics to evaluate scientific impact and trends.Paper · 2026Whose LLM Is It Anyway? Linguistic Comparison and LLM Attribution for GPT-3.5, GPT-4 and BardMathematicsPaper · 2025A computational model for individual scholars' writing style dynamicsJournal of writing research

All publications

Cite this paper

APA

Lazebnik, T., & Rosenfeld, A. (2024). Detecting LLM-assisted writing in scientific communication: Are we there yet?. Journal of Data and Information Science.

BibTeX

@article{lazebnik2024detecting,
  title = {Detecting LLM-assisted writing in scientific communication: Are we there yet?},
  author = {Lazebnik, Teddy and Rosenfeld, Ariel},
  journal = {Journal of Data and Information Science},
  year = {2024}
}