.png){kind=logo}
PROMPTING BEHAVIOR GENERATIVE AI BY POSTGRADUATE STUDENTS OF STATE UNIVERSITY OF MALANG IN WRITING SCIENTIFIC ARTICLES
Abstract
This study aims to identify patterns of prompting behavior of graduate students of State University of Malang in utilizing Generative AI, especially ChatGPT, for scientific article writing. Using a qualitative approach based on grounded theory, data was collected through in-depth interviews with two main informants. The results showed that students applied a systematic and iterative prompting approach in five main aspects: input semantics, output customization, error identification, prompt improvement, and interaction & context control. Analysis through open, axial, and selective coding stages resulted in the SURE Framework (Strategic Prompt Design, Utilization & Output Optimization, Refinement & Iterative Interaction, Evaluation & Academic Validation), which describes the practice of active and reflective use of GenAI in an academic context.[LI1] This research contributes to a deeper understanding of human-GenAI interaction in academic contexts. It underscores the importance of prompting literacy as a critical skill to enhance the effectiveness and integrity of AI-assisted scientific writing. Furthermore, the findings highlight the need for developing digital and information literacy among students and academics, in line with the demands of the digital era. Specifically, within the field of Library and Information Science, this study provides a foundational perspective for designing adaptive curricula that integrate digital technologies into learning, research, and information management. Such an adaptive curriculum is expected to equip students with the ability to use AI tools more effectively and ethically in academic settings. Additionally, the study offers practical insights for improving academic information management systems, thereby promoting more efficient and relevant learning and research processes. Overall, this research bridges the gap between emerging AI technologies and pedagogical innovation in higher education.
Keywords
Full Text:
PDFReferences
Babl, Franz E., and Maximilian P. Babl. 2023. “Generative Artificial Intelligence: Can ChatGPT Write a Quality Abstract?” EMA - Emergency Medicine Australasia 35(5):809–11. doi: 10.1111/1742-6723.14233.
Banh, Leonardo, and Gero Strobel. 2024. “Generative Artificial Intelligence.” Electronic Markets 33(1):1–17. doi: 10.1007/s12525-023-00680-1.
Charmaz, Kathy. 2006. Constructing Grounded Theory: A Practical Guide Through Qualitative Analysis.
Corbin, Juliet, and Anselm Strauss. 2015. Basics of Qualitative Research. SAGE Publication.
Cronjé, Johannes. 2024. “Exploring the Role of ChatGPT as a Peer Coach for Developing Research Proposals: Feedback Quality, Prompts, and Student Reflection.” Electronic Journal of E-Learning 22(2 Special Issue):1–15. doi: 10.34190/ejel.21.5.3042.
Dewi, Anita Candra, Zakiya Firzana, Indri Frastika, Hikma Dwi Putri, Andi Rajeng, and Kata Kunci. 2023. “Strategi Peningkatan Menulis Dalam Membangun Komunikasi Bahasa Tulis Yang Efektif.” Nusantara Journal of Multidisciplinary Science 1(5):1237–47.
Fahky, Adimas Raditya. 2024. “Microsoft: 92 Persen Karyawan Kantoran Di Indonesia Gunakan AI.” ANTARA News. Retrieved (https://www.antaranews.com/berita/4147815/microsoft-92-persen-karyawan-kantoran-di-indonesia-gunakan-ai?utm_source=chatgpt.com).
Feuerriegel, Stefan, Jochen Hartmann, Christian Janiesch, and Patrick Zschech. 2024. “Generative AI.” Business and Information Systems Engineering 66(1):111–26. doi: 10.1007/s12599-023-00834-7.
Geraldi, Joana. 2021. “Plagiarism in Project Studies.” Project Management Journal 52(1):3–10. doi: 10.1177/8756972820982443.
Giray, Louie. 2023. “Prompt Engineering with ChatGPT : A Guide for Academic Writers.” Annals of Biomedical Engineering 51(12):2629–33. doi: 10.1007/s10439-023-03272-4.
Goodfellow, Ian. 2016. “NIPS 2016 Tutorial: Generative Adversarial Networks.”
Haque, Mubin Ul, Isuru Dharmadasa, Zarrin Tasnim Sworna, Roshan Namal Rajapakse, and Hussain Ahmad. 2022. “‘I Think This Is the Most Disruptive Technology’: Exploring Sentiments of ChatGPT Early Adopters Using Twitter Data.” 1–12.
Hartanto, Alfons Yoshio, and Fina Nailur Rohmah. 2024. “Makin Marak Siswa Pakai AI Untuk Mengerjakan Tugas.” Tirto.Id. Retrieved (https://tirto.id/penggunaan-ai-di-dunia-pendidikan-makin-marak-dan-merata-gZax?utm_source=chatgpt.com#google_vignette diakses: 10 Januari 2025).
Huang, Jerry. 2023. “Engineering ChatGPT Prompts for EFL Writing Classes.” International Journal of TESOL Studies 5:73–79. doi: https://doi.org/10.58304/ijts.20230405 Article.
Hwang, Myunghwan, Robert Jeens, and Hee Kyung Lee. 2024. “Exploring Learner Prompting Behavior and Its Effect on ChatGPT-Assisted English Writing Revision.” Asia-Pacific Education Researcher (03722). doi: 10.1007/s40299-024-00930-6.
Hwang, Yohan, Jang Ho Lee, and Dongkwang Shin. 2023. “What Is Prompt Literacy? An Exploratory Study of Language Learners’ Development of New Literacy Skill Using Generative AI.”
Johnston, Heather, Rebecca F. Wells, Elizabeth M. Shanks, Timothy Boey, and Bryony N. Parsons. 2024. “Student Perspectives on the Use of Generative Artificial Intelligence Technologies in Higher Education.” International Journal for Educational Integrity 20(1):1–21. doi: 10.1007/s40979-024-00149-4.
Kingma, Diederik P., and Max Welling. 2013. “Auto-Encoding Variational Bayes.” doi: 10.61603/ceas.v2i1.33.
krzysztof, walczak, and Cellary Wojciech. 2023. “Challenges for Higher Education in the Era of Widespread Access to Generative AI.” Poznań University of Economics and Business Press 2(16).
Lim, Weng Marc, Asanka Gunasekara, Jessica Leigh Pallant, Jason Ian Pallant, and Ekaterina Pechenkina. 2023. “Generative AI and the Future of Education: Ragnar¨ok or Reformation? A Paradoxical Perspective from Management Educators.” The International Journal of Management Education 21(2):100790. doi: 10.1016/j.ijme.2023.100790.
Liu, Yan, and He Wang. 2024. “Who on Earth Is Using Generative AI ?” (August).
Lo, Leo S. 2023. “The CLEAR Path: A Framework for Enhancing Information Literacy through Prompt Engineering.” Journal of Academic Librarianship 49(4):102720. doi: 10.1016/j.acalib.2023.102720.
Łodzikowski, Kacper, Peter W. Foltz, and John T. Behrens. 2023. “Generative AI and Its Educational Implications.” doi: 10.1007/978-3-031-64487-0_2.
Long, Duri, and Brian Magerko. 2020. “What Is AI Literacy? Competencies and Design Considerations | Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems.” Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems 1–16.
Mantell, Mike. 2024. “How to Write AI Prompts That Get Results (& Don’t Suck).” Science of People. Retrieved (https://www.scienceofpeople.com/ai-prompts/ diakses: 15 Maret 2025).
Moleong, lexy J. 2017. METODOLOGI PENELITIAN KUALITATIF (Edisi Revisi). Rosda.
Nashir, Muhammad Hisyam, Teddy Kurnia Wirakusumah, and Dedi Rumawan Erlandia. 2024. “Hubungan Penggunaan ChatGPT Dengan Pemenuhan Kebutuhan Mahasiswa.” Filosofi : Publikasi Ilmu Komunikasi, Desain, Seni Budaya 1(1):129–39. doi: 10.62383/filosofi.v1i1.57.
Niyu, Desideria Dwihadiah, Azalia Gerungan, and Herman Purba. 2024. “Penggunaan ChatGPT Di Kalangan Mahasiswa Dan Dosen Perguruan Tinggi Indonesia.” CoverAge: Journal of Strategic Communication 14(2):130–45. doi: 10.35814/coverage.v14i2.6058.
Novantara, Panji, and Opin Pasruli. 2017. “Implementasi Algoritma Jaro-Winkler Distance Untuk Sistem Pendeteksi Plagiarisme Pada Dokumen Skripsi.” Jurnal Buffer Informatika 3.
O’Dea, Christine, and Mike O’Dea. 2023. “Teaching AI Literacy: How to Begin.” Times Higher Education. Retrieved February 19, 2025 (https://www.timeshighereducation.com/campus/teaching-ai-literacy-how-begin diakses: 8 Januari 2025).
Park, Jiyeon, and Sam Choo. 2024. “Generative AI Prompt Engineering for Educators : Practical Strategies.” 0(0):1–7. doi: 10.1177/01626434241298954.
Putranti, Honorata Ratnawati Dwi. 2023. Metode Penulisan Artikel Ilmiah.
Robinson, Oliver C. 2023. “Probing in Qualitative Research Interviews: Theory and Practice.” Qualitative Research in Psychology 20(3):382–97. doi: 10.1080/14780887.2023.2238625.
Sikha, Vijay Kartik. 2023. “Mastering Prompt Engineering: Optimizing Interaction with Generative AI Agents.” Journal of Engineering and Applied Sciences Technology 5(6):1–8. doi: 10.47363/jeast/2023(5)e117.
Slameto. 2016. “Penulisan Artikel Ilmiah Hasil Penelitian Tindakan Kelas.” Scholaria : Jurnal Pendidikan Dan Kebudayaan 6(2):46. doi: 10.24246/j.scholaria.2016.v6.i2.p46-57.
Steiss, Jacob, Tamara Tate, Steve Graham, Jazmin Cruz, Michael Hebert, Jiali Wang, Youngsun Moon, Waverly Tseng, Mark Warschauer, Carol Booth, Mary Lou, Fulton Teachers, and College Arizona. 2024. “Comparing the Quality of Human and ChatGPT Feedback of Students’ Writing.” Learning and Instruction 91:101894. doi: 10.1016/j.learninstruc.2024.101894.
Vaswani, Ashish, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. “Attention Is All You Need.”
Wan, Tong, and Zhongzhou Chen. 2024. “Exploring Generative AI Assisted Feedback Writing for Students ’ Written Responses to a Physics Conceptual Question with Prompt Engineering and Few-Shot Learning.” Physical Review Physics Education Research 20(1):10152. doi: 10.1103/PhysRevPhysEducRes.20.010152.
White, Jules, Quchen Fu, Sam Hays, Michael Sandborn, Carlos Olea, Henry Gilbert, Ashraf Elnashar, Jesse Spencer-Smith, and Douglas C. Schmidt. 2023. “A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT.”
Woo, David James, Deliang Wang, Tim Yung, and Kai Guo. 2024. Effects of a Prompt Engineering Intervention on Undergraduate Students’ AI Self-Efficacy, AI Knowledge and Prompt Engineering Ability: A Mixed Methods Study.
Zhu, Kayla. 2024. “Ranked: The Most Popular Generative AI Tools in 2024.” Visual Capitalist. Retrieved (https://www.visualcapitalist.com/ranked-the-most-popular-generative-ai-tools-in-2024/ diakses: 10 Januari 2025).
DOI: http://dx.doi.org/10.30829/jipi.v10i1.23934
Refbacks
- There are currently no refbacks.
Copyright (c) 2025 Elshinta Gita Nuraini, Moh Safii (Scopus ID: 57222594842), Sokhibul Ansor
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
