Abstracts
Abstract
Objectives – To understand how many undergraduate and graduate students use generative AI as part of their academic work, how often they use it, and for what tasks they use it. We also sought to identify how trustworthy students find generative AI and how they would feel about a locally maintained generative AI tool. Finally, we explored student interest in trainings related to using generative AI in academic work. This survey will help librarians better understand the rate at which generative AI is being adopted by university students and the need for librarians to incorporate generative AI into their work.
Methods – A team of three library staff members and one student intern created, executed, and analyzed a survey of 360 undergraduate and graduate students at Harvard University. The survey was distributed via email lists and at cafes and libraries throughout campus. Data were collected and analyzed using Qualtrics.
Results – We found that nearly 65% of respondents have used or plan to use generative AI chatbots for academic work, even though most respondents (65%) do not find their outputs trustworthy enough for academic work. The findings show that students actively use these tools but desire guidance around effectively using them.
Conclusion – This research shows students are engaging with generative AI for academic work but do not fully trust the information that it produces. Librarians must be at the forefront of understanding the significant impact this technology will have on information-seeking behaviors and research habits. To effectively support students, librarians must know how to use these tools to advise students on how to critically evaluate AI output and effectively incorporate it into their research.
Appendices
Bibliography
- Arlitsch, K., & Newell, B. (2017). Thriving in the age of accelerations: A brief look at the societal effects of AI and the opportunities for libraries. Journal of Library Administration, 57(7), 789–798. https://doi.org/10.1080/01930826.2017.1362912
- Bodnick, M. (2023, July 18). ChatGPT goes to Harvard. Slow Boring. https://www.slowboring.com/p/chatgpt-goes-to-harvard
- Bonsu, E. M., & Baffour-Koduah, D. (2023). From the consumers’ side: Determining students’ perception and intention to use ChatGPT in Ghanaian higher education. Journal of Education, Society & Multiculturalism, 4(1), 1–29. https://doi.org/10.2478/jesm-2023-0001
- Chan, C. K. Y., & Hu, W. (2023). Students’ voices on generative AI: Perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education, 20, 43. https://doi.org/10.1186/s41239-023-00411-8
- Crompton, H., & Burke, D. (2023). Artificial intelligence in higher education: The state of the field. International Journal of Educational Technology in Higher Education, 20, 22. https://doi.org/10.1186/s41239-023-00392-8
- Cox, C., & Tzoc, E. (2023, March). ChatGPT: Implications for academic libraries. College & Research Libraries News, 84(3), 99–102. https://doi.org/10.5860/crln.84.3.99
- Farrelly, T., & Baker, N. (2023). Generative artificial intelligence: Implications and considerations for higher education practice. Education Sciences, 13(11), 1109. https://doi.org/10.3390/educsci13111109
- Fourie, I., & Meyer, A. (2015). What to make of makerspaces: Tools and DIY only or is there an interconnected information resources space? Library Hi Tech, 33(4), 519–525. https://doi.org/10.1108/LHT-09-2015-0092
- Gasparini, A., & Kautonen, H. (2022). Understanding artificial intelligence in research libraries – Extensive literature review. LIBER Quarterly: The Journal of the Association of European Research Libraries, 32(1). https://doi.org/10.53377/lq.10934
- Halaweh, M. (2023). ChatGPT in education: Strategies for responsible implementation. Contemporary Educational Technology, 15(2), ep421. https://doi.org/10.30935/cedtech/13036
- Hervieux, S., & Wheatley, A. (2021). Perceptions of artificial intelligence: A survey of academic librarians in Canada and the United States. The Journal of Academic Librarianship, 47(1), 102270. https://doi.org/10.1016/j.acalib.2020.102270
- Hu, K. (2023, February 2). ChatGPT sets record for fastest-growing user base—Analyst note. Reuters. https://www.reuters.com/technology/chatgpt-sets-record-fastest-growing-user-base-analyst-note-2023-02-01/
- İpek, Z. H., Gözüm, A. İ. C., Papadakis, S., & Kallogiannakis, M. (2023). Educational applications of the ChatGPT AI system: A systematic review research. Educational Process: International Journal, 12(3), 26–55. https://www.edupij.com/files/1/articles/article_305/EDUPIJ_305_article_64a1ef977594c.pdf
- Kaushal, V., & Yadav, R. (2022). The role of chatbots in academic libraries: An experience-based perspective. Journal of the Australian Library and Information Association, 71(3), 215–232. https://doi.org/10.1080/24750158.2022.2106403
- Lo, L. S. (2023, June). My new favorite research partner is an AI: What roles can librarians play in the future? College & Research Libraries News, 84(6), 209–211. https://doi.org/10.5860/crln.84.6.209
- Lund, B. D., & Wang, T. (2023). Chatting about ChatGPT: How may AI and GPT impact academia and libraries? Library Hi Tech News, 40(3), 26–29. https://doi.org/10.1108/LHTN-01-2023-0009
- Martineau, K. (2023, April 20). What is generative AI? IBM Research Blog. https://research.ibm.com/blog/what-is-generative-AI
- McCormack, M. (2023, April 17). EDUCAUSE QuickPoll results: Adopting and adapting to generative AI in higher ed tech. EDUCAUSE Research Notes. https://er.educause.edu/articles/2023/4/educause-quickpoll-results-adopting-and-adapting-to-generative-ai-in-higher-ed-tech
- McMurtrie, B., & Supiano, B. (2023, June 13). Caught off guard by AI. The Chronicle of Higher Education. https://www.chronicle.com/article/caught-off-guard-by-ai
- Mollick, E. (2023, May 20). On-boarding your AI intern. One Useful Thing. https://www.oneusefulthing.org/p/on-boarding-your-ai-intern
- Nguyen, A., Ngo, H. N., Hong, Y., Dang, B., & Nguyen, B.-P. T. (2022). Ethical principles for artificial intelligence in education. Education and Information Technologies, 28, 4221–4241. https://doi.org/10.1007/s10639-022-11316-w
- OpenAI. (2022, November 30). Introducing ChatGPT. https://openai.com/blog/chatgpt
- Popenici, S. A. D., & Kerr, S. (2017). Exploring the impact of artificial intelligence on teaching and learning in higher education. Research and Practice in Technology Enhanced Learning, 12, 22. https://doi.org/10.1186/s41039-017-0062-8
- Shoufan, A. (2023). Exploring students’ perceptions of ChatGPT: Thematic analysis and follow-up survey. IEEE Access, 11, 38805–38818. https://doi.org/10.1109/ACCESS.2023.3268224
- Stojanov, A. (2023). Learning with ChatGPT 3.5 as a more knowledgeable other: An autoethnographic study. International Journal of Educational Technology in Higher Education, 20, 35. https://doi.org/10.1186/s41239-023-00404-7
- Sudirman, I. D., & Rahmatillah, I. (2023). Artificial intelligence-assisted discovery learning: An educational experience for entrepreneurship students using ChatGPT. In 2023 IEEE World AI IoT Congress (AIIoT) (pp. 0786–0791). IEEE Xplore. https://doi.org/10.1109/AIIoT58121.2023.10174472
- Teel, Z. A. , Wang, T., & Lund, B. (2023, June). ChatGPT conundrums: Probing plagiarism and parroting problems in higher education practices. College & Research Libraries News, 84(6), 205–208. https://doi.org/10.5860/crln.84.6.205
- Terry, O. K. (2023, May 12). Opinion | I’m a student. You have no idea how much we’re using ChatGPT. The Chronicle of Higher Education. https://www.chronicle.com/article/im-a-student-you-have-no-idea-how-much-were-using-chatgpt
- Walczak, K., & Cellary, W. (2023). Challenges for higher education in the era of widespread access to generative AI. Economics and Business Review, 9(2), 71–100. https://doi.org/10.18559/ebr.2023.2.743
- Wang, S., Scells, H., Koopman, B., & Zuccon, G. (2023). Can ChatGPT write a good Boolean query for systematic review literature search? arXiv. https://doi.org/10.48550/arXiv.2302.03495
- Welding, L. (2023, March 17 ). Half of college students say using AI on schoolwork is cheating or plagiarism. BestColleges. https://www.bestcolleges.com/research/college-students-ai-tools-survey/
- Wheatley, A., & Hervieux, S. (2019). Artificial intelligence in academic libraries: An environmental scan. Information Services & Use, 39(4), 347–356. https://doi.org/10.3233/ISU-190065
- Zhu, G., Fan, X., Hou, C., Zhong, T., Seow, P., Shen-Hsing, A. C., Rajalingam, P., Yew, L. K., Poh, T. L. (2023). Embrace opportunities and face challenges: Using ChatGPT in undergraduate students' collaborative interdisciplinary learning. arXiv. https://doi.org/10.48550/arXiv.2305.18616