High School Teachers’ Adoption of Generative AI
Antecedents of Instructional AI Utility in the Early Stages of School-Specific Chatbot Implementation
DOI:
https://doi.org/10.7577/njcie.5736Keywords:
generative AI, instructional AI utility, chatbot, high school, teachersAbstract
In 2023, the breakthrough of generative artificial intelligence (AI) led to its adoption. While some teachers expressed frustration over pupil misuse of generative AI, others advocated for the availability of a school-relevant chatbot for pupil use. In October 2023, a local chatbot intended to meet that goal was launched by Oslo Municipality. After six weeks, an investigation was conducted to examine how 246 teachers perceived the opportunities and limitations of this new technology. The examination used structural equation modelling to explore antecedents of instructional AI utility. The analysis shows that the pathway between instructional self-efficacy and AI utility has the highest positively charged value, while the pathways between management and AI utility have low numerical value. This last finding can be interpreted as the influence of untapped management potential and must be seen in the context of the fact that no guidelines for the use of AI in schools existed when the survey was conducted. In addition, the pathway between colleague discussion and AI utility has relatively low numerical values. The potential for learning through discussion among colleagues can be utilized to an even greater degree. The pathway between management and colleague discussion is remarkable. Implications are discussed.
Downloads
Metrics
References
Acemoglu, D., & Lensman, T. (2023). Regulating transformative technologies (Working Paper No. 31461). National Bureau of Economic Research. https://www.nber.org/papers/w31461 https://doi.org/10.3386/w31461
Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023). Revolutionizing education with AI: Exploring the transformative potential of ChatGPT. Contemporary Educational Technology, 15(3). https://doi.org/10.30935/cedtech/13152
AlBadarin, Y., Tukiainen, M., Saqr, M., & Pope, N. (2023). A systematic literature review of empirical research on ChatGPT in education. SSRN. https://doi.org/10.2139/ssrn.4562771
Bahroun, Z., Anane, C., Ahmed, V., & Zacca, A. (2023). Transforming education: A comprehensive review of generative artificial intelligence in educational settings through bibliometric and content analysis. Sustainability, 15(17). https://doi.org/10.3390/su151712983
Baidoo-Anu, D., & Ansah, L. O. (2023). Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Journal of AI, 7(1), 52–62. https://doi.org/10.61969/jai.1337500
Baytak, A. (2023). The acceptance and diffusion of generative artificial intelligence in education: A literature review. Current Perspectives in Educational Research, 6(1), 7–18. https://doi.org/10.46303/cuper.2023.2
Bryk, A., & Schneider, B. (2002). Trust in schools: A core resource for improvement. Russell Sage Foundation.
Bush, T., & Glover, D. (2014). School leadership models: What do we know? School Leadership & Management, 34(5), 553–571. https://doi.org/10.1080/13632434.2014.928680
Buxrud, O. (2023, November 15). Jeg tror ikke folk forstår hvor mye skade ChatGPT gjør [I don't think people understand how much damage ChatGPT is doing]. Nettavisen. https://www.nettavisen.no/norsk-debatt/jeg-tror-ikke-folk-forstar-hvor-mye-skade-chatgpt-gjor/o/5-95-1455635
Camphuijsen, M. K. (2021). Coping with performance expectations: Towards a deeper understanding of variation in school principals’ responses to accountability demands. Educational Assessment, Evaluation and Accountability, 33(3), 427–453. https://doi.org/10.1007/s11092-020-09344-6
Cao, L., & Dede, C. (2023). Navigating a world of generative AI: Suggestions for educators. Harvard Graduate School of Education. https://bpb-us-e1.wpmucdn.com/websites.harvard.edu/dist/a/108/files/2023/08/Cao_Dede_final_8.4.23.pdf
Celik, I., Dindar, M., Muukkonen, H., & Järvelä, S. (2022). The promises and challenges of artificial intelligence for teachers: A systematic review of research. TechTrends, 66, 616–630. https://doi.org/10.1007/s11528-022-00715-y
Chang, C. H., & Kidman, G. (2023). The rise of generative artificial intelligence (AI) language models—challenges and opportunities for geographical and environmental education. International Research in Geographical and Environmental Education, 32(2), 85–89. https://doi.org/10.1080/10382046.2023.2194036
Chaudhry, I. S., Sarwary, S. A. M., El Refae, G. A., & Chabchoub, H. (2023). Time to revisit existing student’s performance evaluation approach in higher education sector in a new era of ChatGPT: A case study. Cogent Education, 10(1). https://doi.org/10.1080/2331186X.2023.2210461
Cotton, D. R., Cotton, P. A., & Shipway, J. R. (2024). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 61(2), 228-239. https://doi.org/10.1080/14703297.2023.2190148
Dell’Acqua, F., McFowland, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2023). Navigating the jagged technological frontier: Field experimental evidence of the effects of AI on knowledge worker productivity and quality. Harvard Business School Technology & Operations Management Unit Working Paper No. 24-013. https://doi.org/10.2139/ssrn.4573321
Elstad, E. (2016). Why is there a wedge between the promise of educational technology and the experiences in a technology-rich Pioneer School? In E. Elstad (Ed.), Digital expectations and experiences in education (pp. 77–96). Sense Publishers. https://doi.org/10.1007/978-94-6300-648-4_5
Elstad, E. (2023). Læreren møter ChatGPT. [The teacher meets ChatGPT]. Universitetsforlaget.
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2023). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International. https://doi.org/10.1080/14703297.2023.2195846
Fernández-Batanero, J. M., Montenegro-Rueda, M., Fernández-Cerero, J., & García-Martínez, I. (2022). Digital competences for teacher professional development: Systematic review. European Journal of Teacher Education, 45(4), 513–531. https://doi.org/10.1080/02619768.2020.1827389
Fischer G. (2023). A Research Framework Focused on AI and Humans instead of AI versus Humans, Interaction Design & Architecture(s). IxD&A – Interaction Design and Architecture(s) Journal, 59(1), 17–36. https://doi.org/10.55612/s-5002-059-001sp
Guarte, J. M., & Barrios, E. B. (2006). Estimation under purposive sampling. Communications in Statistics-Simulation and Computation, 35(2), 277–284. https://doi.org/10.1080/03610910600591610
Haladyna, T. M., & Rodriguez, M. C. (2013). Developing and validating test items. Routledge. https://doi.org/10.4324/9780203850381
Holmes, W., & Tuomi, I. (2022). State of the art and practice in AI in education. European Journal of Education, 57(4), 542–570. https://doi.org/10.1111/ejed.12533
Holzberger, D., Philipp, A., & Kunter, M. (2013). How teachers' self-efficacy is related to instructional quality: A longitudinal analysis. Journal of Educational Psychology, 105(3), 774–786. https://doi.org/10.1037/a0032198
Hopfenbeck, T.N., Zhang, Z., Sun, S. Z., Robertson, P., & McGrane, J. A. (2023). Challenges and opportunities for classroom-based formative assessment and AI: a perspective article. Frontiers in Education, 8. https://doi.org/10.3389/feduc.2023.1270700
Ingebretsen, T. (2023, August 15.). Arendalsuka 2023: Kunstig intelligens - skolens digitale dilemma [Arendal week 2023: Artificial intelligence – the school's digital dilemma]. Retrieved from https://www.facebook.com/Osloskolen/videos/1927546080954640
Klassen, R. M., & Chiu, M. M. (2010). Effects on teachers' self-efficacy and job satisfaction: Teacher gender, years of experience, and job stress. Journal of Educational Psychology, 102(3), 741–756. https://psycnet.apa.org/doi/10.1037/a0019237
Kline, R. B. (2023). Principles and practice of structural equation modeling. Guilford Publications.
Kocoń, J., Cichecki, I., Kaszyca, O., Kochanek, M., Szydło, D.,Baran, J., Bielaniewicz,J., Gruza, M., Janz, A., Kanclerz, K., Kocoń, A., Koptyra, B., Mieleszczenko-Kowszewicz, W., Miłkowski, P., Oleksy, M., Piasecki,M. Radliński, Ł., Wojtasik, K., Woźniak, S. & Kazienko, P. (2023). ChatGPT: Jack of all trades, master of none. Information Fusion, 99. https://doi.org/10.1016/j.inffus.2023.101861
Kohnke, L. (2023). L2 learners' perceptions of a chatbot as a potential independent language learning tool. International Journal of Mobile Learning and Organisation, 17(1–2), 214–226. https://doi.org/10.1504/ijmlo.2023.10053355
Krumsvik, R. (2023). Digital kompetanse i KI-samfunnet. [Digital competence in the AI society]. Cappelen Damm Akademisk.
Kuhail, M. A., Alturki, N., Alramlawi, S. & Alhejori, K. (2023). Interacting with educational chatbots: A systematic review. Education and Information Technologies, 28, 973–1018. https://doi.org/10.1007/s10639-022-11177-3
Larsen, E., Møller, J., & Jensen, R. (2020). Constructions of professionalism and the democratic mandate in education: A discourse analysis of Norwegian public policy documents. Journal of Education Policy, 37 (1), 1–20. https://doi.org/10.1080/02680939.2020.1774807
Lawler, E. E., & Suttle, J. L. (1973). Expectancy theory and job behavior. Organizational Behavior and Human Performance, 9(3), 482–503. https://doi.org/10.1016/0030-5073(73)90066-4
Lien, T. (2024, January 8). Private email to the first author.
Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4). https://doi.org/10.3390/educsci13040410
Lortie, D. C. (2020). Schoolteacher: A sociological study. University of Chicago Press.
Ministry of Education and Research & Association of Municipalities. (2023). Strategi for digital kompetanse og infrastruktur i barnehage og skole [Strategy for digital competence and infrastructure in kindergartens and schools]. Retrieved from https://www.regjeringen.no/no/dokumenter/strategi-for-digital-kompetanse-og-infrastruktur-i-barnehage-og-skole/id2972254/?ch=8
Moltudal, S., Høydal, K., & Krumsvik, R. J. (2020). Glimpses Into Real-Life Introduction of Adaptive Learning Technology: A Mixed Methods Research Approach to Personalised Pupil Learning, Designs for Learning, 12(1), 13–28. https://doi.org/10.16993/dfl.138
Moltudal, S. H., Krumsvik, R. J., & Høydal, K. L. (2022). Adaptive Learning Technology in Primary Education: Implications for Professional Teacher Knowledge and Classroom Management. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.830536
Montenegro-Rueda, M., Fernández-Cerero, J., Fernández-Batanero, J.M., & López-Meneses, E. (2023). Impact of the implementation of ChatGPT in education: A systematic review. Computers, 12(8), 153. https://doi.org/10.3390/computers12080153
Nagelhout, R. (2023). Academic resilience in a world of artificial intelligence: Guidance for educators as generative AI changes the classroom and the world at large. Harvard Graduate School of Education. Retrieved from https://www.gse.harvard.edu/ideas/usable-knowledge/23/08/academic-resilience-world-artificial-intelligence
Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021). Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2. https://doi.org/10.1016/j.caeai.2021.100041
Niemi, H., Pea, R.D., Lu, Y. (2023). Introduction to AI in Learning: Designing the Future. In: Niemi, H., Pea, R.D., Lu, Y. (eds) AI in Learning: Designing the Future. Springer. https://doi.org/10.1007/978-3-031-09687-7_1
Noys, S., & Zhang, W. (2023). Experimental evidence on the productivity effects of generative artificial intelligence. Science, 6654(381), 187–192. https://doi.org/10.1126/science.adh2586
Osloskolen. (2024). Internal message to schools in the Municipality of Oslo.
Osvold, K. B. (2023). Det blir flere og flere robottekster i skolen. Det er en katastrofe. [There are more and more robot texts in school. It's a disaster]. Aftenposten. Retrieved from https://e-avis.aftenposten.no/titles/aftenposten/1445/publications/91797/pages/26/articles/1930442/27/1
Pagano, A., Mørch, A., Santa Barletta,V., & Andersen, R. (2023). Preface: Special Issue: AI for Humans and Humans for AI: Towards Cultures of Participation in the Digital Age. IxD&A – Interaction Design and Architecture(s) Journal, 59(1), 5-16. https://doi.org/10.55612/s-5002-059-001psi
Pavlik, J. V. (2023). Collaborating with ChatGPT: Considering the implications of generative artificial intelligence for journalism and media education. Journalism & Mass Communication Educator, 78(1), 84–93. https://doi.org/10.1177/10776958221149577
Skaalvik, E. M., & Skaalvik, S. (2007). Dimensions of teacher self-efficacy and relations with strain factors, perceived collective teacher efficacy, and teacher burnout. Journal of Educational Psychology, 99(3), 611–625. https://doi.org/10.1037/0022-0663.99.3.611
Strzelecki, A. (2023). To use or not to use ChatGPT in higher education? A study of students' acceptance and use of technology. Interactive Learning Environments. https://doi.org/10.1080/10494820.2023.2209881
Sullivan, M., Kelly, A., & McLaughlan, P. (2023). ChatGPT in higher education: Considerations for academic integrity and student learning. Journal of Applied Learning and Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.17
Sung, G., Guillain, L., & Schneider, B. (2023). Can AI help teachers write higher quality feedback? Lessons learned from using the GPT-3 engine in a makerspace course. In: P. Blikstein, J. Van Aalst, R. Kizito, & K. Brennan (Eds.), Proceedings of the 17th International Conference of the Learning Sciences - ICLS 2023 (pp. 2093–2094). International Society of the Learning Sciences. https://doi.org/10.22318/icls2023.904961
Susnjak, T. (2022). ChatGPT: The end of online exam integrity? arXiv (preprint). https://doi.org/10.48550/arXiv.2212.09292
The Norwegian Directorate for Education and Training. (2023). Kompetansepakke om kunstig intelligens i skolen [Competence package on artificial intelligence in schools]. Retrieved from https://www.udir.no/kvalitet-og-kompetanse/digitalisering/kompetansepakke-om-kunstig-intelligens-i-skolen/
Tschannen-Moran, M., Hoy, A. W., & Hoy, W. K. (1998). Teacher efficacy: Its meaning and measure. Review of Educational Research, 68(2), 202–248. https://doi.org/10.2307/1170754
Venkatesh, V., Thong, J. Y. L., & Xu, X. (2012). Consumer acceptance and use of information technology: Extending the unified theory of acceptance and use of technology. MIS Quarterly, 36(1), 157–178. https://doi.org/10.2307/41410412
Wathne, M. (2023). Bare legg ned hele skolen! [Just shut down the whole school!]. Stavanger Aftenblad. Retrieved from https://www.aftenbladet.no/meninger/debatt/i/bgPXzl/bare-legg-ned-hele-skolen?fbclid=IwAR3uJIlAB37nLJtT4KdMLHrl0ls2FrBjSG0Dcgp8ILJ9TapOQH0XQS31kCY
Yilmaz, R., & Yilmaz, F. G. K. (2023). The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy, and motivation. Computers and Education: Artificial Intelligence, 4. https://doi.org/10.1016/j.caeai.2023.100147
Zhong, T., Zhu, G., Hou, C., Wang, Y., & Fan, X. (2023, September 26). The Influences of ChatGPT on Undergraduate Students’ Perceived and Demonstrated Interdisciplinary Learning. edarXiv (preprint). https://doi.org/10.35542/osf.io/nr3gj
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Eyvind Elstad, Harald Eriksen
This work is licensed under a Creative Commons Attribution 4.0 International License.
Declaration on copyright
- The author/s will keep their copyright and right of reproduction of their own manuscript, with the work simultaneously licensed under a Creative Commons Attribution License, but give the journal a permanent right to 1) present the manuscript to the public in the original form in which it was digitally published and 2) to be registered and cited as the first publication of the manuscript.
- The author itself must manage its financial reproduction rights in relation to any third-parties.
- The journal does not provide any financial or other remuneration for contributions submitted.
- Readers of the journal may print the manuscripts presented under the same conditions that apply to reproduction of a physical copy. This means that mass reproduction of physical copies or production of copies for commercial purposes is not permitted without the agreement of the author/s.
