Legal and ethical dilemmas and institutional responses to the application of generative artificial intelligence in education

Autores/as

  • Ruixia Zhang Xinjiang College of Science & Technology
  • Jinliang Zeng Al-farabi Kazakh National University

Palabras clave:

Generative Artificial Intelligence, Legal Relationships in Education, Human-machine Collaboration, Educational Ethics Governance, Regulatory Systems for Artificial Intelligence

Resumen

The introduction of generative artificial intelligence (AI) into the education field, by introducing non-human actors, breaks down the binary subject structure of traditional educational legal relationships. This paper argues that the current education governance system, designed based on the teacher-student binary relationship, suffers from institutional mismatches in three aspects: attribution of responsibility, definition of rights, and recognition of academic norms. Through normative analysis and institutional comparison, and drawing on international governance experiences such as China's Education Law, Copyright Law, Personal Information Protection Law, and Data Security Law, this paper identifies three core dilemmas: First, AI-generated outputs lack the necessary justification dimension for "knowledge" in a legal and educational sense; second, the algorithmic process cannot meet the normative standards of legal reasoning; and third, the current tort liability framework struggles to trace damages back to attributable human subjects. To resolve these mismatches, this paper proposes defining generative AI legally as a regulated auxiliary entity, a functional intermediate category between a tool and a legal subject. This concept embodies three institutional principles: traceable responsibility, identifiable use, and labelable generation. This framework, without granting AI legal personhood, incorporates technological autonomy into a human-centered order of responsibility, providing a theoretically sound and operationally feasible institutional model for AI governance in the education sector.

Descargas

Los datos de descarga aún no están disponibles.

Referencias

ALASADI, E. A., & BAIZ, C. R. "Generative AI in education and research: Opportunities, concerns, and solutions", Journal of Chemical Education, V. 100, nº 8, 2023, p. 2965-2971. https://doi.org/10.1021/acs.jchemed.3c00323

BAIDOO-ANU, D., & ANSAH, L. O. "Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning", Journal of AI, V. 7, nº 1, 2023, p. 52-62. https://dx.doi.org/10.2139/ssrn.4337484

BATISTA, J., MESQUITA, A., & CARNAZ, G. "Generative AI and higher education: Trends, challenges, and future directions from a systematic literature review", Information, V. 15, nº 11, 2024, p. 676-702. https://doi.org/10.3390/info15110676

CHEN, J., & SUN, J. "Understanding the chinese data security law", International Cybersecurity Law Review, V. 2, nº 2, 2021, p. 209-221. https://doi.org/10.1365/s43439-021-00038-3

CHEN, J., HUANG, Y., XU, J., & HE, D. "Constructing a New" Teacher-AI" Collaborative Teaching Paradigm in International Chinese Language Education Enabled by Generative AI", Journal of Computing and Electronic Information Management, V. 18, nº 1, 2025, p. 71-78. https://doi.org/10.54097/9cknfy07

CHIU, T. K. "The impact of Generative AI (GenAI) on practices, policies and research direction in education: A case of ChatGPT and Midjourney", Interactive learning environments, V. 32, nº 10, 2024, p. 6187-6203. https://doi.org/10.1080/10494820.2023.2253861

COOPER, G. "Examining science education in ChatGPT: An exploratory study of generative artificial intelligence", Journal of science education and technology, V. 32, nº 3, 2023, p. 444-452. https://doi.org/10.1007/s10956-023-10039-y

DAVIDSON, D. “Essays on actions and events”, 1980. https://doi.org/10.1093/0199246270.001.0001

FILIPOVA, I. A. "Legal regulation of artificial intelligence: Experience of China", Journal of Digital Technologies and Law, V. 2, nº 1, 2024, p. 46-73. https://doi.org/10.21202/jdtl.2024.4

FRANKS, E., LEE, B., & XU, H. "Report: China's new ai regulations", Global Privacy Law Review, V. 5, nº 1, 2024, p. 43-49. https://doi.org/10.54648/gplr2024007

GIANNAKOS, M., AZEVEDO, R., BRUSILOVSKY, P., CUKUROVA, M., DIMITRIADIS, Y., HERNANDEZ-LEO, D., et al. "The promise and challenges of generative AI in education", Behaviour & Information Technology, V. 44, nº 11, 2025, p. 2518-2544. https://doi.org/10.1080/0144929X.2024.2394886

HAETAMI, A., & AGHATA, F. "Ethical and Data Security Analysis in the Implementation of Generative AI in Higher Education Environments", MSJ: Majority Science Journal, V. 3, nº 4, 2025, p. 177-186. https://doi.org/10.61942/msj.v3i4.482

HUANG, P. "Challenges and Risk Regulation of Generative AI for Personal Information Protection", Modern Law Science, V. 46, nº 4, 2024, p. 101-115. https://qks.swupl.edu.cn/docs//2025-09/3822f89555164bd7a5ebf07253cf459c.pdf (accessed on 08 January 2026).

HUGENHOLTZ, P. B., & QUINTAIS, J. P. “Copyright and artificial creation: does EU copyright law protect AI-assisted output?”, IIC-International Review of Intellectual Property and Competition Law, V. 52, nº 9, 2021, p. 1190-1216. https://doi.org/10.1007/s40319-021-01115-0

JAYARAM, Y., SUNDAR, D., & BHAT, J. "Generative AI Governance & Secure Content Automation in Higher Education", International Journal of Artificial Intelligence, Data Science, and Machine Learning, V. 5, nº 4, 2024, p. 163-174. https://doi.org/10.63282/3050-9262.IJAIDSML-V5I4P116

JIANG, L. "Research on Copyright Infringement Issues of Generative Artificial Intelligence", Law and Humanities, V. 1, nº 1, 2025, p. 51-60. https://doi.org/10.63313/LH.9007

KELSEN, H. “Pure theory of law”, Univ of California Press, 1967. https://doi.org/10.1525/9780520312296

LATOUT, B. “Reassembling the social: An introduction to actor-network-theory”, Oxford university press, 2005. https://doi.org/10.1093/oso/9780199256044.001.0001

LI, J., CAI, X., & CHENG, L. "Legal regulation of generative AI: a multidimensional construction", International Journal of Legal Discourse, V. 8, nº 2, 2023, p. 365-388. https://doi.org/10.1515/ijld-2023-2017

LUCCHI, N. "ChatGPT: a case study on copyright challenges for generative artificial intelligence systems", European Journal of Risk Regulation, V. 15, nº 3, 2024, p. 602-624. https://doi.org/10.1017/err.2023.59

MCGREGOR, S. "Preventing repeated real world AI failures by cataloging incidents: The AI incident database", In Proceedings of the AAAI Conference on Artificial Intelligence, V. 35, nº 17, 2021, p. 15458-15463. https://doi.org/10.1609/aaai.v35i17.17817

MICHEL-VILLARREAL, R., VILALTA-PERDOMO, E., SALINAS-NAVARRO, D. E., THIERRY-AGUILERA, R., & GERARDOU, F. S. "Challenges and opportunities of generative AI for higher education as explained by ChatGPT", Education sciences, V. 13, nº 9, 2023, p. 856-873. https://doi.org/10.3390/educsci13090856

MILLS, A., BALI, M., & EATON, L. "How do we respond to generative AI in education?: Open educational practices give us a framework for an ongoing process", Journal of Applied Learning & Teaching, V. 6, nº 1, 2023, p. 16-30. Available at: https://search.informit.org/doi/abs/10.3316/informit.T2025102700000190946580350 (accessed on 08 January 2026).

MO, W. "Research on Legal Issues of Personal Information Protection in the Context of Artificial Intelligence Development", International Journal of Frontiers in Sociology, V. 7, nº 3, 2025, p. 15-20. https://doi.org/10.25236/IJFS.2025.070303

NGUYEN, K. V. "The use of generative AI tools in higher education: Ethical and pedagogical principles", Journal of Academic Ethics, V. 23, nº 3, 2025, p. 1435-1455. https://doi.org/10.1007/s10805-025-09607-1

NZENWATA, U. J., BARN-NZEKWE, C., OJELABI, E. O., ODUWARE, O., ATALOR, P. E., YISAU, Y., et al. "A systematic review of generative AI in education", Journal of Computer Sciences and Applications, V. 12, nº 1, 2024, p. 25-30. https://doi.org/10.12691/jcsa-12-1-4

QU, Y. "Personal Information Protection Dilemmas and Regulatory Adaptation in Generative Artificial Intelligence Applications", Journal of Social Development and History, V. 1, nº 4, 2025, p. 88-98. Available at: https://wonford.com/wp-content/uploads/2026/01/Manuscript-v1n4-10.pdf (accessed on 08 January 2026).

RUHAL, M., BASIT, A., LINXIN, Q., FEROZ, M., XINRONG, P., ZAHEER, S., & ULLAH, W. "From Tradition to Modernity: China' s Education System "A Product of Legal Design"", Journal of Global Research in Education and Social Science, V. 19, nº 1, 2025, p. 62-80. https://doi.org/10.56557/jogress/2025/v19i19143

SEARLE, J. R. “Minds, brains, and programs”, Behavioral and brain sciences, V. 3, nº 3, 1980, p. 417-424. Available at: https://web-archive.southampton.ac.uk/cogprints.org/7150/1/10.1.1.83.5248.pdf (accessed on 08 January 2026).

SHI, Y. "Study on security risks and legal regulations of generative artificial intelligence", Science of law journal, V. 2, nº 11, 2023, p. 17-23. Available at: https://pdfs.semanticscholar.org/251a/77cabedb1c1a8ca964586f967dd848d09fea.pdf (accessed on 08 January 2026).

SU, J., & YANG, W. "Unlocking the power of ChatGPT: A framework for applying generative AI in education", ECNU Review of Education, V. 6, nº 3, 2023, p. 355-366. https://doi.org/10.1177/20965311231168423

TANG, K. S., COOPER, G., & NIELSEN, W. "Philosophical, legal, ethical, and practical considerations in the emerging use of generative AI in academic journals: Guidelines for research in science education (RISE)", Research in Science Education, V. 54, nº 5, 2024, p. 797-807. https://doi.org/10.1007/s11165-024-10192-3

TATA, T. S., & HERI, H. S. "Navigating the Generative AI Revolution in Education: A Systematic Review of Applications, Ethical Considerations, and Future Directions", Jurnal Nasional Pendidikan Teknik Informatika: JANAPATI, V. 14, nº 2, 2025, p. 374-384. https://doi.org/10.23887/janapati.v14i2.90367

VERMA, S., KAUSHIK, P., & SHARMA, G. "AI in Education: Opportunities, Challenges, and Ethical Dilemmas", Journal (IERJ), V. 11, nº 11, 2025, p. 329-340. Available at: https://www.researchgate.net/profile/Gunjan-Sharma-16/publication/399068215_AI_IN_EDUCATION_OPPORTUNITIES_CHALLENGES_AND_ETHICAL_DILEMMAS/links/694d3e5927359023a010373d/AI-IN-EDUCATION-OPPORTUNITIES-CHALLENGES-AND-ETHICAL-DILEMMAS.pdf (accessed on 08 January 2026).

VON SAVIGNY, F. C. “System des Heutigen Romischen Rechts”, Periodicum Iuris, V. 1, 2023, p. 145. Available at: https://www.digitale-sammlungen.de/de/view/bsb10565865?page=,1 (accessed on 08 January 2026).

WANG, N., WANG, X., & SU, Y. S. "Critical analysis of the technological affordances, challenges and future directions of Generative AI in education: a systematic review", Asia Pacific Journal of Education, V. 44, nº 1, 2024, p. 139-155. https://doi.org/10.1080/02188791.2024.2305156

Wang, S. (2023). "ChatGPT and Academic Misconduct Governance: Challenges and Responses", Science and Technology Progress and Countermeasures, V. 40, nº 23, 2023, p. 103-110. https://doi.org/10.6049/kjjbydc.2023020435

WU, S. "Research on the Liability for Copyright Infringement of Generative Artificial Intelligence", Law and Humanities, V. 1, nº 2, 2025, p. 42-54. https://doi.org/10.63313/LH.9014

XIANG, A. "Fairness & privacy in an age of generative AI", Science and Technology Law Review, V. 25, nº 2, 2024, p. 288-312. https://doi.org/10.52214/stlr.v25i2.12765

YADAV, A. B. "The development of AI with generative capabilities and its effect on education", International Journal of Science and Research (IJSR), V. 13, nº 5, 2024, p. 854-860. https://doi.org/10.21275/SR24509232318

YERALAN, S., & LEE, L. A. "Generative AI: Challenges to higher education", Sustainable Engineering and Innovation, V. 5, nº 2, 2023, p. 107-116. https://doi.org/10.37868/sei.v5i2.id196

ZHOU, T., & BIN ABD RAHMAN, M. R. "Legal Perspective on the Risk of Copyright Infringement by AI-Generated Contents in China", Malaysian Journal of Law & Society, V. 34, nº 2, 2024, p. 141-153. https://doi.org/10.17576/juum-2024-3402-10

ZHU, Y., CHEN, Z., LU, Y., & FAN, W. "Generative AI Governance Action Framework: Content Analysis Based on AIGC Incident Report Text", Library and Information Science, V. 40, nº 4, 2023, pp. 41-51. https://doi.org/10.13366/j.dik.2023.04.041

Descargas

Publicado

30-06-2026

Cómo citar

“Legal and ethical dilemmas and institutional responses to the application of generative artificial intelligence in education” (2026) Cadernos de Dereito Actual, (32), pp. 316–335. Available at: https://www.cadernosdedereitoactual.es/index.php/cadernos/article/view/1508 (Accessed: 30 June 2026).