Ethics in EdTech: Consolidating Standards For Responsible Data Handling And Usercentric Design
Keywords:
EdTech, ethics, data handling, user-centric design, data protectionSynopsis
This report proposes aspirational principles for EdTech providers, emphasizing ethical practices, robust data protection, ownership rights, transparent consent processes, and active user engagement, particularly with children. These measures aim to enhance transparency, accountability, and trust in EdTech platforms.
Focusing on the K12 sector, the report systematically reviews and integrates key academic, legal, and technical frameworks to propose ethical benchmarks for the EdTech industry. The benchmarks go beyond quality assurance, highlighting good practices and ethical leadership for the field. The report addresses the need for a new culture in EdTech ethics, one that is collaborative and views EdTech providers as partners in dialogue with researchers and policy-makers to identify constructive solutions and uphold social trust.
The outlined benchmarks are intended for national policymakers, international agencies, and certification bodies to consider when developing quality standards for EdTech used in schools. They include AI safeguards and stress the importance of meeting international data protection standards, establishing clear ownership rights, and implementing transparent consent processes to address data control issues, as well as active user engagement for improving data governance practices.
References
Andreasson, U. (2017). Trust - the Nordic Gold (ANP 2017:737). http://norden.diva-portal.org/smash/get/diva2:1095959/FULLTEXT02.pdf
Atabey, A. & Hooper, L. (2024). International regulatory decisions concerning EdTech companies' data practices. Digital Futures for Children centre, LSE and 5Rights Foundation. http://eprints.lse.ac.uk/123805/1/DFC_Brief_International_regulatory_decisions_final.pdf
Bowie, N. E. & Jamal, K. (2006). Privacy rights on the Internet: Self-regulation or government regulation? Business Ethics Quarterly, 16(3), 323-342.
https://doi.org/10.5840/beq200616340
Campolo, A., Sanfilippo, M., Whittaker, M. & Crawford, K. (2017). AI Now 2017 Report. https://ainowinstitute.org/publication/ai-now-2017-report-2
Cannarsa, M. (2021). Ethics guidelines for trustworthy AI. In L. A. di Matteo et al. (Eds), The Cambridge Handbook of Lawyering in the Digital Age, 283-97. Cambridge University Press.
https://doi.org/10.1017/9781108936040.022
Chaudhry, M. A., Cukurova, M. & Luckin, R. (2022). A transparency index framework for AI in education. In Artificial Intelligence in Education. Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners' and Doctoral Consortium: 23rd International Conference, AIED 2022, Durham, UK, July 27-31, 2022, Proceedings, Part II, 195-198. Springer.
https://doi.org/10.1007/978-3-031-11647-6_33
https://doi.org/10.35542/osf.io/bstcf
CNIL (2023). Digital health and EdTech: The CNIL publishes the results of its first sandboxes. Topics, 28 July. https://www.cnil.fr/en/digital-health-and-edtech-cnil-publishes-results-its-first-sandboxes
COPPA (1998). Children's Online Privacy Protection Rule. https://www.ftc.gov/legal-library/browse/rules/childrens-online-privacy-protection-rule-coppa
Council of Europe (2021). Children's data protection in an education setting - Guidelines. https://edoc.coe.int/en/children-and-the-internet/9620-childrens-data-protection-in-an-education-setting-guidelines.html &focusjump=The%20Guidelines%20on%20Children%E2%80%99s%20Data%20Protection%20in%20an%20Education
Day, E., Pothong, K., Atabey, A. & Livingstone, S. (2022). Who controls children's education data? A socio-legal analysis of the UK governance regimes for schools and EdTech. Learning, Media and Technology, 1-15
https://doi.org/10.1080/17439884.2022.2152838
Datatilsynet (2022). Datatilsynet nedlægger behandlingsforbud i Chromebook-sag (July 14, 2022) https://www.datatilsynet.dk/presse-og-nyheder/nyhedsarkiv/2022/jul/datatilsynet-nedlaegger-behandlingsforbud-i-chromebook-sag
Datatilsynet. (2024). Datatilsynet giver påbud i Chromebook-sag http://www.datatilsynet.dk/afgoerelser/afgoerelser/2024/jan/datatilsynet-giver-paabud-i-chromebook-sag
Delhey, J. & Newton, K. (2005). Predicting cross-national levels of social trust: global pattern or Nordic exceptionalism? European Sociological Review, 21(4), 311-327.
https://doi.org/10.1093/esr/jci022
DfE (2021). UK Department for Education. Skills for Jobs: Lifelong Learning for Opportunity and Growth. White Paper, January 2021. https://www.gov.uk/government/publications/skills-for-jobs-lifelong-learning-for-opportunity-and-growth
EDPS (2024). EDPS Guidelines on generative AI: embracing opportunities, protecting people. Press release June 3, 2024. https://www.edps.europa.eu/press-publications/press-news/press-releases/2024/edps-guidelines-generative-ai-embracing-opportunities-protecting-people_en
Egert, F., Cordes, A. K. & Hartig, F. (2022). Can e-books foster child language? Meta-analysis on the effectiveness of e-book interventions in early childhood education and care. Educational Research Review, 37, 100472.
https://doi.org/10.1016/j.edurev.2022.100472
European Parliament (2024). Artificial Intelligence Act. https://www.europarl.europa.eu/doceo/document/TA-9-2024-0138_EN.pdf
EU Regulation 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation) https://eur-lex.europa.eu/eli/reg/2016/679/oj
Ferguson, R., Hoel, T., Scheffel, M. & Drachsler, H. (2016). Guest editorial: Ethics and privacy in learning analytics. Journal of Learning Analytics, 3, 5-15.
https://doi.org/10.18608/jla.2016.31.2
FERPA (1974). Family Educational and Privacy Act. https://www2.ed.gov/policy/gen/guid/fpco/ferpa/index.html
Gardelli, V. (2016). To Describe, Transmit or Inquire: Ethics and technology in school (Doctoral dissertation, Luleå tekniska universitet).
GDPR (2018). General Data Protection Regulation. https://gdpr-info.eu/
Grant, M. J. & Booth, A. (2009), A typology of reviews: an analysis of 14 review types and associated methodologies. Health Information & Libraries Journal, 26, 91-108.
https://doi.org/10.1111/j.1471-1842.2009.00848.x
Hillman, V. (2023). Bringing in the technological, ethical, educational and social-structural for a new education data governance. Learning, Media and Technology, 48(1), 122-137.
https://doi.org/10.1080/17439884.2022.2052313
ICO (2020). Information Commissioners Office - Age appropriate design: a code of practice for online services https://ico.org.uk/media/for-organisations/guide-to-data-protection/key-data-protection-themes/age-appropriate-design-a-code-of-practice-for-online-services-2-1.pdf
ICO (2023). The Children's code and education technologies (edtech). https://ico.org.uk/for-organisations/uk-gdpr-guidance-and-resources/childrens-information/childrens-code-guidance-and-resources/the-children-s-code-and-education-technologies-edtech/
IEEE (2021). Standard for an Age Appropriate Digital Services Framework Based on the 5Rights Principles for Children, IEEE 2089-2021 https://standards.ieee.org/ieee/2089/7633/
ISO (2024). Tech Risks https://www.iso.org/foresight/tech-risks.html
Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S. & Gašević, D. (2022) Explainable artificial intelligence in education. Computers and Education: Artificial Intelligence, 3, 100074.
https://doi.org/10.1016/j.caeai.2022.100074
Kidron, B., Pothong, K., Hooper, L., Livingstone, S., Atabey, A. & Turner, S. (2023). A blueprint for education data: Realising children's best interests in digitised education. Digital Futures Commission. Accessed June 2024, http://eprints.lse.ac.uk/id/eprint/119737
Kousa, P. & Niemi, H. (2023). AI ethics and learning: EdTech companies' challenges and solutions. Interactive Learning Environments, 31(10), 6735-6746.
https://doi.org/10.1080/10494820.2022.2043908
Kucirkova, N. (2023). How can philanthropy catalyse a system-wide change in EdTech?, Alliance Magazine, https://www.alliancemagazine.org/blog/how-can-philanthropy-catalyse-a-system-wide-change-in-edtech/
Kucirkova, N. (2024). The 5Es of Evidence and SDGs. Springer Nature Research Communities. https://communities.springernature.com/posts/the-5es-of-evidence-and-sdgs
Lindroos Cermakova, A., Prado, Y. & Kucirkova, N. (2024). Equity in EdTech by Design. University of Stavanger.
https://doi.org/10.31265/USPS.277
Livingstone, S., Cantwell, N., Özkul, D, Shekhawat, G., & Kidron, B. (2024a). The best interests of the child in the digital environment. Digital Futures for Children centre, LSE and 5Rights Foundation. https://5rightsfoundation.com/uploads/dfc-report-best-interests-of-the-child.pdf
Livingstone, S., Pothong, K., Atabey, A., Hooper, L. & Day, E. (2024b). The Googlization of the classroom: Is the UK in protecting children's data and rights? Computers and Education Open, 100195.
https://doi.org/10.1016/j.caeo.2024.100195
Luckin, R., Holmes, W., Griffiths, M. & Forcier, L. B. (2016). Intelligence unleashed. An argument for AI in Education, 18.
Mares, M. L. & Pan, Z. (2013). Effects of Sesame Street: A meta-analysis of children's learning in 15 countries. Journal of Applied Developmental Psychology, 34(3), 140-151.
https://doi.org/10.1016/j.appdev.2013.01.001
Marshall, R., Pardo, A., Smith, D. & Watson, T. (2022). Implementing next generation privacy and ethics research in education technology. British Journal of Educational Technology, 53(4), 737-755.
https://doi.org/10.1111/bjet.13224
Mishra, A. (2023). Educational Technology Ethics. University of California, Santa Cruz.
Morley, J., Floridi, L., Kinsey, L. et al. (2020). From What to How: An Initial Review of Publicly Available AI Ethics Tools, Methods and Research to Translate Principles into Practices. Sci Eng Ethics 26, 2141-2168.
https://doi.org/10.1007/s11948-019-00165-5
Niemi, H. (2021). AI in learning: Preparing grounds for future learning. Journal of Pacific Rim Psychology, 15, 18344909211038105.
https://doi.org/10.1177/18344909211038105
Peloquin, D., DiMaio, M., Bierer, B. & Barnes, M. (2020). Disruptive and avoidable: GDPR challenges to secondary research uses of data. European Journal of Human Genetics, 28(6), 697-705.
https://doi.org/10.1038/s41431-020-0596-x
Resnick, M. (2024). Generative AI and Creative Learning: Concerns, Opportunities, and Choices. An MIT Exploration of Generative AI, March.
https://doi.org/10.21428/e4baedd9.cf3e35e5
Robinson, S. C. (2020). Trust, transparency, and openness: How inclusion of cultural values shapes Nordic national public policy strategies for artificial intelligence (AI). Technology in Society, 63, 101421.
https://doi.org/10.1016/j.techsoc.2020.101421
Roschelle, J., Lester, J. & Fusco, J. (2020). AI and the Future of Learning: Expert Panel Report. Digital Promise https://digitalpromise.dspacedirect.org/items/4b4d5758-dc24-400c-92bb-206edba192aa
https://doi.org/10.51388/20.500.12265/106
Sharples, M. (2023). Towards social generative AI for education: theory, practices and ethics. Learning: Research and Practice, 9(2), 159-167.
https://doi.org/10.1080/23735082.2023.2261131
Sikt (2022). Norwegian Agency for Shared Services in Education and Research - CRONOS 2 Wave 5 edition 1.0. https://ess.sikt.no/en/?tab=overview
Sparks. A. (2024). Free as a matter of course, Adam Sparks' Substack. https://adamsparks.substack.com/p/free-as-a-matter-of-course
UN Committee on the Rights of the Child. (2013). General comment No. 14 (2013) on the right of the child to have his or her best interests taken as a primary consideration (art. 3 (1)). CRC/C/GC/14. www.refworld.org/legal/general/crc/2013/en/95780
UNESCO GEM Report (2023). Technology in education. A tool on whose terms? https://www.unesco.org/gem-report/en/technology
https://doi.org/10.54676/KRNO2809
UNICEF (2021). Policy Guidance on AI for Children. https://www.unicef.org/globalinsight/media/2356/file/UNICEF-Global-Insight-policy-guidance-AI-children-2.0-2021.pdf
Wong, G. K., Ma, X., Dillenbourg, P. & Huan, J. (2020). Broadening artificial intelligence education in K-12: Where to start? ACM Inroads, 11(1), 20-29.
