Guest presentation at New York University

While in my research visit to the United States, I was invited by Xavier Ochoa to present at the "Brown Bag" presentation series organised by the Faculty of NYU Educational Communication and Technology which is part of the Steinhardt School of Culture, Education, and Human Development.

Title: Restoring Context in Distance Learning with Artificial Intelligence and Multimodal Learning Experiences​
Abstract: The COVID-19 pandemic forced more than 1.6 billion learners out of school, becoming the most challenging disruption ever endured by the global education systems. In many countries, education institutions decided to move their regular activities online, opting for remote teaching as an emergency solution to continue their education. Meanwhile, physical distancing and learning in isolation heavily challenge learners and hinder their study success. There is a compelling need to make education systems more resilient and less vulnerable to future disruptions in such a critical landscape. In particular, we have to reconsider how digital technologies can support online and hybrid teaching. If digital education technologies such as video conferencing tools and learning management systems have improved to make educational resources more available and education more flexible, the modes of interaction they implement remain essentially unnatural for the learner due to a substantial lack of context. Modern sensor-enabled computer systems allow extending the standard human-computer interfaces and facilitate richer multimodal interaction. Furthermore, advances in AI allow interpreting the data collected from multimodal and multi-sensor devices. These insights can be used to support online teaching and learning in isolation with personalised feedback and adaptation through Multimodal Learning Experiences (MLX). This guest lecture elaborates on existing approaches, architectures, and methodologies. I illustrate use cases that employ multimodal learning analytics applications that can shape the online teaching of the future.

Presentation slides

Published by Daniele Di Mitri

Daniele Di Mitri is a research group leader at the DIPF - Leibniz Institute for Research and Information in Education and a lecturer at the Goethe University of Frankfurt, Germany. Daniele received his PhD entitled "The Multimodal Tutor" at the Open University of The Netherlands (2020) in Learning Analytics and wearable sensor support. His research focuses on collecting and analysing multimodal data during physical interactions for automatic feedback and human behaviour analysis. Daniele's current research focuses on designing responsible Artificial Intelligence applications for education and human support. He is a "Johanna Quandt Young Academy" fellow and was elected "AI Newcomer 2021" at the KI Camp by the German Informatics Society. He is a member of the editorial board of Frontiers in Artificial Intelligence journal, a member of the CrossMMLA, a special interest group of the Society of Learning Analytics Research, and chair of the Learning Analytics Hackathon (LAKathon) series.

Leave a Reply

Your email address will not be published. Required fields are marked *