CategoriesMy Projects

New project: HyTea - Model for Hybrid Teaching

On 1st September, the German Federal Ministry of Education approved a new collaborative project between DIPF EduTec and Cologne Game Lab named "Model for Hybrid Teaching (HyTea)". The project's total funding is Eur 750,000 and will be financing two PhD candidates at the DIPF and one a the Cologne Game Lab. The project's Principal Investigators are Dr Daniele Di Mitri from the DIPF side and Prof. Dr. Roland Klemke of the Cologne Game Lab (TH Köln).

Short project description: Artificial Intelligence (AI) systems can provide automatic, personalised and real-time feedback to learners in distance learning settings when a human expert is unavailable. AI feedback has the potential to be always available and can allow learners to practice deliberately and repeatedly at their own pace. Embedding AI feedback into immersive and multimodal technologies, like Augmented and Virtual Reality (AR/VR) or sensor-based systems, enables learners to train physical learning tasks alongside the more traditional cognitive tasks. We refer to these AI systems as Multimodal Tutors. One scenario that needs to be considered when replacing human feedback is that the AI system may deviate from the learners' expectations and the teachers' learning goals, risking becoming unethical. This challenge is known in AI ethics research as the “alignment problem” and refers to the importance of designing AI systems that align with human values. This project tackles the “alignment problem” in distance teaching in the particular context of presentation skills training. To tackle the problem, we designed a Multimodal Tutor to train presentation skills such as body position, pauses, and voice intonation. The Multimodal Tutor features various game-oriented immersive scenarios on a mixed-reality headset to allow learners to practice autonomously, supported by AI-generated feedback. The human experts can monitor the learning process asynchronously via an Alignment Dashboard. They can assess the learner performance and the quality of the AI feedback, ensuring it is correctly aligned with the learning goals.

Published by Daniele Di Mitri

Daniele Di Mitri is a research group leader at the DIPF - Leibniz Institute for Research and Information in Education and a lecturer at the Goethe University of Frankfurt, Germany. Daniele received his PhD entitled "The Multimodal Tutor" at the Open University of The Netherlands (2020) in Learning Analytics and wearable sensor support. His research focuses on collecting and analysing multimodal data during physical interactions for automatic feedback and human behaviour analysis. Daniele's current research focuses on designing responsible Artificial Intelligence applications for education and human support. He is a "Johanna Quandt Young Academy" fellow and was elected "AI Newcomer 2021" at the KI Camp by the German Informatics Society. He is a member of the editorial board of Frontiers in Artificial Intelligence journal, a member of the CrossMMLA, a special interest group of the Society of Learning Analytics Research, and chair of the Learning Analytics Hackathon (LAKathon) series.

Leave a Reply

Your email address will not be published. Required fields are marked *