The aim of the interdisciplinary TALISMAN project is to propose a framework, sharable data and analysis models to study higher education learning situations in various instructional situations. Keeping ethics and privacy as main concerns of our research, analyses will be guided by the qualification of the teaching and learning experience, and participants’ engagement. To do so, the project relies on a mixed statistical/machine learning approach to genuine instructional events labeling, including raw events and high-level strategies annotation. The experiments will be undertaken using two existing Context Aware Classrooms (CAC) , equipped with a variety of unobtrusive multimodal and multilevel sensors, and effectors, in Grenoble and Poitiers. This project will answer the following questions:

• Q1: How to model and analyze the students’ engagement levels induced by various instructional situations, and to formulate prescriptions to teachers and researchers, for teacher development and educational research purposes?
• Q2: How to gather data to build corpora of these different instructional situations and to (semi-) automatically annotate them in a privacy-safe and ethical way?
• Q3: How to devise novel perception algorithms relying on machine learning and statistical techniques and compare their outputs to those delivered by Q1 answers?

Outcomes of the project will include anonymized datasets, source codes and models, description of processes, indicators and protocols used in the project, as well as design and implementation guidelines for higher education courses.