54
B1 – SZIMPÓZIUM ÁPRILIS 26. (CSÜTÖRTÖK) 14.00–15.30
High-Tech Assessment and Novel Low-Cost Opportunities in Education Díszterem
ANALYSIS OF FACIAL EXPRESSIONS WITH SPECIAL NEED CHILDREN:
PRELIMINARY RESULTS
Brigitta Miksztai-Réthey *, Tímea Magyar **
* Neural Information Processing Group, Faculty of Informatics
** Eötvös Loránd University
Keywords: special educational needs; headmouse; emotions, facial expressions
Recent unprecedented developments in mobile device technology tools may drastically change our everyday life. These transformations are expected to add the most value to the life of children with special needs. Our goal is to study these novel opportunities that may lead to personalized intelligent tutors and individualized adaptive training: the computer will monitor the facial expressions of the subject (Jeni et al., 2012), learn the emotional and cognitive profile of the child, and predict the actual and the coming behavioural patterns, respectively subject to the potential actions of the intelligent tutor utilizing a „recommender system” (Szabó et al., 2012) compressing the information hidden in the database.
Two studies were launched:
(1) 18 children and young adults with severe speech loss and motion disabilities tried to use the webcam based „headmouse” to control the cursor in order to enable their computer based assessments. Their facial expressions were recorded to identify those behavioural patterns where the computer should interact to ease their tasks.
(2) Emotions related to problems with level of numerical concept were recorded for 38 children.
Out of the 18 children with special need, the headmouse was the best choice for 3, 7 either had better options or failed, whereas the work is still in progress for 8 children.
Special behavioural patterns that can be overcome by the computer were identified for 1 out of the 3 children. Facial expressions for the group of 38 children are being analysed to quantify the interrelations between emotions and performances.
______________
The Project is supported by the European Union and co-financed by the European Social Fund (grant agreement numbers: KMOP-1.1.2-08/1-2008-0002 and TÁMOP 4.2.1/B-09/1/KMR-2010- 0003).
