Smile to save it: Facial expressions for lifelogging

Professional Website of Ville Rantanen


Hanna Venesvirta, Oleg Špakov, Yulia Gizatdinova, Outi Tuisku, Ville Ranta- nen, Jarmo Verho, Akos Vetek, Jukka Lekkala, and Veikko Surakka

Smile to save it: Facial expressions for lifelogging

Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia, MUM ’17, pages 441–448, Stuttgart, Germany, November 2017

Current aim was to introduce and initially evaluate the performance of a system called Extended Cognition, which was developed for enhancing the filtering of emotionally meaningful information from visual lifelogging data. The system is proposed to add facial expression markers to the stream of visual lifelogging data in order to later find special, possibly emotionally meaningful moments from the data. In an initial user study we collected subjective evaluations (N=10) about the ergonomics of the data measurement setup and the use of voluntary smiles and frowns for adding markers. Experience evaluations about the system were also collected. Results showed that data measurement setup was ergonomic to use and the system was evaluated positively. Smiling was rated as pleasant, natural, and functional expression for data marking purposes. Participants considered that, for example, the system would support memorization, and that it could be used to share important memories with others.