Creating and sharing knowledge for telecommunications
HiMotion Project
IT - Instituto de Telecomunicações
HiMotion Project  
Contact Us  |  Sitemap  |  Intranet Login
 
You are here: Home > Scientific Areas > HiMotion Project  
 
HiMotion

Project Team

Prof. Ana Fred Hugo Gamboa Hugo Silva

Click to enlarge
   
Summary

The HiMotion project promotes studies human of computer interaction (HCI) and physiology in the context of cognitive activities. The project comprises the design, implementation and integration of the components: (1) set of cognitive tests; (2) signal acquisition protocols and signal processing tools; (3) protocol administration to 25 volunteers (4) database of HCI and electrophysiological signals. The research was conducted within the group of pattern recognition and information theory of IT, with the collaboration of Escola Superior de Tecnologia de Setúbal and INSTICC

   
Overview

HiMotion Project - HCI and physiological signal acquisition


In this project we have developed an experimental setup and a coherent methodological, algorithmic and computational tool set for the acquisition and processing of cognitive-related signals during computer assisted problem solving. This setup is twofold: to assess and study such cognitive states under rigorous and controlled experiments; to test the ability of the several types of data for authentication purposes. The project thus consisted of the design, implementation and administration of a set of computer based experiments with cognitive tests related to memory, concentration, association, intelligence and insight characteristics. The underlying hypothesis are that these activities produce noticeable changes in the subject’s physiological characteristics, which, on one hand, are task dependent and therefore global task-related dynamics/features can be recognised, and, on the other hand, individual behavioural treats may be present in the acquired data, and thus contribute for human identification. A (remote) monitoring system was developed in order to follow the human computer interaction with detailed context information of the user activity.

Click to enlarge
   
Human Computer Interaction

One of the sources of information relevant to our research is the behavior of the user while interacting with the computer. To be able to monitor the user interaction with the computer, we developed a system named Web Interaction Display and Monitoring (WIDAM) to acquire the user interaction in a web page. Although our present study can't be applied at distance since we are using the acquisition of electrophysiological signals, the HCI data can be collected over the Internet using the developed system.

Click to enlarge
   
Physiological Signals

A set of physiologic signals was acquired during the realization of the tests. We have four distinct signals: electrodermal activity (EDA), blood volume pressure (BVP), electrocardiogram (EKG) and electroencephalography (EEG), that are continuously recorded during the session. We record an additional signal that was physically connected to the mouse and that was triggered by pressing the mouse left button in order to be able to synchronize the mouse interaction events and the physiologic signals. This synchronization signal was also fed into the video camera via a LED, thus maintain all the acquisition signals aligned in time.

   
Cognitive Tests

A set of cognitive tests have been designed for the purpose of studying the behavior and the physiological reaction under diverse cognitive situations. Each test focuses on one of the following cognitive activities: Memory; Association; Intelligence; Discovery; and Concentration.


Publications

H. Silva, H. Gamboa, A. Fred, Applicability of Lead V2 ECG Measurements in Biometrics, In Proc. of Med-e-Tel 2007, 2007. (pdf)



 

   
 

   
 

   
 

   
 

   
 

 
© 2015, IT - Instituto de Telecomunicações. Todos os direitos reservados.