HSE Researchers Develop Python Library for Analysing Eye Movements
A research team at HSE University has developed EyeFeatures, a Python library for analysing and modelling eye movement data. This tool is designed to simplify the work of scientists and developers by enabling them to efficiently process complex data and create predictive models.
The project was implemented as part of the Strategic Project 'Human-Centred AI' (Priority 2030).
Modern research increasingly leverages machine learning and artificial intelligence to analyse vast amounts of eye movement data. However, despite significant advancements in this field, certain challenges continue to limit the effectiveness of these methods. One such challenge is the limited flexibility of existing software solutions, which often offer a narrow range of parameter settings, making it difficult to customize them for specific research tasks. Additionally, the integration of these tools with other specialised software remains a significant limitation.
The Python library EyeFeatures, developed by the Laboratory for Social and Cognitive Informatics at HSE Campus in St Petersburg, addresses these challenges by providing a versatile and user-friendly toolkit for working with eye movement data. It includes modules for processing and analysing data collected from eye trackers, devices that monitor eye movement during the performance of various tasks.
Processing eye movement data is a complex task that involves several stages. Since the eyes do not move smoothly but rather in a series of rapid, jerky motions, focusing on specific points, the first stage of data processing is identifying areas of fixation. In the second stage, metrics such as the average gaze fixation duration and the average distance between points are calculated, enabling the creation of initial, simple predictive or diagnostic models.
All stages of data processing can be carried out using the various modules of the EyeFeatures library. The flexible, modular approach makes it easy to integrate eye movement data processing into existing research and commercial projects, from raw data to a fully developed predictive or explanatory model. For example, using the library in marketing research allows for the evaluation of consumer reactions to advertisements. Eye movement analysis will reveal which elements capture the most attention from the audience.
According to Anton Surkov, Project Head, Junior Research Fellow at Laboratory for Social and Cognitive Informatics at HSE Campus in St Petersburg, 'The library can be valuable to researchers, as it enables them not simply to replicate existing functionality from other software but to implement new algorithms and create more advanced models for research in fields such as marketing, cognitive process diagnostics, user interface and neural interface development (where control and interaction with the program occur through eye movement), as well as combine components in innovative ways to achieve new results and enhance methodology.'
This solution streamlines data analysis and accelerates the creation of predictive models, which is particularly beneficial in medical diagnostics, marketing, and the study of cognitive processes. The library has already been applied in research conducted as part of the Strategic Project 'Human-Centred AI' and was presented at the ECEM 2024 international conference in Ireland.
See also:
HSE Scientists Develop Application for Diagnosing Aphasia
Specialists at the HSE Centre for Language and Brain have developed an application for diagnosing language disorders (aphasia), which can result from head injuries, strokes, or other neurological conditions. AutoRAT is the first standardised digital tool in Russia for assessing the presence and severity of language disorders. The application is available on RuStore and can be used on mobile and tablet devices running the Android operating system.
HSE Researchers Discover Simple and Reliable Way to Understand How People Perceive Taste
A team of scientists from the HSE Centre for Cognition & Decision Making has studied how food flavours affect brain activity, facial muscles, and emotions. Using near-infrared spectroscopy (fNIRS), they demonstrated that pleasant food activates brain areas associated with positive emotions, while neutral food stimulates regions linked to negative emotions and avoidance. This approach offers a simpler way to predict the market success of products and study eating disorders. The study was published in the journal Food Quality and Preference.
Russian Scientists Demonstrate How Disorder Contributes to Emergence of Unusual Superconductivity
Researchers at HSE University and MIPT have investigated how the composition of electrons in a superconductor influences the emergence of intertype superconductivity—a unique state in which superconductors display unusual properties. It was previously believed that intertype superconductivity occurs only in materials with minimal impurities. However, the scientists discovered that the region of intertype superconductivity not only persists but can also expand in materials with a high concentration of impurities and defects. In the future, these superconductors could contribute to the development of highly sensitive sensors and detectors. The study has been published in Frontiers of Physics.
HSE Scientists Take Important Step Forward in Development of 6G Communication Technologies
Researchers at HSE MIEM have successfully demonstrated the effective operation of a 6G wireless communication channel at sub-THz frequencies. The device transmits data at 12 Gbps and maintains signal stability by automatically switching when blocked. These metrics comply with international 6G standards. An article published on arXiv, an open-access electronic repository, provides a description of certain elements of the system.
Megascience, AI, and Supercomputers: HSE Expands Cooperation with JINR
Experts in computer technology from HSE University and the Joint Institute for Nuclear Research (JINR) discussed collaboration and joint projects at a meeting held at the Meshcheryakov Laboratory of Information Technologies (MLIT). HSE University was represented by Lev Shchur, Head of the Laboratory for Computational Physics at the HSE Tikhonov Moscow Institute of Electronics and Mathematics (HSE MIEM), as well as Denis Derkach and Fedor Ratnikov from the Laboratory of Methods for Big Data Analysis at the HSE Faculty of Computer Science.
AI vs AI: Scientists Develop Neural Networks to Detect Generated Text Insertions
A research team, including Alexander Shirnin from HSE University, has developed two models designed to detect AI-generated insertions in scientific texts. The AIpom system integrates two types of models: a decoder and an encoder. The Papilusion system is designed to detect modifications through synonyms and summarisation by neural networks, using one type of models: encoders. In the future, these models will assist in verifying the originality and credibility of scientific publications. Articles describing the Papilusion and AIpom systems have been published in the ACL Anthology Digital Archive.
Acoustic Battles for the Harem: How the Calls of Siberian Wapiti Reveal Their Status and Individuality
Researchers at HSE University, Lomonosov Moscow State University, and the A.N. Severtsov Institute of Ecology and Evolution of the Russian Academy of Sciences have studied the distinctive vocalisations of Siberian wapiti (Cervus canadensis sibiricus) stags during the peak of the mating season, when males produce rutting calls (bugles) to attract females (hinds) and deter rivals. The scientists have discovered how the acoustic parameters of these rutting calls reflect the stag's status—whether he currently holds a harem or is still attempting to acquire one—as well as his individual characteristics. The study has been published in Journal of Zoology.
Z-Flipons: How Specific DNA Regions Help Regulate Gene Function
Researchers at HSE University and InsideOutBio have applied machine learning to identify the location and functions of mirror-twisted DNA structures, known as Z-flipons, in human and mouse genomes. The scientists discovered which Z-DNA regions were conserved in both species throughout evolution and demonstrated for the first time that Z-DNA accelerates the process of creating RNA copies of genes. The findings will contribute to the development of new treatments for genetic diseases. The study has been published in Scientific Reports.
Scientists Identify Fifteen Key Motives Driving Human Behaviour
Researchers at HSE University and the London School of Hygiene and Tropical Medicine have identified 15 key motives that drive human behaviour. By analysing people's views, preferences, and actions through an evolutionary lens, they demonstrated how these motives intertwine to shape habits and interpersonal relationships. The findings have been published in Personality and Individual Differences.
HSE Neurolinguists Create Russian Adaptation of Classic Verbal Memory Test
Researchers at the HSE Centre for Language and Brain and Psychiatric Hospital No. 1 Named after N.A. Alexeev have developed a Russian-language adaptation of the Rey Auditory Verbal Learning Test. This classic neuropsychological test evaluates various aspects of auditory verbal memory in adults and is widely used in both clinical diagnostics and research. The study findings have been published in The Clinical Neuropsychologist.