Development of machine learning methods for human-computer interaction – HCI&AI

Institutional research project

Area

STEM

Duration

48 mjeseci

Total Funds

124.220,00 EUR

Abstract

The HCI&AI project is focused on the development of innovative machine learning methods for human-computer interaction (HCI) that will connect augmented reality (XR) technologies, large language models (LLM), user experience evaluation and generative models in a new way.

Solutions will be researched and developed in four complementary areas: (1) interactive AR simulations for user training and support, (2) large language models adapted for interactive support and understanding of specialized texts, (3) user feedback mechanisms and objective evaluation of the effectiveness of HCI systems, and (4) generation of synthetic data and content with the help of advanced generative models.

By integrating these areas, the project will enable new forms of education, intelligent assistive systems and content creation, with applications in various interdisciplinary domains.

The results of the project are expected to contribute to the scientific excellence of the research group and the wider community through publication of papers, open software tools and databases, and the establishment of international interdisciplinary collaborations.

The technologies developed and the data collected will have internationally relevant value, thus the HCI&AI project encourages further progress in HCI and artificial intelligence on a global level.

Main objectives

1

Increasing the participation of public higher education institutions and public scientific institutes in competitive project financing.

2

Encouraging the implementation of applied scientific activities, including cooperation projects with the economy

Project objectives

The project aims to develop innovative machine learning and augmented reality methods to improve human-computer interaction through simulation systems, large-scale language models and generative algorithms with applications in education, medicine and interdisciplinary domains.

The project will result in scientifically based solutions that enable personalized, visually and haptically enriched education and smart assistive systems based on artificial intelligence. The developed methods will be tested and evaluated, and the results will be published in the form of scientific papers and open software solutions.

Research team

prof. dr. sc. Krešimir Nenadić

Human-Computer Interaction and Haptic Systems Expert

Izv. prof. dr. sc. Časlav Livada

Researcher in the field of image processing, computer game development and 3D modeling

doc. dr. sc. Hrvoje Leventić

Expert in the development of machine learning methods and natural language processing

doc. dr. sc. Krešimir Romić

Expert in the field of computer vision and image analysis

Funded by the European Union - Next Generation EU. However, the views and opinions expressed are solely those of the author(s) and do not necessarily reflect those of the European Union or the European Commission. Neither the European Union nor the European Commission can be held responsible for them.