Evaluation Framework for Human-In-The-Loop Digital Twins
- Type:Master Thesis
- Supervisor:
Johannes Deufel
Prof. Sanja Lazarova-Molnar
Description
Problem:
Data-driven Digital Twins are increasingly used in complex decision-making environments. Humans can significantly enhance Digital Twins operations through domain knowledge and cognitive and physical capabilities. To allow human integration in Digital Twins in a more systematic manner, efforts are being made to develop standardized frameworks and applied prototypes. However, evaluating such frameworks and corresponding prototypes remains a major challenge.
To enable systematic development and comparison of Human-in-the-Loop Digital Twins, a structured evaluation methodology is required that considers multiple dimensions such as user satisfaction, transparency, cognitive load, and operational efficiency.
Goal:
The goal of this thesis is to design and validate an evaluation framework for Human-in-the-Loop Digital Twin systems, including both conceptual frameworks and technical implementations.
To achieve this, the student will review evaluation approaches from related domains such as Human-Computer Interaction, Human Factors, and simulation-based systems. Based on this, relevant evaluation dimensions and metrics will be identified and consolidated into a unified, multi-dimensional evaluation method, which is subsequently applied and validated.
Required Skills and Knowledge:
- Interest in Digital Twins and Human-Computer Interaction.
-
Basic understanding of empirical research methods.
-
Analytical and structured working style.
-
Basic programming skills (Python) are beneficial but not required.
-
Interest in user studies and evaluation design.