Skip to content

Publications

Output from FACES, and the Va.Si.Li-Lab work the project builds on. BibTeX entries are taken from the Text Technology Lab publication list.

FACES output

InterView: Towards a Unified VR-Capable Interview Environment

Under review

Patrick Schrottenbacher, Alexander Mehler, Giuseppe Abrami, Lydia Kleine and Doris Stingl (2026). Submitted to the International Journal of Human-Computer Studies (Elsevier). Preprint on SSRN: doi:10.2139/ssrn.7459949.

The system paper: the requirements for a flexible, accessible interview environment; the architecture; and the evaluation study of 27 VR interviews reported under Studies. Its central argument is that interview data should be treated as a structured, networked, multimodal dataset: questionnaire items, multimodal recordings and contextual signals as nodes, their temporal and behavioural relations as typed links, rather than as isolated question–answer pairs with metadata attached.

BibTeX
@misc{Schrottenbacher:et:al:2026:c,
  author       = {Schrottenbacher, Patrick and Mehler, Alexander and Abrami, Giuseppe
                  and Kleine, Lydia and Stingl, Doris},
  title        = {{InterView}: Towards a Unified {VR}-Capable Interview Environment},
  year         = {2026},
  howpublished = {SSRN preprint},
  doi          = {10.2139/ssrn.7459949},
  url          = {https://ssrn.com/abstract=7459949},
  keywords     = {Virtual Reality, Extended reality, Survey interviews,
                  Interview systems, Multimodality, FACES},
  note         = {Under review}
}

ReEmote: Towards Emotion Representation in VR Through Va.Si.Li-Lab

Accepted

Patrick Schrottenbacher, Alexander Mehler, Vivienne Bernhardt, Leon Rohe and Giuseppe Abrami (2026). Proceedings of XR Salento 2026, Springer International Publishing.

ReEmote extends Va.Si.Li-Lab with schema-based emotion mappings that affect both avatars and their environments, so that human users and virtual agents share an emotional expression space. The paper sets out the design choices and evaluates the graphical validity of the representation: emotions can be validly conveyed through avatar facial expression, and users identify them quickly as Ekman's basic emotions. It feeds directly into requirement (B) of the FACES platform.

BibTeX
@inproceedings{Schrottenbacher:et:al:2026:a,
  author    = {Schrottenbacher, Patrick and Mehler, Alexander and Bernhardt, Vivienne
               and Rohe, Leon and Abrami, Giuseppe},
  title     = {ReEmote: Towards Emotion Representation in {VR} Through {Va.Si.Li}-Lab},
  booktitle = {Proceedings of XR Salento 2026},
  year      = {2026},
  publisher = {Springer International Publishing},
  keywords  = {VR, XR, affective computing, virtual humans, emotion detection, FACES},
  note      = {accepted}
}

Presentations

  • Schrottenbacher, P., Kleine, L., Mehler, A., Kleinert, C. & Aßmann, C. (2025, July 14 to 18). Exploring the Impact of Virtual Avatars in Survey Interviews [Paper presentation]. 11th Conference of the European Survey Research Association (ESRA), Utrecht, The Netherlands.
  • Kleine, L., Stingl, D. & Schrottenbacher, P. (2026, February 26 to 27). Virtuelle Avatare in Befragungen [Paper presentation]. 18. Workshop der Panelsurveys im deutschsprachigen Raum, Wiesbaden.

The Va.Si.Li-Lab platform

Va.Si.Li-Lab: A Virtual Reality Solution for Applications in the Field of Educational and Social Science Technologies

Patrick Schrottenbacher, Giuseppe Abrami, Mevlüt Bagci and Alexander Mehler (2026). In Digitale Learning Designs für die Hochschullehre gemeinschaftlich entwickeln, Waxmann, 212–229.

DOI 10.31244/9783818851170

BibTeX
@incollection{Schrottenbacher:et:al:2026:b,
  author    = {Schrottenbacher, Patrick and Abrami, Giuseppe and Bagci, Mevl{\"u}t
               and Mehler, Alexander},
  title     = {{Va.Si.Li-Lab}: A Virtual Reality Solution for Applications in
               the Field of Educational and Social Science Technologies},
  booktitle = {Digitale Learning Designs f{\"u}r die Hochschullehre gemeinschaftlich
               entwickeln: Werkzeuge -- Ressourcen -- Szenarien},
  editor    = {Zeaiter, Sabrina and Stierwald, Mona},
  publisher = {Waxmann},
  year      = {2026},
  pages     = {212--229},
  doi       = {10.31244/9783818851170}
}

Simulation-Based Learning in Virtual Reality: Three Use Cases from Social Science and Technological Foundations in Terms of Va.Si.Li-Lab

Mevlüt Bagci, Alexander Mehler, Giuseppe Abrami, Patrick Schrottenbacher, Christian Spiekermann, Maxim Konca, Jakob Schreiber, Kevin Saukel, Marc Quintino and Juliane Engel (2025). Technology, Knowledge and Learning, Springer Nature.

DOI 10.1007/s10758-025-09837-7

BibTeX
@article{Bagci:et:al:2025,
  author    = {Bagci, Mevl{\"u}t and Mehler, Alexander and Abrami, Giuseppe and Schrottenbacher, Patrick
               and Spiekermann, Christian and Konca, Maxim and Schreiber, Jakob and Saukel, Kevin
               and Quintino, Marc and Engel, Juliane},
  title     = {Simulation-Based Learning in Virtual Reality: Three Use Cases
               from Social Science and Technological Foundations in Terms of
               Va.Si.Li-Lab},
  journal   = {Technology, Knowledge and Learning},
  publisher = {Springer Nature},
  year      = {2025},
  month     = {April},
  day       = {01},
  issn      = {2211-1670},
  doi       = {10.1007/s10758-025-09837-7},
  url       = {https://doi.org/10.1007/s10758-025-09837-7}
}

Towards New Data Spaces for the Study of Multiple Documents with Va.Si.Li-Lab: A Conceptual Analysis

Alexander Mehler, Mevlüt Bagci, Patrick Schrottenbacher, Alexander Henlein, Maxim Konca, Giuseppe Abrami, Kevin Bönisch, Manuel Stoeckel, Christian Spiekermann and Juliane Engel (2024). In Students', Graduates' and Young Professionals' Critical Use of Online Information, Springer Nature Switzerland, 259–303.

The conceptual groundwork for treating VR interaction as a data space, the frame FACES inherits.

DOI 10.1007/978-3-031-69510-0_12

BibTeX
@inbook{Mehler:et:al:2024:a,
  author    = {Mehler, Alexander and Bagci, Mevl{\"u}t and Schrottenbacher, Patrick
               and Henlein, Alexander and Konca, Maxim and Abrami, Giuseppe and B{\"o}nisch, Kevin
               and Stoeckel, Manuel and Spiekermann, Christian and Engel, Juliane},
  editor    = {Zlatkin-Troitschanskaia, Olga and Nagel, Marie-Theres and Klose, Verena
               and Mehler, Alexander},
  title     = {Towards New Data Spaces for the Study of Multiple Documents with
               Va.Si.Li-Lab: A Conceptual Analysis},
  booktitle = {Students', Graduates' and Young Professionals' Critical Use of
               Online Information: Digital Performance Assessment and Training
               within and across Domains},
  year      = {2024},
  publisher = {Springer Nature Switzerland},
  address   = {Cham},
  pages     = {259--303},
  isbn      = {978-3-031-69510-0},
  doi       = {10.1007/978-3-031-69510-0_12},
  url       = {https://doi.org/10.1007/978-3-031-69510-0_12}
}

Va.Si.Li-ES: VR-based Dynamic Event Processing, Environment Change and User Feedback in Va.Si.Li-Lab

Giuseppe Abrami, Dominik Alexander Wontke, Gurpreet Singh and Alexander Mehler (2024). Proceedings of the 35th ACM Conference on Hypertext and Social Media (HT '24), ACM, 357–368.

Publisher · DOI 10.1145/3648188.3675154

BibTeX
@inproceedings{Abrami:et:al:2024:b,
  author    = {Abrami, Giuseppe and Wontke, Dominik Alexander and Singh, Gurpreet
               and Mehler, Alexander},
  title     = {Va.Si.Li-ES: VR-based Dynamic Event Processing, Environment Change
               and User Feedback in Va.Si.Li-Lab},
  year      = {2024},
  isbn      = {9798400705953},
  publisher = {Association for Computing Machinery},
  address   = {New York, NY, USA},
  url       = {https://doi.org/10.1145/3648188.3675154},
  doi       = {10.1145/3648188.3675154},
  booktitle = {Proceedings of the 35th ACM Conference on Hypertext and Social Media},
  pages     = {357--368},
  numpages  = {12},
  keywords  = {Collaborative Simulation, Environmental Event System, Hypertext, Ubiq, Va.Si.Li-Lab, Virtual Reality},
  location  = {Poznan, Poland},
  series    = {HT '24}
}

A Multimodal Data Model for Simulation-Based Learning with Va.Si.Li-Lab

Alexander Mehler, Mevlüt Bagci, Alexander Henlein, Giuseppe Abrami, Christian Spiekermann, Patrick Schrottenbacher, Maxim Konca, Andy Lücking, Juliane Engel, Marc Quintino, Jakob Schreiber, Kevin Saukel and Olga Zlatkin-Troitschanskaia (2023). Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management (HCII 2023), Springer Nature Switzerland, 539–565.

The hypergraph-based data model, interleaved with ISO-Space, that InterView extends with interview-specific entities.

Publisher · DOI 10.1007/978-3-031-35741-1_39

BibTeX
@inproceedings{Mehler:et:al:2023:a,
  author    = {Mehler, Alexander and Bagci, Mevl{\"u}t and Henlein, Alexander
               and Abrami, Giuseppe and Spiekermann, Christian and Schrottenbacher, Patrick
               and Konca, Maxim and L{\"u}cking, Andy and Engel, Juliane and Quintino, Marc
               and Schreiber, Jakob and Saukel, Kevin and Zlatkin-Troitschanskaia, Olga},
  title     = {A Multimodal Data Model for Simulation-Based Learning with Va.Si.Li-Lab},
  booktitle = {Digital Human Modeling and Applications in Health, Safety, Ergonomics
               and Risk Management},
  editor    = {Duffy, Vincent G.},
  address   = {Cham},
  isbn      = {978-3-031-35741-1},
  pages     = {539--565},
  publisher = {Springer Nature Switzerland},
  year      = {2023},
  doi       = {10.1007/978-3-031-35741-1_39}
}

Va.Si.Li-Lab as a Collaborative Multi-User Annotation Tool in Virtual Reality and Its Potential Fields of Application

Giuseppe Abrami, Alexander Mehler, Mevlüt Bagci, Patrick Schrottenbacher, Alexander Henlein, Christian Spiekermann, Juliane Engel and Jakob Schreiber (2023). Proceedings of the 34th ACM Conference on Hypertext and Social Media (HT '23), ACM.

Publisher · PDF · DOI 10.1145/3603163.3609076

BibTeX
@inproceedings{Abrami:et:al:2023,
  author    = {Abrami, Giuseppe and Mehler, Alexander and Bagci, Mevl{\"u}t and Schrottenbacher, Patrick
               and Henlein, Alexander and Spiekermann, Christian and Engel, Juliane
               and Schreiber, Jakob},
  title     = {Va.Si.Li-Lab as a Collaborative Multi-User Annotation Tool in
               Virtual Reality and Its Potential Fields of Application},
  booktitle = {Proceedings of the 34th ACM Conference on Hypertext and Social Media},
  series    = {HT '23},
  year      = {2023},
  isbn      = {9798400702327},
  publisher = {Association for Computing Machinery},
  address   = {New York, NY, USA},
  articleno = {22},
  numpages  = {9},
  location  = {Rome, Italy},
  url       = {https://doi.org/10.1145/3603163.3609076},
  doi       = {10.1145/3603163.3609076}
}

Geo-spatial hypertext in virtual reality: mapping and navigating global news event spaces

Patrick Schrottenbacher, Alexander Mehler, Theresa Berg, Jasper Hustedt, Julian Gagel, Timo Lüttig and Giuseppe Abrami (2025). New Review of Hypermedia and Multimedia 31(1–2), 76–105.

DOI 10.1080/13614568.2024.2383601

BibTeX
@article{Schrottenbacher:et:al:2025,
  author    = {Schrottenbacher, Patrick and Mehler, Alexander and Berg, Theresa
               and Hustedt, Jasper and Gagel, Julian and L{\"u}ttig, Timo and Abrami, Giuseppe},
  title     = {Geo-spatial hypertext in virtual reality: mapping and navigating
               global news event spaces},
  journal   = {New Review of Hypermedia and Multimedia},
  volume    = {31},
  number    = {1-2},
  pages     = {76--105},
  year      = {2025},
  publisher = {Taylor \& Francis},
  doi       = {10.1080/13614568.2024.2383601},
  url       = {https://doi.org/10.1080/13614568.2024.2383601}
}

Further Va.Si.Li-Lab work

  • Henlein, Lücking & Mehler (2024). Virtually Restricting Modalities in Interactions: Va.Si.Li-Lab for Experimental Multimodal Research. MMSYM 2024, 96–97. PDF
  • Henlein, Lücking, Bagci & Mehler (2023). Towards grounding multimodal semantics in interaction data with Va.Si.Li-Lab. GESPIN 2023, Nijmegen. PDF
  • DUUI (Docker Unified UIMA Interface), the distributed processing pipeline InterView-P hands its relational datasets to. Repository

The full list is maintained on the Text Technology Lab publications page.


How to cite

Until the system paper appears, cite the framework InterView is built on:

@inproceedings{Mehler:et:al:2023:a,
  author    = {Mehler, Alexander and Bagci, Mevl{\"u}t and Henlein, Alexander
               and Abrami, Giuseppe and Spiekermann, Christian and Schrottenbacher, Patrick
               and Konca, Maxim and L{\"u}cking, Andy and Engel, Juliane and Quintino, Marc
               and Schreiber, Jakob and Saukel, Kevin and Zlatkin-Troitschanskaia, Olga},
  title     = {A Multimodal Data Model for Simulation-Based Learning with Va.Si.Li-Lab},
  booktitle = {Digital Human Modeling and Applications in Health, Safety, Ergonomics
               and Risk Management},
  editor    = {Duffy, Vincent G.},
  address   = {Cham},
  pages     = {539--565},
  publisher = {Springer Nature Switzerland},
  year      = {2023},
  doi       = {10.1007/978-3-031-35741-1_39}
}

If you refer to the project, cite it as DFG project 539621548 within SPP 2431 New Data Spaces.

Partners & funding