Current Research Activities

At present, I am active in the following research projects:

• The GEM Benchmark Project — Investigating the evaluation of large language models.
• The ReproHum Project — Exploring the reproducibility of human evaluations in Natural Language Generation.

In addition to the above projects, I also participate in reviewing and writing of research papers for conferences such as ACL, INLG, EMNLP, and COLING. For a list of authored or co-authored papers please see the publications section.

I was also the lead program chair for the 17th International Conference on Natural Language Generation in Tokyo, Japan. I helped to organise the conference by sending out the call for papers, recruiting reviewers, defining the conference program, communicating with authors, coordinating with local chairs, etc.

Internships

The following PhD students have conducted their internships under my supervision:

• Patrícia Schmidtová (Charles University). Detecting Semantic Errors in Hotel Highlights. October 2024-January 2025, at trivago
• Eduardo Calò (Utrecht University). Annotation Scheme for Annotating Hallucinations in LLM Output. November 2023-Feburary 2024, at trivago

Thesis Supervision

I have supervised the following students for their respective thesis:

• Siddhartha Mathi — Master Thesis, January 2024. Using LLMs for Data-to-Text Generation of Descriptions (trivago & Ruhr-Universität Bochum)
• Yasmine Taha — Master Thesis, July 2024. Landmark detection in Images using Multimodal LLMs (trivago & Universität Duisburg-Essen)