Recent Publications

A selection of recent papers and preprints. For the full publication list, please see Google Scholar.

• FondueQA: A Benchmark for Evaluating Parametric Compensation in Multi-Hop QA

  Preprint · 2026

  Laurin Schmid, Suman Navaratnarajah, Koel Dutta Chowdhury, Steffen Eger, Josif Grabocka, Christian Frey

  We remove facts from retrieved evidence to test when models fill the gaps with internal knowledge.

  Knowledge and evidenceRetrieval-augmented generation

• Formatting and Surface Feature Confounds in AI Text Detection: A Clever Hans Effect

  Findings of EMNLP 2026 · Accepted

  Koel Dutta Chowdhury, Cristina España-Bonet, Josef van Genabith

  We test whether AI text detectors are picking up formatting cues rather than differences between human and generated writing.

  EvaluationAI text detection

• Tracing Stereotypes from Representation to Output in Multilingual LLMs

  EMNLP 2026 · Main conference · Accepted

  Ariun-Erdene Tumurchuluun, Yusser Al Ghussin, Pinzhen Chen, Josef van Genabith, Koel Dutta Chowdhury

  We ask whether stereotypes found inside a model also shape its answers, and how this changes across languages.

  MultilingualityInterpretabilitySocial biasPaper ↗

• Last Translation Benchmark

  Preprint · 2026

  I contributed to a community effort to collect translation examples that remain difficult for current systems.

  EvaluationMultilingualityPaper ↗

• Cultivar: A Contrastive and Locale-Oriented Translation Benchmark for Investigating Contamination and Localisation Robustness

  Preprint · 2026

  Pinzhen Chen, Koel Dutta Chowdhury, Xiaoya Xu, David Tan, Doreen Osmelak, Ona de Gibert, Ariun-Erdene Tumurchuluun, Ashok Urlana, Fedor Sizov, Hale Sirin, Jesujoba Alabi, Karrar Talib Abed, Mateusz Klimaszewski, Nikolay Bogoychev, Niyati Bafna, Patricia Schmidtova, Preksha Manjunath Shanbhag, Sherrie Shen, Vilem Zouhar, Vivek Iyer, Yasser Hamidullah, Yusser Al Ghussin, Zheng Zhao

  We use contrastive, locale-specific translation examples to examine contamination and localisation.

  EvaluationLocalisationPaper ↗