Culturally Grounded Physical Commonsense Reasoning in Italian and English: A Submission to the MRL 2025 Shared Task
By: Marco De Santis, Lisa Alazraki
Potential Business Impact:
Teaches computers Italian common sense.
This paper presents our submission to the MRL 2025 Shared Task on Multilingual Physical Reasoning Datasets. The objective of the shared task is to create manually-annotated evaluation data in the physical commonsense reasoning domain, for languages other than English, following a format similar to PIQA. Our contribution, FormaMentis, is a novel benchmark for physical commonsense reasoning that is grounded in Italian language and culture. The data samples in FormaMentis are created by expert annotators who are native Italian speakers and are familiar with local customs and norms. The samples are additionally translated into English, while preserving the cultural elements unique to the Italian context.
Similar Papers
Global PIQA: Evaluating Physical Commonsense Reasoning Across 100+ Languages and Cultures
Computation and Language
Helps computers understand people's different cultures.
Grounded Multilingual Medical Reasoning for Question Answering with Large Language Models
Computation and Language
Helps doctors answer medical questions in many languages.
Do LLMs exhibit the same commonsense capabilities across languages?
Computation and Language
Computers understand and write stories in many languages.