NALA_MAINZ at BLP-2025 Task 2: A Multi-agent Approach for Bangla Instruction to Python Code Generation
By: Hossain Shaikh Saadi , Faria Alam , Mario Sanz-Guerrero and more
Potential Business Impact:
Teaches computers to write code from Bangla.
This paper presents JGU Mainz's winning system for the BLP-2025 Shared Task on Code Generation from Bangla Instructions. We propose a multi-agent-based pipeline. First, a code-generation agent produces an initial solution from the input instruction. The candidate program is then executed against the provided unit tests (pytest-style, assert-based). Only the failing cases are forwarded to a debugger agent, which reruns the tests, extracts error traces, and, conditioning on the error messages, the current program, and the relevant test cases, generates a revised solution. Using this approach, our submission achieved first place in the shared task with a $Pass@1$ score of 95.4. We also make our code public.
Similar Papers
Retriv at BLP-2025 Task 2: Test-Driven Feedback-Guided Framework for Bangla-to-Python Code Generation
Computation and Language
Helps computers write code from Bengali instructions.
BanglaForge: LLM Collaboration with Self-Refinement for Bangla Code Generation
Software Engineering
Helps computers write code from Bengali words.
End-to-End Bangla AI for Solving Math Olympiad Problem Benchmark: Leveraging Large Language Model Using Integrated Approach
Computation and Language
Makes AI better at math problems in Bangla.