Adoption of Explainable Natural Language Processing: Perspectives from Industry and Academia on Practices and Challenges
By: Mahdi Dhaini , Tobias Müller , Roksoliana Rabets and more
Potential Business Impact:
Helps people understand how AI makes decisions.
The field of explainable natural language processing (NLP) has grown rapidly in recent years. The growing opacity of complex models calls for transparency and explanations of their decisions, which is crucial to understand their reasoning and facilitate deployment, especially in high-stakes environments. Despite increasing attention given to explainable NLP, practitioners' perspectives regarding its practical adoption and effectiveness remain underexplored. This paper addresses this research gap by investigating practitioners' experiences with explainability methods, specifically focusing on their motivations for adopting such methods, the techniques employed, satisfaction levels, and the practical challenges encountered in real-world NLP applications. Through a qualitative interview-based study with industry practitioners and complementary interviews with academic researchers, we systematically analyze and compare their perspectives. Our findings reveal conceptual gaps, low satisfaction with current explainability methods, and highlight evaluation challenges. Our findings emphasize the need for clear definitions and user-centric frameworks for better adoption of explainable NLP in practice.
Similar Papers
Explainability in Practice: A Survey of Explainable NLP Across Various Domains
Computation and Language
Shows how smart computer language programs make decisions.
NLP Meets the World: Toward Improving Conversations With the Public About Natural Language Processing Research
Computers and Society
Helps people understand AI better.
When Explainability Meets Privacy: An Investigation at the Intersection of Post-hoc Explainability and Differential Privacy in the Context of Natural Language Processing
Computation and Language
Makes AI explain itself without sharing secrets.