DAMASHA: Detecting AI in Mixed Adversarial Texts via Segmentation with Human-interpretable Attribution
By: L. D. M. S. Sai Teja , N. Siva Gopala Krishna , Ufaq Khan and more
Potential Business Impact:
Finds where computers start writing in human text.
In the age of advanced large language models (LLMs), the boundaries between human and AI-generated text are becoming increasingly blurred. We address the challenge of segmenting mixed-authorship text, that is identifying transition points in text where authorship shifts from human to AI or vice-versa, a problem with critical implications for authenticity, trust, and human oversight. We introduce a novel framework, called Info-Mask for mixed authorship detection that integrates stylometric cues, perplexity-driven signals, and structured boundary modeling to accurately segment collaborative human-AI content. To evaluate the robustness of our system against adversarial perturbations, we construct and release an adversarial benchmark dataset Mixed-text Adversarial setting for Segmentation (MAS), designed to probe the limits of existing detectors. Beyond segmentation accuracy, we introduce Human-Interpretable Attribution (HIA overlays that highlight how stylometric features inform boundary predictions, and we conduct a small-scale human study assessing their usefulness. Across multiple architectures, Info-Mask significantly improves span-level robustness under adversarial conditions, establishing new baselines while revealing remaining challenges. Our findings highlight both the promise and limitations of adversarially robust, interpretable mixed-authorship detection, with implications for trust and oversight in human-AI co-authorship.
Similar Papers
AI-generated Text Detection: A Multifaceted Approach to Binary and Multiclass Classification
Computation and Language
Finds if writing is from a person or AI.
Beyond checkmate: exploring the creative chokepoints in AI text
Computation and Language
Finds where AI writing is easiest to spot.
Robust and Fine-Grained Detection of AI Generated Texts
Computation and Language
Finds AI writing mixed with human writing.