More Parameters Than Populations: A Systematic Literature Review of Large Language Models within Survey Research
By: Trent D. Buskirk , Florian Keusch , Leah von der Heyde and more
Potential Business Impact:
Helps surveys use AI to gather and understand information.
Survey research has a long-standing history of being a human-powered field, but one that embraces various technologies for the collection, processing, and analysis of various behavioral, political, and social outcomes of interest, among others. At the same time, Large Language Models (LLMs) bring new technological challenges and prerequisites in order to fully harness their potential. In this paper, we report work-in-progress on a systematic literature review based on keyword searches from multiple large-scale databases as well as citation networks that assesses how LLMs are currently being applied within the survey research process. We synthesize and organize our findings according to the survey research process to include examples of LLM usage across three broad phases: pre-data collection, data collection, and post-data collection. We discuss selected examples of potential use cases for LLMs as well as its pitfalls based on examples from existing literature. Considering survey research has rich experience and history regarding data quality, we discuss some opportunities and describe future outlooks for survey research to contribute to the continued development and refinement of LLMs.
Similar Papers
Large Language Models in the Data Science Lifecycle: A Systematic Mapping Study
Computers and Society
Helps computers do data science tasks better.
On the Use of Large Language Models for Qualitative Synthesis
Software Engineering
Helps doctors organize medical research faster.
Large language models for behavioral modeling: A literature survey
Software Engineering
Helps computers draw diagrams from words.