Employing large language models in survey research

Bernard J. Jansen, Soon-gyo Jung, Joni Salminen Natural Language ProcessingJournal (2023)

Abstract

This article discusses the promising potential of employing large language models (LLMs) for survey research , including generating responses to survey items. LLMs can address some of the challenges associated with survey research regarding question-wording and response bias. They can address issues relating to a lack of clarity and understanding but cannot yet correct for sampling or nonresponse bias challenges. While LLMs can assist with some of the challenges with survey research, at present, LLMs need to be used in conjunction with other methods and approaches. With thoughtful and nuanced approaches to development, LLMs can be used responsibly and beneficially while minimizing the associated risks.

Team

Dr. Bernard Jansen

Dr. Bernard Jansen

Visiting Professor, Peking University, China
Dr. Joni Salminen

Dr. Joni Salminen

Associate Professor, University of Vaasa, Finland

Tools

Survey2Persona​

Survey2Persona​

Survey2Persona is a survey data analysis and visualization tool. It transforms numerical survey responses (e.g., Likert scale, Binary, or other categorical data) and associate demographic survey data into personas, a humanized representation of the underlying survey data presented as a believable person, containing picture, name, age, country, and other demographic attributes and information.​

AI-Human Interaction

Connections

ResearchPeopleTools
Employing large language mo…AI-Human InteractionSoon-gyo JungDr. Bernard JansenDr. Joni SalminenSurvey2Persona​