Seeking to interview social scientists experimenting with LLM simulations of opinions or behavior

This is Jessica. As part of our interest in how social scientists are using LLM simulations of human behavior, some collaborators and I are seeking interview participants. We are thinking about tools to support rigorous design and evaluation of such studies, and would like to hear examples of goals and challenges that researchers who are experimenting with LLM simulations are facing.

Specifically, we’re looking for researchers in academia or industry who are currently using LLM simulations in their work and could bring a simulation dataset (and optionally, human ground truth data) that they are working with to the interview. We are interested in use cases like piloting surveys or experiments with LLMs, replacing or supplementing human participants in surveys or experiments with LLMs, or using LLM simulations for post-study analysis or theorizing. The interviews should take no more than 1 hr.

Email me and Xudong Tang (xudongtang2029@u.northwestern.edu) if interested, and/or pass this on if you know of social scientists who might be.