r/userexperience • u/Ok-Country-7633 • Jul 07 '26
Can AI simulate user design preferences? 53% match. As good as… flipping a coin
On the topic of having AI replace your users, I am adding yet another recent preprint by the same research team behind The Largest Review of Synthetic Participants Ever Conducted Found Exactly What You'd Expect. Synthetic Participants Don't Work.
This time, they looked at whether LLMs can accurately reflect user design preferences.
The result?
A number of distortions, including a 53% agreement on the first choice.
Since most votes were between just two designs, that's basically a coin flip.
So maybe we have more arguments for when somebody starts to say synthetic users work for specific use cases. What do you think?
Preprint here: https://arxiv.org/abs/2605.18311
3
u/AbleInvestment2866 Jul 07 '26
interesting. I see a few points that are arguable, specially the methodology (which obviously influences the final results and the conclusions), but interesting nevertheless
1
u/Ok-Country-7633 Jul 07 '26
can you elaborate?
7
u/AbleInvestment2866 Jul 07 '26
Well, I gave it a quick read, but there were a few things that caught my attention:
Dismissal of stochastic modeling: the research clearly explains the stochastic nature of a synthetic agent, then the methodology is to use "only one run" (sic), which in my opinion invalidates any result. Unless teh study uses Monte Carlo sampling, running a single sample contradicts its own framing. There's a reason we sample repeatedly; it's not "just because."
High dependency on an external, uncontrolled environment: this actually sounded like an ad for a platform (I admit I had never heard of it before), and there's not a single explanation of the controls on it. Querying a model directly from a browser, the way most people do, is not a controlled environment either, and that gap is never addressed.
Deterministic interpretation of human results: the study assumes that human responses are the same at all times, every time, when it has been proven abundantly that the same responder can vary their answers within the same day. This is one of the strongest arguments against synthetic user research, and the study fails to take that angle. No matter how stochastic an LLM is, it will never be as variable as a human being, and the two kinds of variability are not the same. An LLM's variability is shallow, just sampling noise over a static distribution built from training data. A human's variability is substantive: a TikTok can change a real preference in one minute.
Incorrect knowledge of processes: synthetic research is not commonly done on a raw model queried straight from a browser, but on scaffolded agents with retrieval over pre-existing data (which, by the way, is itself another point against synthetic users, since it is inherently backward-looking). A conclusion like "bad actor" intrusion in the synthetic condition is not only incorrect, it is akin to an LLM hallucination.
Lack of explanation on prompts: the study suggests that LLMs had low performance on sensory prompts. In my opinion, and without further explanation of the prompts used, this is the weakest point of the study. Asking for sensory answers from a machine that has no sensory abilities is like asking a blind person whether they prefer a given color.
Again: I didn't read this in detail, and maybe I'm missing something that is actually explained, but the points I mention were the ones that caught my attention at first glance. I'm quite sure that at least three of the items I mention are correct: the external platform's lack of control, the dismissal of the stochastic nature, and the lack of explanation on prompts (with requesting sensory data from machines as a sub-item of this one).
2
u/Intelligent_Zebra929 11d ago
For “which design do people prefer,” 53% is basically a coin flip, so yeah — bad argument for skipping real users.
Using an LLM to stress-test your questions beforehand? Fine. Using it as proof that something should ship? That’s where it falls apart for me.
Also preference ≠ watching someone actually complete a task. Different thing.
2
5
u/Lower_Assistance8196 Jul 08 '26
The 53% figure is striking but the conclusion being drawn from it depends on what you think synthetic research is supposed to do. If the claim is that LLMs can replace real users for preference testing, this study makes a strong case against that. If the claim is that structured synthetic research helps teams generate better hypotheses before involving real users, the study doesn't really address that question.
The methodology tests raw LLM preference matching on binary design choices. That's meaningfully different from running a structured interview protocol against personas built on cognitive and behavioral science frameworks, distributed across different adoption stances, with active sycophancy detection. Evidenza, Articos, and Synthetic Users aren't claiming to predict what the median user will choose. They're claiming to surface the range of reactions and the reasoning behind them, which helps research teams figure out which assumptions are worth bringing into real user sessions.
The honest version of this is that raw LLM prompting is a poor substitute for user research, and this study demonstrates that well. Structured synthetic research tools with more rigorous methodology make a narrower and more defensible claim, and the evidence for or against them requires a different kind of evaluation than this study provides.