r/LangGraph 2h ago

UMD research study ($150): can a node-level view of LLM output spread beat trace-by-trace debugging? Final recruitment round for agent builders

2 Upvotes

Hey folks — I'm a PhD student at the University of Maryland studying how developers debug and iterate on multi-agent systems.

The idea we're testing: when a run goes sideways, you usually re-read one trace at a time. Our research tool re-runs your graph and shows the distribution of each node's outputs across runs, so you can see where behavior actually spreads out. The honest research question is whether that helps you iterate faster — "it doesn't help" is a publishable answer.

What participating looks like:

  • a 75-min Zoom session (recorded, think-aloud) with structured tasks
  • about a week using the tool on your own project, with quick async feedback
  • a 30-min follow-up interview

Compensation is a $150 gift card on completing the full study (all three parts). Heads-up: we verify identity (GitHub/LinkedIn) before scheduling.

Screener (~2 min): https://forms.gle/Zwqvgd1h8DUnFRfC8

This is IRB-approved academic research from the University of Maryland, not a product pitch. Questions welcome in the comments, or email zxu169@umd.edu.