September 23
9:00a - 5:00p ET
Location TBD
Llewyn Paine
Strategy Consultant
AI is rapidly changing how teams conduct UX research–but most practitioners still lack a reliable way to determine where AI improves business outcomes and where it introduces too much risk.
In this workshop, you'll use transparent, custom-built AI research tools to observe exactly how AI impacts research data and business decisions. Through hands-on experimentation, grounded in academic research and controlled testing, you'll gain an accurate understanding of AI's capabilities and failure modes for common research approaches.
You'll leave with a framework for evaluating AI research tools and evidence-based best practices for making informed trade-offs between AI and traditional methods.
People who conduct UX research (user researchers, market researchers, designers, product managers, etc.)
Familiarity with fundamental UX research methods (interviews, usability tests, surveys, qualitative data analysis) No prior familiarity with AI is assumed. All tools will be provided.
Learn evidence-based best practices for applying AI in UX research
Understand how common AI research tools work at a technical level, and how this impacts your data
Apply a framework to evaluate AI capabilities in the context of UX research, even as the tools change
Get hands-on experience with the technology, working directly with the latest models and AI agents that major commercial research tools are built on
Warm-up: AI + UXR hopes and concerns
Approaching UXR as Jobs To Be Done for stakeholders
Introduce a framework for thinking about AI augmentation of UXR
Understand the “main jobs” of UXR
Large Language Model (LLM) foundations for UXR
Why you should understand LLMs even if you’re using commercial AI tools
Review LLM fundamentals
Practice and evaluate: LLMs for qualitative analysis
Introduce key considerations when using LLMs for qualitative analysis
Practice qualitative analysis with a long-context LLM
Discuss how to optimize for stakeholder needs
Practice and evaluate: AI-moderated interviewing
Introduce AI moderation tool
Practice creating and participating in an AI-moderated interview
Review evidence-based best practices
Test a web interface with an AI agent
Discuss the emergence of agents in the context of UXR JTBD
Introduce “Agent Experience”
Practice conducting a usability test for an AI agent
Extending the framework to other AI UXR tools (time permitting)
Introduce AI tools and trends not previously discussed
Create your own AI validation plan using the JTBD framework
Wrap-up