56. AI for UX Analysis: How Accurate Is It? (feat. Christian Holst & Jamie Holst, Baymard Institute)

As AI-powered tools flood the market promising quick evaluations and audits, the conversation zeroes in on a critical issue: the reliability of these tools. In this episode, co-hosts Therese Fessenden and NN/G VP Kate Moran sit down with Jamie Holst and Christian Holst, the co-founders of Baymard Institute, to examine the growing role of AI in UX analysis. The group discusses the risks of over-relying on AI—particularly for junior UX practitioners—and the deeper implications for professionalism in the field.

About the speakers:

• Christian Holst (Co-founder & Research Director, Baymard Institute)
• Jamie Holst (Co-founder & CTO, Baymard Institute)
• Kate Moran (VP, NN/G)

Links Referenced in the Episode:

• Try UX Ray for Free: https://baymard.com/product/ux-ray
• Read their article on AI accuracy: https://baymard.com/blog/ai-heuristic-evaluations

Related NN/G Courses:

• Accelerating Research with AI
• AI for Design Workflows
• Designing AI Experiences
• AI Product Strategy

Check out ALL of our courses at nngroup.com/learning

Related NN/G Articles:

• AI Hallucinations: What Designers Need to Know
• AI-Powered Tools for UX Research: Issues and Limitations
• AI as a UX Assistant
• AI Chatbots Discourage Error Checking