How to Measure AI-Powered Experiences

Teams are rapidly introducing AI features but there is still no established way to measure whether those experiences are accurate, understandable and worthy of users’ trust. Traditional UX metrics alone may not capture what happens when outputs are generated by AI and can change from one interaction to the next. In this hands-on workshop you’ll learn how to build a practical measurement framework for AI-powered experiences. Using DocuSign’s evolving UX Scorecard approach you’ll explore how to define and apply metrics across trust, transparency and the accuracy of AI outputs. You’ll work with others to evaluate a realistic AI use case before applying the approach to your own product or experience. You’ll leave with a practical starting point that your team can adapt as its AI capabilities and measurement maturity develop. By the end of the workshop you’ll be able to:

• Identify where traditional UX metrics fall short when evaluating AI-powered experiences
• Define meaningful measures of trust, transparency and output accuracy
• Build a practical scorecard for evaluating an AI feature or user journey
• Adapt the approach to your own product, users and organizational context
• Use measurement findings to guide research, product decisions and improvements to the experience