The Superpowers and Shadows of A/B Testing: Balancing Data-Driven Success with Bold Innovation
The Superpowers and Shadows of A/B Testing: Balancing Data-Driven Success with Bold Innovation
20 May, 11:55 - 12:30 (Europe/Berlin) - Main Stage
20 May, 09:55 - 10:30 (UTC)
A/B testing has become a superpower in product development, enabling data-driven decisions that fuel business growth. But with great power comes a shadow: an over-reliance on testing can lead to incremental tweaks over bold, groundbreaking moves. This talk sheds light on both the superpowers and the shadows of A/B testing, exploring the risks of a test-heavy culture and how it can stifle creativity and big-picture thinking. Discover practical strategies to balance optimization with innovation, fostering a culture that leverages testing without losing sight of visionary product development.
- Harnessing the super powers of A/B testing to make revenue generating business decisions
- Recognizing the limitations of A/B testing and the risks of focusing solely on incremental improvements
- Identifying the “shadow side” of a testing culture on stifling creativity and broader strategic thinking
- How to balance rigorous testing processes without sacrificing creative exploration for breakthrough developments
- Practical steps to push beyond data dependency, fostering a mindset of experimentation that leads to transformative product outcomes.

Ryan Leffel, Head of Design,Priceline