Contacts
Info
Outperform is a show dedicated to helping your business unlock its full potential through data-driven decision-making and experimentation. Every episode is packed with innovative strategies and practical insights designed to...
show more
Outperform is a show dedicated to helping your business unlock its full potential through data-driven decision-making and experimentation. Every episode is packed with innovative strategies and practical insights designed to equip and inspire data scientists, marketers, and engineers alike.
We're exploring topics ranging from A/B testing and machine learning to creating a culture of experimentation within your organization.
Discover how businesses win by driving innovation and better decision-making!
show less
We're exploring topics ranging from A/B testing and machine learning to creating a culture of experimentation within your organization.
Discover how businesses win by driving innovation and better decision-making!
Episodes & Posts
Episodes
Posts
23 JUL 2026 · What separates experimentation programs that become strategic advantages from those that never make it beyond a handful of A/B tests? According to Lucia van den Brink, it starts with ownership.
As founder of The Initial, Lucia helps companies build experimentation programs from the ground up but unlike most agencies, her goal isn't to become a permanent partner. Instead, she works to create internal capabilities, establish experimentation culture, and leave organizations with self-sufficient teams that can continue growing long after her engagement ends.
In this episode, Lucia joins host Ryan Lucht to discuss why experimentation is about much more than finding winning tests. She explains how organizations can build momentum through early wins, develop internal champions, avoid getting stuck on tool selection, and create a culture where data—not hierarchy—drives better decisions.
In this episode, we discuss:
- Why experimentation should become an internal capability instead of an outsourced function
- How to build an experimentation culture through early wins, internal champions, and organizational buy-in
- Why companies often overthink experimentation tools—and underestimate the importance of simply running experiments
- The biggest mistakes organizations make when launching experimentation programs, including chasing velocity at the expense of learning
18 MAR 2026 · Why does one of the world’s leading business podcasts (and media companies) employ a full-time Head of Experimentation and Failure?Ask Grace Miller, who holds the title at FLIGHTSTORY, the company behind The Diary of a CEO. On today’s episode, Grace shares how her team built an experimentation engine to drive growth across podcasts, product, paid media, and marketing.Grace shares how her work spans the entire business - from optimizing things like add-to-cart placement and email design, to podcast-specific experiments like trailer hooks, audience retention, ad placement, and YouTube thumbnails. She also discusses how FLIGHTSTORY takes experimentation offline through live events and community dinners to strengthen the audience bond. If you want to understand how modern media companies test, learn, and grow faster, this episode offers a behind-the-scenes look at experimentation in action.In this episode, we discuss:
- Why FLIGHTSTORY built a culture around experimentation and why failure is part of the process
- How testing small changes (like podcast hooks, thumbnails, and ad placement) can significantly impact audience growth
- What it takes to build an experimentation engine across podcasts, product, marketing, and paid media
- How live events and community experiences help strengthen audience connection beyond digital channels
19 DEC 2024 · What’s next for experimentation in 2025? We’re breaking down insights from the biggest names in tech—Netflix, Amazon, Meta, and more.
Fresh from top experimentation conferences, we’ve identified three major trends set to shape the future of experimentation.
In this Episode:
- Shifting toward self-serve capabilities for less-technical end users
- The rise of automated "set it and forget it" experiments
- Rethinking statistical guidelines to accelerate innovation
Connect with us:
Ryan on https://www.linkedin.com/in/ryanlucht/
Chetan onhttps://www.linkedin.com/in/chetanvsharma/
26 NOV 2024 · Eppo Head of Product Eric Metelka took to the stage in San Francisco at the 2024 Lenny & Friends Summit to share some big insights on where product teams are making mistakes in their experimentation programs.
Drawing on case studies from industry leaders like Netflix, MSN and Booking.com, Eric explores how to rebuild trust in your data, accelerate experiment velocity, and foster a culture that thrives on bold, high-impact innovation.
In this Episode:
- Discover how rigorous science ensures reliable results and builds trust with stakeholders.
- Learn the secret to running faster, more impactful experiments using self-service tools.
- Explore why bold changes drive growth—and how to manage risks with guardrails.
12 NOV 2024 · Data-driven is the buzzword of the day—but what are the strategies that separate top-tier, data-driven companies from the rest? From chaotic, one-off tests to fully automated systems, we share the four stages that drive scalable growth, speed up learning, and make decision-making a breeze.
In this episode, Lukas Goetz-Weiss, joins Ryan Lucht to explore each maturity stage, the common roadblocks, and the practical steps any business can take to level up.
In this Episode:
- Why most companies start with isolated, intuition-driven tests and the pitfalls of this chaotic approach.
- Why companies gain structure but struggle with resource bottlenecks and decision-making delays.
- How to build trust in experiment results, empower teams, and avoid pitfalls like p-hacking and underpowered tests.
- Examples of companies that turn experimentation into a seamless, strategic advantage.
29 OCT 2024 · "When in doubt, test it out!"
In today's episode of Outperform, we uncover why the best teams thrive on a culture of testing everything— powerful metrics like segment-level differences and the dynamic balance between best practices and bold experiments, showcasing why both small tweaks and big swings matter. Plus, how a well-balanced experiment portfolio and savvy management can supercharge your path to strategic innovation!
In this Episode:
- Discover five unconventional methods for generating powerful A/B test hypotheses.
- Learn how to harness historical company insights, customer feedback, and UX best practices to drive impactful business outcomes.
- Explore the significance of a balanced experimentation portfolio, blending big and small bets to effectively transform your business and maintain a competitive edge.
16 OCT 2024 · The power of experimentation is never clearer than when small changes spark massive breakthroughs. But how do you get your teams convinced to start testing many small changes in the first place?
We explore some common roadblocks that stand in the way of world-class cultures of experimentation. Ryan, Che, and Sven share insider insights from companies like Airbnb and Stitch Fix to give you actionable ideas and strategies in building your own experimentation program - and career.
In this Episode:
- Taking calculated risks and consistently experimenting are key to achieving breakthroughs and driving success.
- Standardizing processes and metrics minimizes friction, making it easier for teams to run experiments independently.
- Leadership is essential in building a culture of experimentation, where successes are celebrated and failures are seen as valuable learning opportunities.
24 SEP 2024 · AI is evolving at lightning speed - the shift from custom-built models to pre-trained large language models (LLMs) is driving rapid adoption from businesses.
But how do we know if all these models are actually driving positive business outcomes? As the New York Times put it, “AI has a measurement problem”.
In this Episode:
- Why most current AI model evaluation methods fall short
- How to truly measure AI effectiveness with real-world data and experimentation
9 SEP 2024 · Imagine a world where your AB tests run themselves—faster, smarter, and more dynamic than a simple 50/50 split that takes weeks to measure.
Today’s episode breaks down how multi-armed bandit algorithms could change when and where you use AB testing. But don’t be fooled—there are no free lunches and no cure-alls.. We’ll show you why understanding your use case, keeping the stakes low, and having human oversight are the keys to getting the most out of these powerful algorithms.
In this Episode:
- The potential of multi-armed bandit algorithms to supplant traditional AB testing
- Critically assessing the limitations and complexities involved in applying bandit algorithms to real-world data and marketing contexts.
- The role of these algorithms in personalizing customer interactions and automating low-risk experiments.
Outperform is a show dedicated to helping your business unlock its full potential through data-driven decision-making and experimentation. Every episode is packed with innovative strategies and practical insights designed to...
show more
Outperform is a show dedicated to helping your business unlock its full potential through data-driven decision-making and experimentation. Every episode is packed with innovative strategies and practical insights designed to equip and inspire data scientists, marketers, and engineers alike.
We're exploring topics ranging from A/B testing and machine learning to creating a culture of experimentation within your organization.
Discover how businesses win by driving innovation and better decision-making!
show less
We're exploring topics ranging from A/B testing and machine learning to creating a culture of experimentation within your organization.
Discover how businesses win by driving innovation and better decision-making!
Information
| Author | Sweet Fish |
| Organization | Sweet Fish |
| Categories | Technology , Marketing , Business |
| Website | - |
| ryan@geteppo.com |
Copyright 2026 - Spreaker Inc. an iHeartMedia Company
