Episode
15

Eoin O'Mahony on Why Good Metrics Still Lead to Bad Decisions — and How to Fix It

Eoin O'Mahony—data science partner at Lightspeed, former Uber science lead, and one of the early architects of the system that kept NYC’s Citi Bikes available across the city—argues that positive metrics are meaningless if you don’t understand the mechanism behind them. At Uber, he was careful to make sure his launches both looked good on paper and made sense in practice. Now in venture, he’s applying that same rigor to unstructured data—using GenAI to scale a kind of work that’s long resisted systematization.
June 19, 2025
Listen on
spotify logoApple podcast logo
Guest
Eoin O'Mahony

Lightspeed Ventures

,

Eoin O'Mahony is Partner, Data Science at Lightspeed, where he’s focused on building a strong internal data engine to support data-driven decision-making across the firm. He spent eight years working in applied science at Uber, where he built and led high-performing science teams. Before that, at Citi Bike, he used applied analytics, machine learning, and optimization to solve real-world transportation problems in New York City. Eoin holds a PhD and M.S. in Computer Science from Cornell University and a BSc in Computer Science from University College Cork. His technical background is helping make data a core pillar of how Lightspeed operates.

‍

Originally from a small town in the Irish countryside—where everyone knew their neighbors—Eoin brings that same sense of warmth, community, and willingness to help to the tight-knit world of venture capital. “The broader VC industry is going through an inflection point in terms of how it leverages data,” Eoin says. “I want Lightspeed to be setting the standard and shaping the direction the industry is taking.” Outside of work, Eoin enjoys exploring new restaurants with his wife and two young kids. He also loves reading and cooking—two hobbies he says sharpen his execution mindset: “When something’s worth doing, it’s worth doing well.”

HOST
Hugo Bowne-Anderson

Delphina

Hugo Bowne-Anderson is an independent data and AI consultant with extensive experience in the tech industry. He is the host of the industry podcast Vanishing Gradients, a podcast exploring developments in data science and AI. Previously, Hugo served as Head of Developer Relations at Outerbounds and held roles at Coiled and DataCamp, where his work in data science education reached over 3 million learners. He has taught at Yale University, Cold Spring Harbor Laboratory, and conferences like SciPy and PyCon, and is a passionate advocate for democratizing data skills and open-source tools.

Key Quotes

Key Takeaways

1. Positive Metrics Can Mislead — Mechanism Matters More

Eoin blocked product launches at Uber when teams couldn’t explain why a metric had improved. Without a clear causal explanation, those “wins” often turned out to be losses.

2. Early-Stage Products Don’t Need A/B Tests — They Need Impact

For new products, Eoin didn’t bother with small-effect experiments. If a change didn’t create a visible spike in time series data, it wasn’t worth pursuing.

3. Simple Algorithms Win in the Real World

At Citi Bike, Eoin scrapped complex optimization for plain, actionable routing instructions that teams could follow. He optimized for execution, not elegance.

4. Complex Systems Break Simple Assumptions

Marketplace dynamics often invalidate basic experimentation. Eoin shows how network effects, time lags, and interactions can make even clean A/B tests misleading.

5. GenAI Might Finally Scale Judgment Work in VC

At Lightspeed, Eoin is building tooling to extract signal from unstructured data — applying scientific rigor in a domain that’s long resisted systematization.

‍

‍

You can read the full transcript here.

‍

00:00 Positive Metrics Can Mislead — Mechanism Matters More

03:18 Eoin's Journey with Citi Bike

05:56 Challenges and Solutions at Citi Bike

14:05 Uber: From Two Wheels to Four

19:47 Navigating the COVID-19 Crisis at Uber

26:21 Transition to Venture Capital at Lightspeed

28:05 Joining Lightspeed: A New Opportunity

29:19 Exciting Projects at Lightspeed

30:08 Exploring Generative AI Tools

31:27 The Rapid Evolution of AI

37:01 Leveraging AI in Venture Capital

41:41 Future of AI and Personal Insights

52:29 Predictions and Closing Thoughts

Links From The Show

‍

Transcript

featured

In the spotlight: Our most popular episodes

Episode
15

Eoin O'Mahony on Why Good Metrics Still Lead to Bad Decisions — and How to Fix It

Eoin O'Mahony—data science partner at Lightspeed, former Uber science lead, and one of the early architects of the system that kept NYC’s Citi Bikes available across the city—argues that positive metrics are meaningless if you don’t understand the mechanism behind them. At Uber, he was careful to make sure his launches both looked good on paper and made sense in practice. Now in venture, he’s applying that same rigor to unstructured data—using GenAI to scale a kind of work that’s long resisted systematization.

With
Eoin O'Mahony
Partner, Data Science
,
Lightspeed Ventures
Play episode
Episode
10

Ari Kaplan on Why AI Won't Save You But Data Intelligence Will

Ari Kaplan—Global Head of Evangelism at Databricks and a pioneer in sports analytics—explains why businesses fixated on AI often overlook the real advantage: making better decisions with their own data. He shares lessons from his work building analytics teams for Major League Baseball, advising McLaren’s F1 strategy, and helping companies apply AI where it actually works—without falling into hype-driven traps.
With
Ari Kaplan
Global Head of Evangelism
,
Databricks
Episode
5

Gabriel Weintraub on The Hard Truth About Building AI Systems and What Most Leaders Miss About AI

In this episode of High Signal, Gabriel Weintraub (the Amman Professor of Operations, Information, and Technology at Stanford Graduate School of Business), brings his expertise in market design, data science, and operations, enriched by his experience with global platforms like Uber and Mercado Libre, to a conversation that spans practical strategies, cultural insights, and global perspectives on data and AI.
With
Gabriel Weintraub
Amman Mineral Professor of Operations, Information & Technology
,
Stanford Graduate School of Business
most recent

Listen up: Our latest discussions

Hear the hottest takes on data science and AI.

See all episodes
Episode
18

Sudarshan Seshadri on High-Stakes AI Systems and the Cost of Getting It Wrong

Sudarshan Seshadri—VP of AI, Data Science, and Foundations Engineering at Alto Pharmacy—joins us to explore what it takes to build high-stakes AI systems that people can actually trust. He shares lessons from deploying machine learning and LLMs in healthcare, where speed, safety, and uncertainty must be carefully balanced. We talk about designing AI to support pharmacist judgment, the shift from bottlenecks to decision backbones, and why great data leaders are really architects of how irreversible decisions get made.
With
Sudarshan Seshadri
VP of AI, Data Science and Foundations Engineering
,
Alto Pharmacy
Episode
17

Roberto Medri on The Incentive Problem in Shipping AI Products — and How to Change It

Roberto Medri, VP of Data Science at Instagram, explains why most experiments fail, how misaligned incentives warp product development, and what it takes to drive real impact with data science. He shares what teams get wrong about launches, why ego gets in the way of learning, and how Instagram turned Reels from a struggling product into a global success. A candid look at product, data, and decision-making inside one of the world’s most influential platforms.
With
Roberto Medri
VP, Data Science
,
Meta
Episode
16

Fei-Fei Li on How Human-Centered AI Actually Gets Built

Fei-Fei Li—co-director of Stanford’s Human-Centered AI Institute and one of the most respected voices in the field—reflects on AI’s evolution from the early days of ImageNet to the rise of foundation models. She explains why spatial intelligence may be the next major shift, how human-centered design applies in practice, and why AI should be understood as a civilizational technology—one that shapes individuals, communities, and society at large.
With
Fei-Fei Li
Sequoia Professor in the Computer Science Department at Stanford University, and a Founding Co-Director of Stanford’s Human-Centered AI Institute
,
Stanford University

Get the latest episodes in your inbox

Never miss an episode of High Signal by signing up for the Delphina newsletter.

By clicking Sign Up you're confirming that you agree with our Terms and Conditions.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.