We’ve all been in that soul-crushing meeting. You’re staring at a problem that needs a call today. The room is full of smart people who’ve been in the trenches for decades, and their collective gut is screaming, "Go left." Then someone in a crisp shirt clears their throat, pulls up a deck with 40 slides of inconclusive metrics, and says, "Look, the vibes are great, but we just don't have the statistical significance to make a move yet. Let’s set up a three-month multi-variant A/B test and re-evaluate next quarter."
And just like that, the momentum dies.
Somewhere between the dot-com boom and the modern era of hyper-connected, algorithmic everything, society went completely data-mad. We’ve built a culture that treats raw data like the ultimate arbiter of truth and views human intuition, the hard-earned, tacit experience living between our ears as an embarrassing relic of our superstitious past. We’ve drifted into a world where nobody wants to make a call unless there’s a dashboard backing them up, a 300-page peer-reviewed paper proving it, or the CEO directly gives it their blessing.
The result? Absolute gridlock. By demanding total, bulletproof evidence for every single decision, we’ve traded forward motion for a comfortable, defensible state of analysis paralysis.
Don't get it wrong: data is brilliant. It stopped us from leeching sick people and building bridges that collapse when the wind blows. But somewhere around 2010, when every app started tracking our micro-interactions and cloud storage became dirt cheap, we stopped using data as a tool and started using it as a shield.
Data-driven decision-making quickly morphed into data-covered cover-your-ass-making.
If you make a bold decision based on thirty years of hands-on experience and it flops, you get sacked for being reckless. But if you make a disastrous decision backed by a stack of spreadsheets, external consultant reports, and a p-value under 0.05? Well, "the data pointed us in that direction." You get a pass because you followed The Process.
This dynamic holds up progress everywhere:
To understand why this is so broken, you have to look at how human knowledge actually works.
Explicit knowledge is the easy stuff. It’s the data points, the documented procedures, the hard metrics, the stuff you can stick in a table or feed into a database. It's clean, legible, and easily shared. Because computers love explicit knowledge, our modern digital world worships it.
Implicit (or tacit) knowledge is the slippery stuff. It’s the subconscious pattern recognition an experienced mechanic uses when they hear a motor tick and just know the timing belt is shot. It’s the field-tested instinct a lead engineer has when a design "looks wrong" long before the simulation fails. You can’t easily put it into a slide deck or craft a robust decision tree that others can follow.
Michael Polanyi summed it up well when he wrote, "We can know more than we can tell."
When we demand absolute explicit evidence for every call, we effectively throw out the entire reservoir of implicit knowledge human beings have accumulated over millions of hours of real-world practice. We force ourselves to act like amnesiacs who can only trust what’s written on a piece of paper right in front of us.
Nobody is saying we should burn down the server farms (well, some are) and go back to reading tea leaves or relying entirely on the "hippo" (the Highest Paid Person's Opinion). A world governed purely by unchecked gut feelings gives us snake oil salesmen, bad policy, and catastrophic echo chambers.
The goal isn't to replace data with gut instinct. It’s to restore the delicate balance between them.
"Ultimately, we find ourselves caught between two extremes. Lean too far into data, and you fall into analysis paralysis, a state of stagnation where the fear of risk keeps you permanently pinned in place. Lean too far into pure gut feeling, and you slip into reckless gambling, blinded by hidden assumptions and snake oil. The sweet spot lives right in the middle: using your hard-earned tacit experience to set the direction, while letting data act as your guardrails for continuous action and verification."
In the real world, especially when stakes are high and time is short, intuition sets the vector, while data provides the guardrails.
Have we let the pendulum swing too far toward the illusion of absolute certainty? The modern obsession with requiring ironclad proof before taking a step hasn't made us smarter; it's just made us timid.
The biggest breakthroughs whether in tech, politics, or personal life rarely come from waiting until all the lights are green across the whole dashboard. They come from someone who knows their craft inside out, looks at an incomplete picture, and has the guts to say: "We don't have time to measure this to death. We move now, and we adjust as we go."
Data is a brilliant co-pilot, but it’s a terrible driver. It’s time we put human experience back in the steering seat.