The condensation on the heavy glass pitcher in the center of the conference room had formed a perfect, trembling ring on the mahogany veneer. I watched a single droplet track its way down the side, fighting gravity until it finally surrendered and pooled at the base. It was the only thing in the room that felt honest.
Around the table, the air smelled of stale espresso and the faint, ozone-heavy scent of a laser printer that had been working overtime to produce the thick stacks of paper sitting in front of each of us.
The hiring manager, a bright-eyed director named Sarah, was beaming. She tapped a highlighter against the top page of her folder. “Look at these scores,” she said, her voice carrying that specific kind of corporate triumph that usually precedes a disaster.
“On a scale of one to ten, she’s a nine on product knowledge, an eight-point-five on CRM fluency, and she nailed the mock discovery call. The rubric doesn’t lie. She’s the one.”
The Measurement Trap
I looked over at Marcus, the senior Customer Success Manager who would actually be responsible for mentoring this new hire. Marcus wasn’t looking at the scores. He was staring at the water pitcher, his jaw set in a way that suggested he was biting back a very long, very tired sentence.
He just nodded, a short, perfunctory movement of the chin. He knew what I knew: the rubric had measured everything that was easy to write down and nothing that actually mattered when the doors closed and the pressure climbed.
He was thinking about the Tuesday afternoon when our biggest client had realized their data migration had stalled, and their VP of Sales had spent shouting into a speakerphone.
He was thinking about the “unwritten” part of the job-the part where you have to decide, in the space of three seconds, whether to apologize, push back, or just be a human sponge for someone else’s panic.
The rubric had no row for “Ability to absorb professional rage without losing your own center.” There was no checkbox for “Knowing when a client’s silence means they’re thinking and when it means they’re looking for a competitor.”
We had spent interviewing candidates based on a scorecard that was, for all intents and purposes, a map of a different country.
This is the central paradox of the modern Customer Success hiring process. We have become obsessed with the “articulable”-the skills we can name, categorize, and rank on a scale of one to ten. But the actual work of retention and relationship management lives in the “tacit”-the knowledge that is felt, sensed, and performed, but almost never spoken aloud in an interview.
The Blower and the Blue Flame
It reminds me of a story about the early days of industrial steel production. In the , the Bessemer process changed everything, but for a long time, the quality of the steel depended entirely on one person: the “blower.”
This person had to watch the flames shooting out of the converter. They had to look for a very specific change in color-a transition from a brownish-red to a faint, fleeting blue-that signaled the carbon had been burned out.
The “Shimmer”: The fleeting blue flame that signaled perfect steel, a sight no manual could describe.
If you stopped too early, the steel was brittle. If you waited too long, you ruined the batch. There was no manual that could accurately describe that blue. There was no rubric for the “shimmer.”
You had to stand in the heat, breathe the soot, and learn the soul of the metal. If a factory owner tried to hire a blower based on a written test about thermodynamics, they’d end up with a yard full of scrap iron.
We are doing the same thing in SaaS today. We are hiring people who know the thermodynamics of the CRM, but they can’t see the blue in the flame. I’ve made this mistake myself. More than once.
I once hired a candidate who was, on paper, a deity of the industry. He had a 94% retention rate at his last stop and could talk about “Net Revenue Retention” with the cadence of a poet.
But in, he faced his first real friction-a client who didn’t want a “partnership,” they just wanted the software to work. He didn’t know how to handle the lack of a script. He was a master of the rubric, but he was illiterate in the language of reality.
Waving at the Wrong Person
I felt a similar pang of miscalibration just yesterday. I was walking down a crowded street and saw someone waving enthusiastically. I smiled and waved back with a flourish, only to realize a split second later that they were waving at someone three feet behind me.
That sudden, cold realization that you’ve misread the entire social landscape-that’s what it feels like to realize your “perfect” hire is actually a stranger to the role’s true demands. You’ve committed to a gesture that doesn’t fit the room.
The problem is that HR departments and hiring managers crave the safety of the scorecard. It provides an audit trail. If the hire fails, they can point to the document and say, “But look, they were a nine on product knowledge!” It’s a shield against the inherent risk of human judgment.
But Customer Success is, at its core, a role of high-stakes improvisation. You need to know the scales (the product, the process, the pricing), but the performance happens in the notes you choose to play when the client goes off-script.
The 81% Reality Gap
When we ignore the tacit skills, we systematically misjudge the role. We end up with a “competency gap” that is actually a “reality gap.” The scorecard says the candidate is ready, but the CSM on the floor knows they’re going to drown.
Rubric Skills
81%
Tacit Performance
The percentage of superstar performance accounted for by unwritten, tacit skills.
There are three specific “unwritten” skills that almost never make it onto a standard hiring rubric, yet they account for nearly 81% of the difference between a mediocre CSM and a superstar.
1. Product Intuition
This isn’t the same as product knowledge. Product knowledge is knowing where the buttons are. Product intuition is knowing why a customer is struggling with a specific workflow even when they can’t articulate it.
It’s the ability to see the “ghost in the machine”-the underlying frustration that drives a support ticket. A rubric can measure if you know the features; it can’t measure if you can feel the friction.
2. Internal Diplomacy
A CSM is often caught in the crossfire between a demanding client and a protective engineering team. The rubric might measure “communication skills,” but it rarely measures the ability to negotiate a bug fix with a developer who is already behind schedule.
That requires a specific kind of social capital that isn’t built on “competencies,” but on empathy and timing.
3. Strategic Silence
Most rubrics reward the talkers-the ones who can fill the air with value propositions. But the best CSMs know that the most important information often comes right after a long, uncomfortable pause. They know how to sit in the silence until the client finally admits the real reason they’re unhappy.
Guardians of the Rubric
The struggle is that these things are incredibly hard to interview for. You can’t ask, “How good are you at silence?” because everyone will say they’re great at it. You have to observe it. You have to create scenarios that are messy, unstructured, and deliberately frustrating.
This is where specialized help becomes a necessity rather than a luxury. Most generalist recruiters are trained to match keywords on a resume to keywords on a job description. They are the guardians of the rubric.
Organizations like
function differently because they understand that the resume is just the “explicit” layer.
They spend their time looking for the “tacit” signals-the evidence of relationship management skill and operational fluency that doesn’t always show up in a 9-out-of-10 score on a product quiz. They bridge the gap between what the scorecard wants to see and what the VP of Customer Success actually needs to survive the quarter.
“I tell them to just stand in the hearth and listen. The wind moving through a chimney sounds different if there’s a crack in the flue. You can’t put ‘sound of a crack’ on a government form, but if you don’t hear it, the house burns down.”
– Pierre A., Chimney Inspector
In the SaaS world, we are often so busy checking the “flue” for soot that we forget to listen to the wind. We hire people who can clean the chimney, but they don’t know the sound of a house that’s about to catch fire.
The Staggering Cost of Misalignment
The cost of this misalignment is staggering. It’s not just the cost of a “bad hire”-the roughly $21,400 to $62,000 lost in recruitment fees and onboarding time. It’s the hidden tax of the “mis-hire.”
Lower Bound Loss
Upper Bound Loss
It’s the frustrated CSMs who have to pick up the slack. It’s the clients who feel the handoff is clunky and start looking at the exit. It’s the slow, quiet erosion of trust between the hiring manager and the team on the floor.
When Marcus finally spoke in that meeting, he didn’t criticize the candidate’s scores. He just asked one question: “Sarah, what happens when this person has to tell the CEO of our largest account that the feature they were promised for Q3 is being pushed to next year?”
The room went quiet. Sarah looked at the rubric. There was no row for that. There was no score for “delivering devastating news while maintaining a partnership.”
“She has high empathy scores,” Sarah offered, though even she sounded unconvinced.
We ended up not hiring that candidate. It was a difficult decision because, on paper, we were “walking away from a winner.” But we realized we were actually walking away from a beautiful map that didn’t match the terrain.
Finding the Shimmer
We started changing our process after that. We stopped focusing on the 17 rows of the scorecard and started looking for the “shimmer” in the flame.
We started asking candidates to tell us about a time they were wrong-not a time they “overcame a challenge,” but a time they genuinely misread a situation and how they felt in the moment of realization. We looked for the people who could admit to waving at the wrong person on the street.
We need to stop assuming that because we can measure a skill, that skill is the one that drives the business. We have to be brave enough to admit that the most important parts of the job are the ones we haven’t found the words for yet.
The next time you’re sitting in a conference room, looking at a stack of “perfect” scores, take a moment to look at the water pitcher. Look at the condensation. Look at the things that are happening right in front of you that don’t have a row on your spreadsheet.
Because at 5 PM on a Friday, when the product is broken and the client is screaming, the rubric won’t be in the room. Only the person will be.
And if that person doesn’t know how to hear the wind in the chimney, all the product knowledge in the world won’t keep the house from burning.
Is your scorecard a tool for finding talent, or is it just a way to make sure you have someone to blame when things go wrong? Because if we aren’t measuring the “unwritten,” we aren’t really hiring for the job at all-we’re just hiring for the interview.