Startup fundamentals
Measuring product-market fit
Retention cohorts are behavioral truth. The Sean Ellis test is a leading survey proxy. Use both.
Andreessen's definition is a lagging description — by the time bankers are interested, you already have fit. You also need leading signals: retention curves, and a survey that asks how upset people would be to lose the product.
Feelings lie. Demand that outruns you is real, but you still need numbers so you do not declare victory on a good week.
Concept
Retention is whether users who arrived in a given period still use the product later. A cohort is that group, defined by when they started (for example, "users who signed up in March"). Flat or gently declining curves after an initial drop are a classic fit signal. Curves that fall to zero mean novelty, not a habit.
The big idea
Retention is what people do. A survey is what they say. Lock-in can look like retention without love. Courtesy can look like love without retention. If the two disagree, segment before you celebrate.
Walking through it
Watch cohort curves first: they should flatten above a usable floor after the initial drop. Rising organic or referral share, deeper usage among actives, and a shorter sales cycle at similar price help confirm. Later, net revenue retention matters. Caveats: the floor depends on category, founder-led sales inflate win rate, and vanity DAU without retention misleads.
The Sean Ellis test
Sean Ellis found a leading survey proxy after working growth at Dropbox, LogMeIn, and Eventbrite:
How would you feel if you could no longer use this product?
- Very disappointed
- Somewhat disappointed
- Not disappointed
Across many startups, companies where ≥40% of qualifying respondents said "very disappointed" tended to grow; those below struggled. Slack early on reportedly scored around 51% in one oft-cited sample.
Survey hygiene:
- Poll users who experienced the core product recently (Ellis often suggested at least twice in the last two weeks — adapt to your cadence)
- Do not poll one-time tire-kickers
- Around ~40 respondents can be directionally useful; more is better
- Segment: your best-fit customers may love you while the wrong segment dilutes the score
Superhuman's engine
Rahul Vohra turned Ellis's question into a continuous loop:
- Measure the "% very disappointed"
- Identify the high-expectation customer (who loves you and why)
- Double down on what fans love
- Fix the blockers that hold somewhat disappointed users back
- Resurvey; treat the score as a product KPI
Superhuman's public story: the score started around 22%, rose after segmenting to the right customer, and climbed to roughly 58% over later quarters. The method is disciplined listening with a numeric north star.
Example
You survey 80 users who used the core workflow at least twice in two weeks. Results: 28 very disappointed (35%), 40 somewhat, 12 not. Under 40%. Among "PMs at B2B SaaS companies, 50–500 employees," very-disappointed is 48%; among students on the free tier, 12%. Stop optimizing for students. Ship the three blockers PMs named (SSO, shared workspaces, export). Resurvey in six weeks.
Common mistakes
- Polling tire-kickers. One-time visitors dilute the score toward "not disappointed."
- Skipping segments. A blended 35% can hide a 48% beachhead.
- Trusting the survey alone. Retention without love can be lock-in. Love without retention can be courtesy.
- Treating 40% as a trophy. It is a threshold to keep retesting after pricing and ICP changes.
Check yourself
Your Ellis score is 35% blended and 48% in one ICP. What do you do?
Narrow to that ICP, fix the blockers those fans named, and stop optimizing for the segment at 12%.
Why is retention the tie-breaker when the survey looks great?
Surveys are stated preference. Retention is whether people actually come back.
Key takeaways
- Retention cohorts are behavioral truth. Ellis's "very disappointed" question is a leading proxy.
- The usual bar is ≥40% very disappointed among people who used the core product.
- Superhuman's loop: measure, find fans, double down, fix fence-sitter blockers, resurvey.
- Always segment. A blended miss can hide a beachhead.
Further learning
How Superhuman Built an Engine to Find Product/Market Fit (First Round Review)Superhuman founder and CEO Rahul Vohra walks us through the framework his startup used to make product/market fit more actionable, detailing the survey and four-step process that were key to measuring and optimizing it.First Round
How Superhuman built an engine to find product-market fitFinding product-market fit is an obsession for every startup. Superhuman CEO Rahul Vohra built an engine to find it — here's how...Superhuman Blog
Next: false positives.
Related
Product-market fit
What fit feels like, how to measure it, the false positives that fool teams, and what changes after you find it.
Retention and engagement
Retention curves, cohort analysis, DAU/MAU and why retention is the foundation of growth. Start here for the map.
SaaS metrics: ARR, churn and net retention
ARR and the bridge, bookings vs revenue, logo vs revenue churn, GRR, NRR, and the quick ratio.