What Are Vanity Metrics? How to Identify Them and Focus on What Matters
Vanity metrics are measurements that look impressive on a dashboard but don’t meaningfully indicate whether a product or business is actually succeeding. They are numbers that make teams feel good — large totals, growing graphs, impressive-sounding statistics — without providing actionable insight into whether the business is healthy or whether product decisions are creating real value.
The concept was popularized by Eric Ries in The Lean Startup as a warning to startups: the metrics most easily celebrated (total downloads, registered users, page views, social media followers) are often the least useful for understanding whether a product is actually working.
Examples of Vanity Metrics
Registered Users
Total registered users can be compelling — until you realize that many of those users signed up once, never returned, and generated zero value. Without knowing what percentage of registered users are active, engaged, and retained, total registrations tells you almost nothing about the product’s health.
App Downloads
Downloads measure the success of an app store listing and acquisition funnel, not the product’s value to users. An app with 1 million downloads and 2% day-7 retention is in far worse shape than one with 50,000 downloads and 60% day-7 retention.
Total Page Views
For content-heavy products or marketing sites, raw page views conflate valuable engagement (users finding the content they need) with low-value behavior (bots, accidental clicks, users who immediately bounced). Average session duration, conversion rate, and engaged sessions are more meaningful.
Social Media Followers
Follower count is a brand awareness signal, not a business performance metric. Followers who don’t click, convert, or engage produce no revenue and no product growth.
Email List Size
The size of a mailing list matters far less than the engagement rate. A list of 100,000 subscribers with 5% open rates produces less value than a list of 10,000 with 40% open rates.
How to Identify Vanity Metrics
A useful test from Eric Ries: ask whether the metric could tell you what to do next. If the answer is no — if a change in the metric doesn’t indicate a specific action to take — it’s likely a vanity metric.
More specifically, vanity metrics typically:
- Can’t be traced to a specific business outcome
- Always go up regardless of product quality (more time = more total users)
- Don’t segment in ways that reveal actionable differences
- Look impressive to outsiders but don’t inform internal decisions
What to Use Instead: Actionable Metrics
Actionable metrics are those that directly reflect meaningful business performance and connect to decisions the team can make:
Vanity → Actionable substitutions:
- Total users → Monthly active users (MAU) or Daily active users (DAU)
- Downloads → Day-7 and Day-30 retention rates
- Page views → Time on page, scroll depth, conversion rate
- Followers → Engagement rate, click-through rate, conversions from social
Building a Metrics Culture That Avoids Vanity
Focus on Rates and Ratios, Not Raw Totals
Raw totals almost always grow with time. Rates and ratios reveal whether quality is improving or declining as scale increases. Monthly churn rate is more informative than total churned users. Activation rate is more informative than total activated users.
Ask “So What?” Before Celebrating
When presenting a metric that looks good, ask: what does this tell us about what to do next? If the answer is “nothing specific,” the metric may not deserve prominent placement on the dashboard.
Align Metrics with Decisions
The metrics that deserve the most attention are the ones that most directly inform the team’s biggest current decisions. If the team is deciding whether to invest in improving onboarding, onboarding-related metrics should be front and center.
Key Takeaways
The antidote to vanity metrics is the discipline of asking what each metric is actually measuring and what decision it informs. Teams that build their measurement practices around actionable, outcome-relevant metrics make better product decisions, allocate resources more effectively, and avoid the trap of optimizing impressive-looking numbers while the underlying product health deteriorates.