Skip to content
The Product Guys
All teardowns
RedditDiscovery6 min read

Ranking a crowd against itself

Two arrows, a time decay, and a sort menu that changes the site.

The surface
The subreddit and home listings, the vote arrows on posts and comments, and the sort controls including Hot, New, Top and comment sorts.
What the user wants
I want to see what is worth reading in this community right now, without wading through the rest.
01

Two arrows

Every post and comment carries an up and a down vote, available inline without opening anything.

Binary judgement at minimal cost

A five point scale asks people to calibrate, which is work and produces noisy results. A binary choice can be made in the time it takes to read a title, so participation is wide enough to be meaningful. A downvote also exists, which most platforms avoid, and it is what lets a listing actively bury things.

02

Time decay in the default sort

The default listing weighs score against submission age, so older posts fall even as their score rises.

Recency-weighted ranking

Pure score ranking freezes: the top post keeps accruing votes because it is on top, and nothing new can ever compete. Decay forces turnover, which is what makes a returning visitor find a different page. The ranking is designed to keep a market for attention open rather than to be correct.

03

The sort menu

Users can switch the same listing to New, Top over a chosen period, Rising, or Controversial.

Explicit control over the algorithm

Different jobs need different orderings, and no single ranking serves the person catching up, the person moderating and the person looking for the best of the year. Exposing the sort rather than inferring it treats the user as capable. It also makes the ranking legible, which is rare.

04

Comment sorting separately

Comment threads have their own sort, with Best as a default and Q&A, New and Controversial available, and threads are nested.

Separating two different ranking problems

A good post and a good comment are judged on different things, and a comment's value often depends on what it replies to. Nesting preserves that dependency, and a separate sort stops a slow, thoughtful reply from being invisible under an early joke. Most products reuse one ranking for both and lose the distinction.

05

Subreddits as the unit

Communities are separate spaces with their own rules, moderators and norms, and voting happens inside that context.

Contextual norms

What counts as a good post is not a global property, and a single site-wide feed would average incompatible standards into mush. Scoping the vote to a community lets each one define quality for itself. The moderation labour that makes this work is unpaid, which is the arrangement's real fragility.

06

Vote fuzzing and hidden scores

Displayed scores are approximate, and new comment scores are hidden for an initial period.

Breaking the information cascade

If early voters see a score, they tend to follow it, and the first few votes decide the outcome. Hiding the number for a window forces independent judgement while the ranking is still forming. Fuzzing separately makes vote manipulation harder to measure and therefore harder to sell.

Making the ranking arguable

1Pick a default with a stated ruleScore, decayed by age. Somebody candescribe it in a sentence.2Put the alternatives in reachNew, top, rising. One control, alwaysin the same place.3Sort the comments separatelyPeople want the thread ordereddifferently from the list that gotthem there.4Now the ranking can be argued withComplaints become about the rulerather than about the mood of themachine.
Any default ordering is a guess about why somebody arrived. Guessing is unavoidable; hiding the guess is not. Putting the sort in a menu turns a mysterious feed into a system people can disagree with, which is cheaper than being right.

What not to copy

  • Early votes still dominate despite fuzzing. A post's fate is largely set in the first minutes, which rewards timing and coordinated voting over quality.
  • Downvoting is nominally for irrelevance and is used for disagreement, which pushes minority positions out of visibility and makes threads more homogeneous than the community actually is.
  • The whole quality system rests on volunteer moderators with real power and no support, and the platform has repeatedly discovered how load-bearing that is only during disputes.
  • Controversial sort and decay together favour posts that provoke fast reaction, so the default page systematically overrepresents whatever is easiest to have an opinion about.

The takeaway

Expose the sort. Letting users choose the ranking is cheaper than guessing their intent and makes your system arguable instead of mysterious.

Finished the teardown? Bank it and the day counts toward your run.

Where the principles come from

  • Influence: The Psychology of Persuasion (social proof), Robert Cialdini
  • Governing the Commons, Elinor Ostrom
  • The Wisdom of Crowds, James Surowiecki
  • Information cascades and herding, Sushil Bikhchandani, David Hirshleifer and Ivo Welch

Written from public behaviour of the product, not from inside it. Interfaces change often, so treat the flow described here as of the time of writing and check the live product before quoting it.