Stack Overflow Podcast - Episode 22

Release Date: April 19, 2011
Hosts: Joel Spolsky & Jeff Atwood
Special Guest: Josh Millard (MetaFilter)

Episode Overview

In this episode, Joel and Jeff celebrate the public launch of Stack Overflow, reflect on the technical and community challenges of scaling the site, and host an extended, insightful conversation with Josh Millard from MetaFilter. The discussion dives deep into the design of social software, the value of community moderation, the importance of “meta” discussions, and the delicate balance between openness and maintaining quality.

Key Discussion Points & Insights

1. Stack Overflow’s Public Launch

[03:11] - [07:53]

• Surviving the Surge: Stack Overflow transitioned from private beta to public launch, experiencing a dramatic jump in site load and user engagement.

  • "The amazing thing to me is that the site is still up because I really wasn't sure." — Jeff Atwood [03:23]
  • Private beta peak: ~8,500 questions in 6 weeks; On public launch day: 1,500 questions, 6,000 answers, 1,700 comments, 62,000 unique visitors, nearly 700,000 page views.

• Scaling Worries & Reality:

  • Early concerns about questions getting 'buried' too quickly due to increased traffic.
  • "Even though a question lives less time on the homepage, it's still seen by about the same number of people." — Joel Spolsky [06:20]

• Maintaining Quality:

  • The risk of “Eternal September,” but both Joel and Jeff argue that openness brings advantages, particularly addressing niche questions through a broader, more inclusive user base.

2. Comparing Community Models: Stack Overflow vs. MetaFilter

Entry Barriers & Community Health

[10:08] - [11:19], [34:24] - [34:27]

• MetaFilter’s $5 Fee: A minimal financial barrier deemed to improve participation quality.

  • "It's a speed bump"—just enough friction to deter trolls and spam. — Josh Millard [34:24]

• Stack Overflow’s OpenID Requirement:

  • "It’s about $5 of headache… it’s a minimal barrier." — Joel Spolsky [10:14]
  • Some gripe about friction, but hosts argue OpenID is better than having “thousands of logins across thousands of sites.”

Programming Focus and Tagging Approach

[12:36] - [17:31]

• Stack Overflow aims to be technology-agnostic. Issues with non-programming questions and inadvertent technology bias are addressed.
  • "We’re not saying this is a place to discuss Windows programming, this is just a place to discuss programming, period." — Jeff Atwood [13:10]
  • Tagging enables breadth without the constraints of traditional forum hierarchies.

3. Insights from MetaFilter: Social Dynamics & Moderation Practices

[20:40] - [60:57]

How MetaFilter Works: Open Structure with “Ask MetaFilter”

• "It’s a community weblog... collaborative blogging site...Anyone in the user base can make a post." — Josh Millard [20:40]
• MetaFilter introduced “Ask MetaFilter,” a heavily used Q&A component.

Discussing the Platform on the Platform: “Meta” Spaces

[26:37] - [29:36]

• MetaFilter established “MetaTalk,” a dedicated space for discussing site operations and policies—crucial as a community release valve.

  • "MetaTalk is key to the success of the site because it creates a sort of release valve…" — Josh Millard [27:45]

• Contrast with Stack Overflow’s reluctance to “talk about the site on the site.”

  • "You begin leaving breadcrumbs about Stack Overflow, and I do not feel like… that's ultimately helpful to programmers." — Jeff Atwood [31:19]
  • But recognition that highly engaged users ("star users") need somewhere for these meta discussions.

Voting, Moderation, and Community Policing

[33:15] - [39:57], [47:11] - [51:52]

• MetaFilter: “Favorites” (akin to upvotes) and invisible “flag” system for moderator review.

  • "Flag system is kind of like a downvote but functions differently—they’re not visible." — Josh Millard [47:31]
  • Stack Overflow made an early mistake displaying flag counts publicly.

• Dealing with spam, abuse, and problematic users:

  • "At this point, we get an email every time someone makes their first post, tells us about it, we check it out…" — Josh Millard [34:39]
  • The $5 fee plus community norms succeed in filtering out most problems.

4. Maintaining Quality & Handling Growth

Scaling Challenges & Community Health

[53:46] - [56:02]

• Scaling up moderation is mainly workload; MetaFilter limits ambitions for mass growth to keep community manageable.
  • "We're not trying to turn this into something that's going to scale to a million users." — Josh Millard [55:20]
  • Stack Overflow also wary of scaling moderation (“my life sort of ends” at 100+ support emails a day).

Keeping it Civil: Respect, Trust & Private Warnings

[57:17] - [59:02]

• Emphasis on separating the content from the user—flag the action, not the person.

  • "You’re separating the person from their actions, which I think is probably the right solution." — Jeff Atwood [57:17]

• Strong distaste for "public shaming" as a moderation tool.

  • "You gotta take the high road, period, which is hard to do." — Josh Millard [59:02]

Notable Quotes & Memorable Moments

• "The amazing thing to me is that the site is still up because I really wasn't sure..." — Jeff Atwood [03:23]

• "We have our own $5 barrier. It's called OpenID." — Joel Spolsky [10:05]

• "One of my favorite threads...was somebody complaining about OpenID and then the highest voted answer was... ‘I'm a VB programmer for 16 years, I was able to sign up for this site.’" — Jeff Atwood [10:19]

• "MetaTalk is one of the things mentioned as key to the success of MetaFilter, because it creates a sort of release valve." — Josh Millard [27:45]

• "If people don't like content that's on there, they will vote it down... Nobody has to step in and really do anything other than vote." — Jeff Atwood [34:03]

• "We mostly let people do their own thing... There's a fair amount of community policing." — Josh Millard [34:39]

• "I like that it's about community. I believe deeply in the community. But obviously, there's a scale issue..." — Jeff Atwood [54:49]

• "We're not trying to turn this into something that's going to scale to a million users. I can't imagine what that MetaFilter would look like." — Josh Millard [55:20]

• "You gotta have that mutual respect all around, which means you don't have people in charge, you know, treating users—even jerky users—like crap." — Josh Millard [57:41]

• "I've always been worried about that because actually I have the exact same problem, which is... a lot of the people that are really, really good don't think they're that good." — Joel Spolsky [60:18]

Timestamps for Key Segments

• Office move-backstage banter: [01:01] – [03:11]
• Stack Overflow public launch, site metrics: [03:11] – [05:27]
• Scaling, “Eternal September,” and audience quality: [05:27] – [10:05]
• MetaFilter intro & comparing community models: [10:05] – [20:40]
• Josh Millard on MetaFilter’s history, moderation, & success factors: [20:40] – [26:37]
• Meta discussions (“MetaTalk”), meta on Stack Overflow: [26:37] – [32:04]
• Site voting, moderation, and spam/abuse handling: [33:15] – [39:57]
• MetaFilter fav/flag mechanics and community policing: [47:11] – [51:52]
• Scaling and user management challenges: [53:46] – [56:02]
• On respect, private warnings, and public shaming: [57:17] – [59:02]
• New user anxiety and self-filtering (MetaFilter, Stack Overflow, and jobs): [59:41] – [60:57]

Takeaways & Reflections

• Balance Barriers and Openness: Minimal entry barriers (like MetaFilter's $5 fee or OpenID) can meaningfully improve content quality without employing heavy-handed gatekeeping.
• Meta Discussions are Vital: Having a dedicated “meta” space for policy and self-reflection is crucial in communities to separate noise from core content, empower engaged users, and relieve pressure from main channels.
• Community-First Moderation: Empower users to shape interactions (“vote it down”), reserve moderation for clearly egregious cases, and always strive to treat users with respect—even when they cross the line.
• Mindful Scaling: Recognize the challenges in scaling community moderation; automation and distributed trust (through voting/flagging) help, but some human touch is always needed for a healthy ecosystem.
• Quality as Practice: Both platforms strive for high-quality contributions—not by restricting participation, but by cultivating norms where users organically filter and improve content.

Final Thoughts

The dialogue between the Stack Overflow and MetaFilter crews offers a rare, honest glimpse into the messiness of building lasting, positive online communities—their strengths, persistent challenges, and the human values underpinning technical design. Whether through transparent meta channels, light-touch barriers, or relentless focus on mutual respect, the message is clear: social software succeeds when it puts people—and their collective wisdom—at its core.