← Knowledge Notes
Global Growth / Knowledge note · English

GSC Blog 2005-2010: The Infrastructure Era (Birth of Webmaster Tools / Sitemap Protocol / Early Spam)

The first 6 years of the Google Search Central Blog (2005–2010, ~708 posts): launch and maintenance of the Webmaster Tools platform / evolution of the Sitemap 0.84–0.90 protocol / early spam governance / badware/StopBadware security partnership / start of the Matt Cutts video series / the Vanessa Fox era / launch of the Canonical link element (2009) / international blog branches / first malware warnings / the link economy war (major paid links debate 2007–2008) / duplicate content myth education / first edition of the SEO Starter Guide (2008) / Caffeine indexing architecture (2010) / Site Speed becomes a ranking signal (2010)

Source collection:Google Search and SEO · Published here:2026-09-26

SEOSearch EnginesOrganic growth

This covers the birth and first 6 years of the Google Search Central (formerly Webmaster Central / Google Webmaster Blog) blog.Approximately 708 English posts(of which ~190 have zh-cn translations; most translations only began after 2008).Core themes: Webmaster Tools (2005–), Sitemap protocol (2005), the badware war (2006–), duplicate content (2008), Caffeine indexing (2010).Writing style: Early contributors including Vanessa Fox, Matt Cutts, Susan Moskwa and other founding members. Matt Cutts' video series gained momentum starting in late 2009.


2005 — The Sitemap Era Begins (32 posts)

Origins: On 2005-08-09 Google launched Google Sitemaps(later expanded into Webmaster Tools). Earliest post:Just getting started...(2005-08, public announcement)

Main topics

  • Early Sitemap protocol: What URLs should be included / Sitemap Index Files / Mobile Sitemaps (very early!) / Sitemap Generator (v1.3 changed encoding) / multiple Sitemaps in the same directory / cross-domain Sitemaps
  • Site Verification system: Lowercase filenames / verifying in subdirectories / DNS verification (added later)
  • Query stats: More stats! / More query stats (early prototype of Search Console)
  • Multilingual expansion: Japanese support (November) / More language support (2006-01)
  • Key early Q&A:www vs non-www versions(2005-12)/ Changing domains(2005-11)

2006 — Webmaster Tools Renamed + Spam Governance (83 posts)

Renaming event:2006-08 "Webmaster Central" officially replaced the name "Google Sitemaps" — marking the expansion into broader webmaster tools beyond just sitemaps.

Key milestones

  • 2006-04: Better details about when Googlebot last visited / Yahoo! Merchants get Sitemaps(signaling the first signs of cross-search-engine protocol unification)
  • 2006-06: site: major discussion of operator misunderstandings — multiple posts (Issues with site: operator, Another update on site:)
  • 2006-07: More control over page snippets + More control over titles too — first snippet control announcements
  • 2006-08: "All About Googlebot" + official introduction to webmaster rearrangement
  • 2006-09: Setting the preferred domain launch
  • 2006-09: How to verify Googlebot(reverse DNS check process finalized, still in use today)
  • 2006-10: Multiple Sitemaps in the same directory + Update to our webmaster guidelines(policy update)
  • 2006-11: Badware alerts for your sites(first launch of security warning notifications)+ Introducing Sitemaps for Google News(News sitemap is born)
  • 2006-11: Joint support for the Sitemap Protocol(0.90 cross-engine unified protocol announced)
  • 2006-12: Deftly dealing with duplicate content — classic duplicate content myth-busting post (cited repeatedly in office hours)

2007 — Content Control + Spam Education (94 posts)

Key topics

  • 2007-02: badware notifications improved (webmasters could see specific URLs)
  • 2007-02: Discover your links / full link graph opened up
  • 2007-03: All about robots(laid the foundation for the complete robots.txt guide)
  • 2007-04: SEO education: Linking / anchor text / Requesting removal / Getting your site indexed (each piece is introductory level)
  • 2007-06: Better Snippets for your Users(meta description guidance)
  • 2007-08: Stay away from automatically generated links(spam policy warning)+ Malware reviews via Webmaster Tools
  • 2007-09: Google, duplicate content caused by URL parameters, and you(parameterized duplicate governance)
  • 2007-09: Improve snippets with a meta description makeover(teaching how to write meta descriptions)
  • 2007-11: A spider's view of Web 2.0(early discussion on handling JS-heavy sites)
  • 2007-11: SEO advice: URL canonicalization(canonicalization education)
  • 2007-12: Information about buying and selling links that pass PageRank(Major paid links debate, the headline topic of 2007–2008)
  • 2007-12: Introducing Video Sitemaps(Video Sitemap protocol launched)
  • 2007-12: The Ultimate Fate of Supplemental Results(history of the supplemental index concept)

2008 — Major Webmaster Tools Overhaul + Duplicate Content Myth + SEO Starter Guide (142 posts)

Key events:First edition of the SEO Starter Guide released(2008-11) — the official introductory document still in use today.

Important milestones

  • 2008-01: Subdomains vs subdirectories (classic discussion)
  • 2008-03: First date with the Googlebot: Headers and compression(Googlebot behavior series)
  • 2008-04: Best practices when moving your site(early version of the site move playbook)
  • 2008-04: Crawling through HTML forms(announcement of crawler form-filling capability)
  • 2008-04: My site's been hacked - now what?(hacked site playbook)
  • 2008-05: How to apply for reconsideration (manual action appeal process)
  • 2008-06: How Google defines IP delivery, geolocation, and cloaking(classic definition of cloaking)
  • 2008-06: Improved Flash indexing (later followed by Goodbye Flash in 2019)
  • 2008-06: Improving on Robots Exclusion Protocol
  • 2008-08: 404 week(Farewell to soft 404s / Make your 404 pages more useful / It's 404 week at Webmaster Central / To infinity and beyond? No!) — classic 404 education series
  • 2008-09: Demystifying the "duplicate content penalty"(cited repeatedly in office hours — classic myth-busting)
  • 2008-09: Dynamic URLs vs. static URLs(dynamic URL education, countering SEO myths)
  • 2008-09: Matt Cutts interview trilogy
  • 2008-10: First Click Free for Web Search(cloaking exception policy for news subscription sites launched — later deprecated)
  • 2008-10: Importance of link architecture
  • 2008-11: Date with Googlebot, Part II: HTTP status codes and If-Modified-Since(core topics such as 304 caching)
  • 2008-11: Google's SEO Starter Guide(⭐ First edition!)
  • 2008-12: More control of Googlebot's crawl rate(crawl rate settings)
  • 2008-12: One place for changing your site's settings(WMT settings UI integration)

Key innovations:rel="canonical" link element launched(2009-02-12)— a turning point for the entire SEO era.

Classic and important posts

  • 2009-02: Canonical Link Element SMX presentation — rel=canonical first introduced
  • 2009-02: About paid links (ongoing governance of the link economy)
  • 2009-02: Best practices against hacking
  • 2009-04: New canonical posts series
  • 2009-04: nofollow policy refinement (shift from PageRank sculpting to ignore)
  • 2009-06: Search user tracking / personalized data
  • 2009-09: Duplicate content and multiple site issues(cited in office hours)
  • 2009-09: Reunifying duplicate content on your website (cited in office hours)
  • 2009-10: Reunifying duplicate content on your website(again)
  • 2009-12: Handling cross-domain duplication (cited in office hours)
  • Within 2009: a large number of Matt Cutts video posts — several per month, making up the bulk of the year's content
  • Matt Cutts video appearance frequency: started in 2008,peak in 2009–2011

International blog branches

  • Spanish-language blog launched (2008-09 but translations continued in 2009)
  • Support added for French, Italian, German, Portuguese, Chinese (Simplified), and Japanese

2010 — Caffeine Indexing / Site Speed Enters Rankings / Rich Snippets Expansion (177 posts)

3 major milestone events:

  1. 2010-04 Site Speed → ranking signal(Using site speed in web search ranking) — historic event where speed became a ranking factor
  2. 2010-06 Caffeine new indexing system launched(Our new search index: Caffeine) — indexing architecture shifted from batch to streaming
  3. 2010-08 Rich Snippets expansion(events / recipes / shopping / etc.)

Other important items

  • 2010-01: Introducing a new Rich Snippets format: Events(early form of Event structured data)
  • 2010-02: Best Practices for Breadcrumbs(early Breadcrumbs)
  • 2010-03: Microdata support for Rich Snippets(expanded from microformats to microdata)
  • 2010-03: Working with multi-regional websites + multilingual websites(international SEO series)
  • 2010-04: Adding Images to your Sitemaps(Image Sitemap)
  • 2010-04: Better recipes on the web: Introducing recipe rich snippets(early form of Recipe structured data)
  • 2010-04: Help Google index your videos
  • 2010-04: Rich snippets go international
  • 2010-06: How to display recipe information in recipe search
  • 2010-06: Crawl Errors now reports soft 404s(soft 404 monitoring)
  • 2010-07: Google, transparency and our not-so-secret formula(algorithm transparency public relations)
  • 2010-08: Showing more results from a domain(early form of the host group concept)
  • 2010-08: Google now indexes SVG(SVG indexing support)
  • 2010-09: Google Instant: Impact on Search queries(Instant Search launched)
  • 2010-09: Finding Places on the Web: Rich Snippets for Local Search
  • 2010-09: SEO Starter Guide updated
  • 2010-10: Google Merchant Center is open(Merchant Center launched — the epic starting point of ecommerce SEO)
  • 2010-11: Introducing a new meta tag that reveals the referring article(early syndication source)
  • 2010-11: Instant Previews(real-time SERP previews, later removed)
  • 2010-11: Make your websites run faster, automatically—try mod_pagespeed for Apache
  • 2010-11: Rich snippets for shopping sites
  • 2010-11: What a feeling! Even better indexing of SWF content(Flash indexing, 2019 Goodbye Flash)
  • 2010-12: New hacked site notifications in search results(hacked site warnings introduced in SERPs)

Summary of era characteristics

Core mental models (2005–2010)

  • "We are trying to be more transparent" — these 6 years marked SEO's shift from myth to documentation, with Google proactively disclosing mechanisms
  • Webmaster Tools was the only window for webmasters — predecessor to Search Console
  • Matt Cutts was the face of SEO education — peak period 2007–2014

Major intangible legacy

  • rel=canonical(2009)— remains a canonicalization signal through 2026
  • Site speed → ranking signal(2010)— ancestor of Core Web Vitals
  • News Sitemap protocol(2006)— foundation of News indexing
  • Video Sitemap protocol(2007)— foundation for case studies from Vimeo, MX Player, and others
  • Image Sitemap(2010)— foundation for large Discover images / Images search
  • SEO Starter Guide v1(2008)— survives after multiple revamps

Historical baggage (no longer relevant)

  • ❌ Flash indexing(SWF)— 2019 Goodbye
  • ❌ First Click Free(2008)— deprecated
  • ❌ Supplemental Index(2007)— unified
  • ❌ Google Instant(2010)— decommissioned
  • ❌ Instant Previews(2010)— decommissioned
  • ❌ PageRank sculpting(2009 nofollow change)— completely ineffective

Content insights

  • A large number of posts were event recap(conferences such as SES / Pubcon / BlogHer / SMX)— the Google team attended heavily in that era
  • Matt Cutts video series was the essence of SEO education — short videos + transcripts, extremely high output
  • 400+ posts were in office hours / Q&A format

Reverse Lookup Guide

If you are looking for:

  • History of the Sitemap protocol → sitemap-related posts from 2005–2007
  • Recovery of hacked sites → 2008-04 + 2008-08 + 2010-12 series
  • Origins of canonicalization → 2007-11 + 2009-02
  • duplicate content myth → 2006-12 + 2008-09 + 2009-09/10 + 2009-12
  • Beginnings of international SEO → early hreflang posts from 2010-03
  • Origins of rich snippets → 2010-01 + 2010-04 + 2010-08 + 2010-09

Modern answers to various questions are available at:


Cross-references

Sources and related materials