← Knowledge Notes
Global Growth / Knowledge note · English

GSC Blog 2005–2010: The Infrastructure Era (Birth of Webmaster Tools / Sitemap Protocol / Early Spam)

The first 6 years of the Google Search Central blog (2005–2010, approximately 708 posts): birth and maintenance of the Webmaster Tools platform / evolution of the Sitemap protocol from 0.84 to 0.90 / early spam governance / badware / StopBadware security partnership / the start of the Matt Cutts video series / the Vanessa Fox era / launch of the Canonical link element (2009) / international blog branches / the first malware warning / the link economy war (major paid links debate 2007–2008) / education on duplicate content myths / first edition of the SEO Starter Guide (2008) / Caffeine indexing architecture (2010) / Site Speed becomes a ranking signal (2010)

Source collection:Google Search and SEO · Published here:2026-09-26

SEOSearch EnginesOrganic growth

This covers the birth and first 6 years of the Google Search Central (formerly Webmaster Central / Google Webmaster Blog) blog.Approximately 708 English posts(of which around 190 have Chinese translations; most translations only began after 2008).Core themes: Webmaster Tools (from 2005), the Sitemap protocol (2005), the badware (malicious software) war (from 2006), duplicate content (2008), and the Caffeine indexing system (2010).Writing style: Early contributors including Vanessa Fox, Matt Cutts, Susan Moskwa and other founding members. Matt Cutts' video series gained momentum starting in late 2009.

Note: Blog post titles are kept in English (they serve as reference identifiers), with explanatory notes added in Chinese parentheses.


2005 — The Birth of the Sitemap Era (32 posts)

Origins: On 2005-08-09 Google launched Google Sitemaps(later expanded into Webmaster Tools). Earliest post:Just getting started...(Just getting started…, 2005-08, public announcement)

Main themes

  • Early Sitemap protocol: What URLs should include / Sitemap Index Files / Mobile Sitemaps (very early!) / Sitemap Generator (encoding change in v1.3) / multiple Sitemaps in the same directory / cross-domain Sitemaps
  • Site Verification system: lowercase filenames / verification in subdirectories / DNS verification (added later)
  • Query stats: More stats! / More query stats (early prototype of Search Console)
  • Multilingual expansion: Japanese support (November) / More language support (2006-01)
  • Key early Q&A:www vs non-www versions(www vs non-www versions, 2005-12) / Changing domains(changing domain names, 2005-11)

2006 — Webmaster Tools Renamed + Spam Governance (83 posts)

Renaming event:2006-08 "Webmaster Central" officially replaced the name "Google Sitemaps" — marking the expansion into broader webmaster tools beyond just sitemaps.

Key milestones

  • 2006-04: Better details about when Googlebot last visited / Yahoo! Merchants get Sitemaps(Yahoo! merchants get Sitemaps, signaling the first signs of cross-search-engine unification of the protocol)
  • 2006-06:site: operator misconception debate — multiple posts (Issues with site: operator / Another update on site:)
  • 2006-07:More control over page snippets + More control over titles too(more control over page snippets / titles) — among the first snippet control announcements
  • 2006-08:"All About Googlebot"(everything about Googlebot) + official introduction to webmaster rearrangement
  • 2006-09:Setting the preferred domain(set preferred domain) launched
  • 2006-09:How to verify Googlebot(how to verify Googlebot, the reverse DNS check process was finalized and remains in use today)
  • 2006-10:Multiple Sitemaps in the same directory(multiple Sitemaps in the same directory) + Update to our webmaster guidelines(webmaster guidelines update, policy update)
  • 2006-11:Badware alerts for your sites(malware warnings for sites, first launch of security warning notifications) + Introducing Sitemaps for Google News(introducing Sitemaps for Google News, birth of News sitemaps)
  • 2006-11:Joint support for the Sitemap Protocol(joint support for the Sitemap protocol, announcement of the cross-engine unified 0.90 protocol)
  • 2006-12:Deftly dealing with duplicate content(deftly dealing with duplicate content) — classic duplicate content myth-busting post (cited repeatedly in office hours)

2007 — Content Control + Spam Education (94 posts)

Key topics

  • 2007-02: Improved malware notifications (webmasters could see specific URLs)
  • 2007-02: Discover your links / full link graph opened up
  • 2007-03:All about robots(everything about robots, laying the foundation for the complete robots.txt guide)
  • 2007-04: SEO education: Linking / anchor text / Requesting removal / Getting your site indexed (each post is introductory level)
  • 2007-06: Better Snippets for your Users (meta description guide)
  • 2007-08:Stay away from automatically generated links(stay away from auto-generated links, spam policy warning) + Malware reviews via Webmaster Tools
  • 2007-09:Google, duplicate content caused by URL parameters, and you(duplicate content caused by Google / URL parameters / and you, parameterized duplicate governance)
  • 2007-09:Improve snippets with a meta description makeover(improving snippets with meta descriptions, teaching how to write meta descriptions)
  • 2007-11:A spider's view of Web 2.0(Web 2.0 through the eyes of the crawler, early discussion on handling JavaScript-heavy sites)
  • 2007-11:SEO advice: URL canonicalization(SEO advice: URL canonicalization, canonicalization education)
  • 2007-12:Information about buying and selling links that pass PageRank(information about buying and selling links that pass PageRank,the great paid links debate, the major focus of 2007–2008)
  • 2007-12:Introducing Video Sitemaps(introducing video Sitemaps, Video Sitemap protocol launched)
  • 2007-12:The Ultimate Fate of Supplemental Results(the final destination of supplemental results, history of the supplemental index concept)

2008 — Major Webmaster Tools Overhaul + Duplicate Content Myths + SEO Starter Guide (142 posts)

Key events:First edition of the SEO Starter Guide released(2008-11) — the official introductory document still used today.

Important milestones

  • 2008-01: Subdomains vs subdirectories (classic discussion)
  • 2008-03:First date with the Googlebot: Headers and compression(A first date with Googlebot: headers and compression, Googlebot behavior series)
  • 2008-04:Best practices when moving your site(best practices for moving sites, early version of the site move playbook)
  • 2008-04:Crawling through HTML forms(crawling through HTML forms, announcement of crawler form-filling capability)
  • 2008-04:My site's been hacked - now what?(My site was hacked - now what? Hacked site playbook)
  • 2008-05: How to apply for reconsideration (manual penalty appeal process)
  • 2008-06:How Google defines IP delivery, geolocation, and cloaking(how Google defines IP delivery / geotargeting / cloaking, classic definition of cloaking violations)
  • 2008-06: Improved Flash indexing (Flash was later retired in 2019)
  • 2008-06:Improving on Robots Exclusion Protocol(improving the robots exclusion protocol)
  • 2008-08:404 week(404 week:Farewell to soft 404s(farewell to soft 404s) / Make your 404 pages more useful(making 404 pages more useful) / It's 404 week at Webmaster Central / To infinity and beyond? No!(to infinity and beyond? No!)) — classic 404 education series
  • 2008-09:Demystifying the "duplicate content penalty"(debunking the "duplicate content penalty" myth, cited repeatedly in office hours — classic myth-busting)
  • 2008-09:Dynamic URLs vs. static URLs(dynamic URLs vs static URLs, anti-SEO myth)
  • 2008-09: Matt Cutts interview trilogy
  • 2008-10:First Click Free for Web Search(First Click Free for web search, cloaking exception policy launched for news subscription sites — later deprecated)
  • 2008-10:Importance of link architecture(the importance of link architecture)
  • 2008-11:Date with Googlebot, Part II: HTTP status codes and If-Modified-Since(A date with Googlebot part 2: HTTP status codes and If-Modified-Since, 304 caching and other core topics)
  • 2008-11:Google's SEO Starter Guide(⭐ First edition!)
  • 2008-12:More control of Googlebot's crawl rate(more control over Googlebot crawl rate)
  • 2008-12:One place for changing your site's settings(one place to change site settings, Webmaster Tools settings UI consolidation)

Key innovation:rel="canonical" link element launched(2009-02-12) — a turning point for the entire SEO era.

Classic + important posts

  • 2009-02:Canonical Link Element SMX presentation — rel=canonical first introduced
  • 2009-02: About paid links (ongoing governance of the link economy)
  • 2009-02: Best practices against hacking
  • 2009-04: New canonical posts series
  • 2009-04:nofollow policy refinement (shifting from PageRank sculpting to ignoring)
  • 2009-06: search user tracking / personalized data
  • 2009-09:Duplicate content and multiple site issues(duplicate content and multi-site issues, cited in office hours)
  • 2009-09: Reunifying duplicate content on your website (cited in office hours)
  • 2009-10:Reunifying duplicate content on your website(again)
  • 2009-12: Handling cross-domain duplication (cited in office hours)
  • Throughout 2009: a large number of Matt Cutts video posts — several per month, making up the bulk of the year's content
  • Matt Cutts video appearance frequency: started in 2008,peak from 2009–2011

International blog branches

  • Spanish blog launched (2008-09, continued translations in 2009)
  • French / Italian / German / Portuguese / Chinese (Simplified) / Japanese support

2010 — Caffeine Index / Site Speed Enters Rankings / Rich Snippets Expansion (177 posts)

3 major milestone events:

  1. 2010-04 Site Speed → ranking signal(Using site speed in web search ranking using site speed in web search ranking) — speed became a ranking factor, a historic event
  2. 2010-06 Caffeine new indexing system went live(Our new search index: Caffeine our new search index: Caffeine) — indexing architecture shifted from batch to streaming
  3. 2010-08 Rich Snippets expansion(events / recipes / shopping / etc.)

Other important

  • 2010-01:Introducing a new Rich Snippets format: Events(Introducing new Rich Snippets formats: events, early prototype of Event structured data)
  • 2010-02:Best Practices for Breadcrumbs(Breadcrumb best practices, early Breadcrumb)
  • 2010-03:Microdata support for Rich Snippets(Microdata support for Rich Snippets, expanded from microformats to microdata)
  • 2010-03:Working with multi-regional websites + multilingual websites(How multi-region + multilingual sites work, international SEO series)
  • 2010-04:Adding Images to your Sitemaps(Add images to your Sitemap, Image Sitemap)
  • 2010-04:Better recipes on the web: Introducing recipe rich snippets(Better recipes on the web: introducing recipe rich snippets, early prototype of Recipe structured data)
  • 2010-04:Help Google index your videos(Help Google index your videos)
  • 2010-04: Rich snippets go international (internationalization of rich snippets)
  • 2010-06:How to display recipe information in recipe search(How to show recipe information in recipe search)
  • 2010-06:Crawl Errors now reports soft 404s(Crawl errors now report soft 404s, soft 404 monitoring)
  • 2010-07:Google, transparency and our not-so-secret formula(Google / Transparency / Our not-so-secret formula, algorithm transparency PR)
  • 2010-08:Showing more results from a domain(Showing more results from the same domain, early prototype of the host group concept)
  • 2010-08:Google now indexes SVG(Google now indexes SVG)
  • 2010-09:Google Instant: Impact on Search queries(The impact of Google Instant on search queries, launch of Instant Search)
  • 2010-09:Finding Places on the Web: Rich Snippets for Local Search(Finding places on the web: Rich Snippets for local search)
  • 2010-09:SEO Starter Guide updated(SEO Starter Guide updated)
  • 2010-10:Google Merchant Center is open(Google Merchant Center opens, Merchant Center launches — the epic starting point of e-commerce SEO)
  • 2010-11:Introducing a new meta tag that reveals the referring article(Introducing a new meta tag to indicate the original source article for syndicated content, early syndication source marking)
  • 2010-11:Instant Previews(Instant Previews, real-time SERP previews, later retired)
  • 2010-11:Make your websites run faster, automatically—try mod_pagespeed for Apache(Make your website automatically faster — try Apache mod_pagespeed)
  • 2010-11:Rich snippets for shopping sites(Rich snippets for shopping sites)
  • 2010-11:What a feeling! Even better indexing of SWF content(What a feeling! Better indexing of SWF content, Flash indexing; farewell to Flash in 2019)
  • 2010-12:New hacked site notifications in search results(New notifications for hacked sites in search results, hacked site warnings introduced in search results)

Summary of era characteristics

Core mental models (2005–2010)

  • "We're trying to be more transparent" — These 6 years marked SEO's shift from myth to docs, as Google proactively disclosed its mechanisms
  • Webmaster Tools was the only channel for webmasters — Predecessor of Search Console
  • Matt Cutts was the face of SEO education — Peak period 2007–2014

Major intangible legacies

  • rel=canonical(2009) — Remains a canonicalization signal as of 2026
  • Site speed → ranking signal(2010) — Ancestor of Core Web Vitals
  • News Sitemap protocol(2006) — Foundation of News indexing
  • Video Sitemap protocol(2007) — Basis for case studies including Vimeo / MX Player
  • Image Sitemap(2010) — Foundation for Discover large images / Image Search
  • SEO Starter Guide v1(2008) — Survived multiple overhauls

Historical baggage (no longer relevant)

  • ❌ Flash indexing(SWF) — Farewell in 2019
  • ❌ First Click Free(2008) — Deprecated
  • ❌ Supplemental Index(2007) — Unified
  • ❌ Google Instant(2010) — Retired
  • ❌ Instant Previews(2010) — Retired
  • ❌ PageRank sculpting(2009 nofollow change) — Fully obsolete

Content insights

  • A large number of articles are conference recaps(Conferences such as SES / Pubcon / BlogHer / SMX) — Google teams attended heavily in that era
  • Matt Cutts videos series were the essence of SEO education — short videos + transcripts, extremely prolific
  • 400+ articles were in office hours / Q&A format

Reverse lookup guide

If you are looking for:

  • History of the Sitemap protocol → Sitemap-related articles from 2005–2007
  • Hacked site recovery → 2008-04 + 2008-08 + 2010-12 series
  • Origins of canonicalization → 2007-11 + 2009-02
  • Duplicate content myths → 2006-12 + 2008-09 + 2009-09 / 10 + 2009-12
  • Beginnings of international SEO → 2010-03 early hreflang article
  • Origins of rich snippets → 2010-01 + 2010-04 + 2010-08 + 2010-09

Modern answers to various questions are in:


Related references

Sources and related materials