Official Google Blog: The Robots Exclusion Protocol

Official Google Blog: The Robots Exclusion Protocol

| Official Google Blog: The Robots Exclusion Protocol | This is the second in a short series of posts about the Robots Exclusion Protocol, the standard for controlling how web pages on your site are indexed. This post provides more details and examples of mechanisms to control access and indexing of your website by Google.

Advertisement
Kevin Duane

Kevin Duane

Site reliability engineer writing first-person about AI, engineering, and productivity — what actually works in daily practice.