# Disallow all crawlers access to certain pages. User-agent: * Disallow: /cgi-bin/ Disallow: /wp-content/plugins/wp-dtree/ Disallow: /wp-content/plugins/ Disallow: /wp-admin/ #Sitemap: http://www.yoursite.com/sitemap.gz