Ban robots while in development

This commit is contained in:
Wesley Moore 2010-03-19 18:23:57 +11:00
parent 27a19e0c94
commit 5683c8809a

View file

@ -2,5 +2,5 @@
#
# To ban all spiders from the entire site uncomment the next two lines:
User-Agent: *
Disallow:
Disallow: /
Sitemap: <%= @site.config[:base_url] %>/sitemap.xml