wezm/wezm.net
1
0
Fork 1
mirror of https://github.com/wezm/wezm.net.git synced 2024-11-10 01:42:32 +00:00
Code Issues Projects Releases Packages Wiki Activity

Ban robots while in development

Browse source
This commit is contained in:
Wesley Moore 2010-03-19 18:23:57 +11:00
parent 27a19e0c94
commit 5683c8809a
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
content/robots.txt
View file

@ -2,5 +2,5 @@
# #
# To ban all spiders from the entire site uncomment the next two lines: # To ban all spiders from the entire site uncomment the next two lines:
User-Agent: * User-Agent: *
Disallow: Disallow: /
Sitemap: <%= @site.config[:base_url] %>/sitemap.xml Sitemap: <%= @site.config[:base_url] %>/sitemap.xml