mirror of
https://github.com/wezm/wezm.net.git
synced 2024-11-18 12:52:47 +00:00
Ban robots while in development
This commit is contained in:
parent
27a19e0c94
commit
5683c8809a
1 changed files with 1 additions and 1 deletions
|
@ -2,5 +2,5 @@
|
|||
#
|
||||
# To ban all spiders from the entire site uncomment the next two lines:
|
||||
User-Agent: *
|
||||
Disallow:
|
||||
Disallow: /
|
||||
Sitemap: <%= @site.config[:base_url] %>/sitemap.xml
|
||||
|
|
Loading…
Reference in a new issue