Add robots.txt
Use same setup as on docs.openstack.org to exclude draft content. Change-Id: Ied68f5f357a110fe5411ca28831d5a113314eacf
This commit is contained in:
parent
bafd7ef618
commit
7509562ac8
7
www/robots.txt
Normal file
7
www/robots.txt
Normal file
@ -0,0 +1,7 @@
|
||||
# openstack-manuals/www/robots.txt
|
||||
User-agent: Googlebot
|
||||
Disallow: /*.pdf$
|
||||
|
||||
# Keep OpenStack users from accidentally using docs for the upcoming release
|
||||
User-agent: *
|
||||
Disallow: /draft/
|
Loading…
x
Reference in New Issue
Block a user