api-site/www/robots.txt
Andreas Jaeger 7509562ac8 Add robots.txt
Use same setup as on docs.openstack.org to exclude draft content.

Change-Id: Ied68f5f357a110fe5411ca28831d5a113314eacf
2015-04-25 15:41:10 +02:00

8 lines
185 B
Plaintext

# openstack-manuals/www/robots.txt
User-agent: Googlebot
Disallow: /*.pdf$
# Keep OpenStack users from accidentally using docs for the upcoming release
User-agent: *
Disallow: /draft/