Commit ef8a1b60 authored by Douwe Maan's avatar Douwe Maan

Merge branch 'patch-28' into 'master'

Update robots.txt (#51167)

See merge request gitlab-org/gitlab-ce!21585
parents 9765f876 2be7ddb7
...@@ -21,6 +21,8 @@ Disallow: /groups/new ...@@ -21,6 +21,8 @@ Disallow: /groups/new
Disallow: /groups/*/edit Disallow: /groups/*/edit
Disallow: /users Disallow: /users
Disallow: /help Disallow: /help
# Only specifically allow the Sign In page to avoid very ugly search results
Allow: /users/sign_in
# Global snippets # Global snippets
User-Agent: * User-Agent: *
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment