Merge branch 'patch-28' into 'master'

Update robots.txt (#51167) See merge request gitlab-org/gitlab-ce!21585

Merge branch 'patch-28' into 'master'
Update robots.txt (#51167) See merge request gitlab-org/gitlab-ce!21585
ef8a1b60 · Douwe Maan · 9765f876 · 2be7ddb7 · ef8a1b60
Commit ef8a1b60 authored Sep 07, 2018 by Douwe Maan
Hide whitespace changes
Inline Side-by-side

Showing with 2 additions and 0 deletions

public/robots.txt public/robots.txt +2 -0

No files found.
--- a/public/robots.txt
+++ b/public/robots.txt
@@ -21,6 +21,8 @@ Disallow: /groups/new
 Disallow: /groups/*/edit
 Disallow: /users
 Disallow: /help
+# Only specifically allow the Sign In page to avoid very ugly search results
+Allow: /users/sign_in

 # Global snippets
 User-Agent: *