Update robots.txt (#51167)

2be7ddb7 · Moritz Schlarb · c380d3ac · 2be7ddb7
Commit 2be7ddb7 authored Sep 07, 2018 by Moritz Schlarb
Hide whitespace changes
Inline Side-by-side

Showing with 2 additions and 0 deletions

public/robots.txt public/robots.txt +2 -0

No files found.
--- a/public/robots.txt
+++ b/public/robots.txt
@@ -21,6 +21,8 @@ Disallow: /groups/new
 Disallow: /groups/*/edit
 Disallow: /users
 Disallow: /help
+# Only specifically allow the Sign In page to avoid very ugly search results
+Allow: /users/sign_in

 # Global snippets
 User-Agent: *