legger historikk i robots.txt for å prøve å hindre google i å indekse…

…re siden
navikt · Jul 19, 2021 · 2e73ede · 2e73ede
1 parent 7804506
commit 2e73ede
Showing 1 changed file with 3 additions and 0 deletions.
diff --git a/public/robots.txt b/public/robots.txt
@@ -1,2 +1,5 @@
 User-agent: *
 Sitemap: https://www.nav.no/arbeid/sitemap.xml
+
+User-agent: Googlebot
+Disallow: https://www.nav.no/arbeid/historikk/