midgard/zeus.ugent.be
1
0
Fork 0
Code Issues Pull requests Packages Projects Releases Wiki Activity

Allow less crawling

Browse source
This commit is contained in:
Felix Van der Jeugt 2020-01-16 09:02:52 +01:00
parent 60d03a8920
commit 785c927834
No known key found for this signature in database
GPG key ID: 58B209295023754D
1 changed files with 6 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

9
content/robots.txt
View file

@ -1,4 +1,7 @@
User-agent: * User-agent: *
Allow: / Disallow: /
Disallow: /wiki/ Allow: /about/
Disallow: /slackintegrations Disallow: /about/sponsorende-leden/
Allow: /contact/
Allow: /events/
Allow: /projects/