Skip to content

Commit

Permalink
Adds CCBot to robots.txt
Browse files Browse the repository at this point in the history
  • Loading branch information
SomniusTiger committed Dec 26, 2023
1 parent b05a9d5 commit fdf39e7
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions public/robots.txt
Original file line number Diff line number Diff line change
@@ -1,5 +1,8 @@
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file

User-agent: CCBot
Disallow: /

User-agent: *
Disallow: /media_proxy/
Disallow: /interact/

0 comments on commit fdf39e7

Please sign in to comment.