Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update robots.txt #74

Closed
wants to merge 3 commits into from
Closed

Conversation

Super-Code774
Copy link
Contributor

Adding bot from other companies
and change disalow

Adding bot from other companies
@saumon-brule
Copy link
Member

Nice addition, thank you a lot for your participation but what are the path /temp and /private ?

Sorry! I did something wrong, I don't remember where the files are, I think I confused them with something else
@Super-Code774
Copy link
Contributor Author

do you think you need to architect the file like that

User-agent: Googlebot
Disallow: /lab

User-agent: Bingbot
Disallow: /lab

User-agent: *
Disallow: /lab

Sitemap: https://ecole-directe.plus/sitemap.xml

or like that

User-agent: Googlebot
User-agent: Bingbot
User-agent: *
Disallow: /lab
Sitemap: https://ecole-directe.plus/sitemap.xml

@Super-Code774 Super-Code774 closed this by deleting the head repository Jan 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants