Week 9

Robot Rules

Description

Websites have a special file called 'robots.txt' that tells search engine robots which pages they can visit! Sometimes interesting directories are listed there. Your task: Check the robots.txt file of THIS website to find a secret path! STEPS:

1. Look at the URL of this page in your browser

2. Remove everything after the domain name

3. Add /robots.txt to the end

4. For example: if you're on 'example.com/challenge/123', go to 'example.com/robots.txt'

5. Find the comment that says 'Secret path:' and look at what follows it

6. Submit it as FLAG{path_you_found} NOTE: Real websites use robots.txt to tell search engines what to index. Hackers often check this file first to discover hidden directories!

Links

• https://www.robotstxt.org/
• https://en.wikipedia.org/wiki/Robots.txt

Last Updated
2026-03-06 14:40:47