Training-WWW-Robots

Training-WWW-Robots

In this little training challenge, you are going to learn about the Robots exclusion standard. The robots-txt file is used by web crawlers to check if they are allowed to crawl and index your website or only parts of it. Sometimes these files reveal the directory structure instead protecting the content from being crawled. Enjoy! Q HTML < !OOCTYPE html > : head head* In this little training challenge, you are going to learn about the (a href-"http://en."ikipedia.ore/wiki/Robot5 exclusion The robot5.tKt file is used by web crawlers to check if they are allowed to crawl and index your website or only parts of Sometimes these files reveal the directory structure instead protecting the content from being crawled.

进行翻译发现robots.txt，进行访问

O a 61.147.171.105:60744/robots.txt Disallow: / f leg. php User - agent: Yandex

发现fl0g.php，访问它，获取flag

c :yberpeace 5ce5d3429b6a870en31 ccb8ccl

posted @ 2023-06-17 16:24  回忆的金鱼  阅读(138)  评论(0)    收藏  举报