Top

Robots.Txt Generator

Report An Error

Thanks for reporting us about this tool.We will fix it asap thanks.

Select given options and generate Robots.txt file

Sitemap: (leave blank for none)
Default -  All Robots are: Crawl-Delay:
Generate Robots for Wordpress ?
Specific Search Robots
Google   googlebot MSN Search   msnbot
Yahoo   yahoo-slurp Ask/Teoma   teoma
Cuil   twiceler GigaBlast   gigabot
Scrub The Web   scrubby DMOZ Checker   robozilla
Nutch   nutch Alexa/Wayback   ia_archiver
Baidu   baiduspider Naver   naverbot, yeti
Specific Special Bots
Google Image   googlebot-image Google Mobile   googlebot-mobile
Yahoo MM   yahoo-mmcrawler MSN PicSearch   psbot
SingingFish   asterias Yahoo Blogs   yahoo-blogs/v3.9
Restricted Directories
The path is relative to root and must contain a trailing "/"