WebTools

Useful Tools & Utilities to make life easier.

Robots.txt Generator — Seogtl.org

Feel free to request missing tools or give some feedback using our contact form.

Generate Robots.txt Files

Default for All Robots

Crawl Delay

Sitemap

Google

Google Images

Google Mobile

MSN Search

Yahoo

Yahoo MM

Yahoo Blogs

Ask/Teeoma

GigaBlast

DMOZ Checker

Nutch

Alexa / Wayback

Baidu

Naver

MSN PicSearch

Disallowed Directories

Robots.txt Generator is a useful tool that helps you generate Robots.txt files to handle many types of bot visitors on your website.

Feel free to request missing tools or give some feedback using our contact form.