Robots.txt Generator

Leave blank if you don't have.
Google
Google Image
Google Mobile
MSN Search
Yahoo
Yahoo MM
Yahoo Blogs
Ask/Teoma
GigaBlast
DMOZ Checker
Nutch
Alexa/Wayback
Baidu
Naver
MSN PicSearch
The path is relative to the root and must contain a trailing slash "/".

Robots.txt Generator is a tool used to create a Robots Exclusion File (robots.txt) for a website. This file can be used to control how search engine bots crawl and index a website. The tool allows users to create files that include rules and directives for specific search engines or types of web crawlers, as well as instructions for how user agents should interact with website content.


Sheikh Md. Mahtabur Rahman

CEO / Founder

Sheikh Md. Mahtabur Rahman was born in Rangpur, Bangladesh in 1994 and completed his MBBS from the University of Rajshahi. He then pursued online courses in Digital Marketing, Web Design & Development & Video Production. He is currently a doctor, article writer and YouTuber. He has been fascinated by genetics since he was young and has been studying many different aspects of human biology including cancer, diabetes, immunology, hypertension, ageing and Alzheimer's disease.