Robots.txt Generator


Default - All Robots are:  
    
Crawl-Delay:
    
Sitemap: (leave blank if you don't have) 
     
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo
  Yahoo MM
  Yahoo Blogs
  Ask/Teoma
  GigaBlast
  DMOZ Checker
  Nutch
  Alexa/Wayback
  Baidu
  Naver
  MSN PicSearch
   
Restricted Directories: The path is relative to root and must contain a trailing slash "/"
 
 
 
 
 
 
   

Advertisement



Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.



Related Tools



LATEST BLOGS

A Look At How AI Is Rewriting the Rules of Search Visibility

A Look At How AI Is Rewriting the Rules of Search Visibility

9 Feb  / 1558 views  /  by Malik Junaid Rasheed
The Ultimate Checklist for Enterprise-Level Site Audits Using Free SEO Tools

The Ultimate Checklist for Enterprise-Level Site Audits Using Free SEO Tools

24 Jan  / 13880 views  /  by Malik Junaid Rasheed

Small SEO Tools

CONTACT US

contact@smallseo.tools

ADDRESS

SmallSEO.Tools Service is Free Worldwide Disclaimer: We do not have any other websites. SmallSEOTools ™ does not have any affiliation with other SEO tools website.