Learn New Things in Digital Marketing Techniques

What is Robots.txt file in Seo

robots.txt, It  is a standard used by websites to communicate with search engine crawlers and other search engine robots. The standard specifies how to inform the search engine  robots about which areas of the website should not be processed or scanned or read.

how to generate robots.txt file using generator  tool?

robots.txt file code example:-

User-Agent: *

Disallow: /admin

nOTE:- The "User-Agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit /admin directory.

 Use  http://tools.seobook.com/robots-txt/generator/

Next Post »