Robots.txt is really a file that exists on the foundation directory of each Site and can be employed to instruct search engines like google and yahoo on which directories/information of the web site they're able to crawl and involve within their index. A substantial motive that Search engine optimization issues https://news.rafeeg.ae