Dangers of robots.txt file killing your business.
Beware when getting a new website, or maybe a new website design – more often than not after your new website has been built, within the robots.txt file your website hasn’t changed to allow Google to start looking at it. As a result, you are seeing no organic traffic.
Why is this?
When website developers are creating and building your new website design, they will often tell search engines to ignore your website within the robot Txt with a simple disallow command. This just deters anyone viewing a site while it’s under construction.
However, what happens when it is complete and gone live? Surely you want to allow access again? Sadly, this simple command can be over-looked by web developers.
Luckily, this is an easy fix.
- Within your google search console account, look towards the bottom of the left hand menu.
- Click on ‘go to old version’.
- Once in the older version go to the ‘crawl’ drop down menu and click ‘robots.txt Tester’. Here you can view simply change the code to allow google to
- Make sure your website designer does not get google to ignore your website!
Interested to know more about how a Robots.Txt file influences your website? I recommend reading this: https://www.whoishostingthis.com/resources/robots-txt/
Find out about Click Return’s website design services.
Blog source: http://twfacs.co.uk
