1 Comments
- samblesj, on 06/06/2008, -0/+1Hi,
Yes you should always have a robots.txt file. IMHO you should do whatever you can to make you site easily 'found' by the Search engines. Good article and helpful.
Thanks
indiaseo-services.blogspot.com — Generally in case of small websites webmasters are under false assumption that they do not require to create a robot.txt file. But it is required. First of all let us define the robot.txt file. Even prior to it we need to define what a web robot is.