The role of the robots.txt file to improve site ranking! Not many web master take the time to use a robots.txt file for their website http://