Answers.com > Wiki Answers > Categories > Technology > Computers > Internet > Web Design and Publishing > Web Hosting > How do you create to robot.txt file for own websites?

How do you create to robot.txt file for own websites?

Answer:
The robot.txt file tells web crawlers which directories or files can or cannot be crawled. Make sure it's current for your site so that you don't accidentally block content you want others to find.

See related links for steps to create a valid robots.txt file.
First answer by Docjason. Last edit by Docjason. Contributor trust: 130 [recommend contributor recommended]. Question popularity: 2 [recommend question].

Can you answer these Web Hosting questions?

What is a free website with peace sign logo? Answer it!
How do you set up a live chat on your website? Answer it!
Who owns godlike productions website? Answer it!
How can you create your own website to generate income? Answer it!
What groups created relief organizations to help individuals? Answer it!

Relevant answers:

Home

Answer these

What us antonym of why?
In: Synonyms and Antonyms
Answer it!
How do you play all of the lights on a alto saxophone?
In: Saxophone
Answer it!
Would a male dog try to mate with another male dog?
In: Dogs (Canines)
Answer it!
What colour is the heart when its unhealthy?
In: Heart
Answer it!
» more

Featured guides

» More