robots.txt
-
M
A Whole Blog in Robots.txt - Broke all Normal Blogging Trends
All of us use Wordpress, Blogger, MySpace, Live Journal etc. etc. for our Blogging Purpose. Those who are using self hosted Wordpress Blogs know about robots.txt As Taken from WikipediaA robots.txt file on a website will function as a request that specified robots ignore specified files or... -
.:: Is robots.txt necessary? ::.
I dont want any restriction on indexing so dont require robots.txt file. But is it any harm or good if you put one? coz a blank file will stop giving the 404 message. What do u all say? Pros and Cons plz let me know Thanks- tuXian
- Thread
- file giving robots.txt stop
- Replies: 6
- Forum: QnA (read only)