Okay, so I was just wondering why you would need this file? what is a robot? I'm really confused. I started to read up on it, but it confused me to hell.

Can anyone explain it in simple terms for me??

Thanks in advice!

__________________

It's a file that is designed to help web sites like Google, Yahoo... to know which directories are allowed to be scanned/accessed. (from what I remember).

Without it, a crawler from one of the search engines could index/search your entire web site.

__________________
I'm here, you may now make your next two wishes.

Beat Me, Whip Me, Make Me Use Windows!!

Every Piece of Electronic Equipment runs on a finite amount of smoke. The systems are normally very efficient at reclaiming the smoke and recycling it, however, should you do something to let the smoke out, your system will become useless.

SAVE THE SMOKE !!

New PC :
New: Phenom 9500 Quad 2.2, 4gb ram XP Pro 64-bit (Sata 0), XP Pro 32 bit (sata 1), 40 eide HDD (music), Pioneer Blu-Ray Burner, HP Multidisk CD-RW/DVD-Rom, 2x250 Seagate HDD's, ATI Radeon 3870, Asus M3A32-MVP Deluxe WiFi-AP

Old PC:
P4 1.5GHz, 768 Ram, hda-80Gb (80Ubuntu), DVD R/RW

oooh! Okay, I'm with you now! Thanks

__________________

If you look at the online users on CompuForums (guests) then you will notice a lot of them are google bots or yahoo bots.

__________________
Mr Pickles
Moderator
Please consider Premium Member Ship Here
Please follow and obey the rules of the forum. Failure to do so could result in an infraction or ban
NO PM's For help, they will be ignored
Please vote in Contributor of the Month
For all your Hosting Centicero

yea, theres alot of these spiders from usually yahoo and google and MSN. i really havent seen alot of other brands, but if you ever happen to notice that theres 2 of the same IPs under an online user or a quest, then you should automatically know that it is a bot from another site, or search engine. Some of them dont have the text like google and yahoo.

__________________
What is a physical body. The body is merely an object. It is a form of existence far too impure to store the gods within us called souls. Now you will remember. The bloodstained history. Material desire. Hunger. Sexual Drive. Desire to dominate. Desire for fame. Humanity. As long as there is a body, desires will be born. The human ego will never disappear as long as desire remains present. Humans will continue to fight to fulfill their bodies desires and it will never end. At this rate there is no future.