rejetto forum

Blocking Googlebots on an open server

0 Members and 1 Guest are viewing this topic.

Offline teeburd105

  • Occasional poster
  • *
    • Posts: 2
    • View Profile
Is there any way to block googlebots from scanning my server without creating user groups.
I like people to be able to access w/o passwords.  I know with some webservers a file called a robot.txt with specific command lines is used.  Any option like that in hsf?

thanks, tony


Offline rejetto

  • Administrator
  • Tireless poster
  • *****
    • Posts: 13308
    • View Profile
yes, it's the same. create a robot.txt and put it in the virtual file system (under the home).


Offline dA CLOwN

  • Occasional poster
  • *
    • Posts: 6
    • View Profile
Code: [Select]
User-agent: *
Disallow: /

Save that as robots.txt, and put it on the root of your hosting directory
« Last Edit: July 26, 2007, 10:29:18 PM by dA CLOwN »
Laterz, dA CLOwN


Offline teeburd105

  • Occasional poster
  • *
    • Posts: 2
    • View Profile
I've made the robot.txt file, but I don't use virtual folders, so where on my hard drive do I place it?
Is there an ini file i've missed?

tony


Offline Giant Eagle

  • Tireless poster
  • ****
    • Posts: 535
  • >=3 RAWR!
    • View Profile
    • RAWR-Designs.com
decide for yourself, doesnt really matter. Just drag the file to the root of your VFS.


Offline rejetto

  • Administrator
  • Tireless poster
  • *****
    • Posts: 13308
    • View Profile
the home is like a folder, you can add anything in it.

and, for your information... surprise, you can add files to real folders too. it will display its content from the disk plus the added file.


Offline Tuskenraider

  • Occasional poster
  • *
    • Posts: 74
    • View Profile
Code: [Select]
User-agent: *
Disallow: /

Save that as robots.txt, and put it on the root of your hosting directory

thanks M8

tuskenraider
pfffssshhh i dont need a signature...