Feature request: stop search bots

[rejetto]

i asked what's exactly referring to, not the meaning of +1 itself.

Stopping spiders from following 'folder archive' links and downloading data, thus wasting precious resources. Your 'stop spiders' option would stop them completely.

does anyone know how the robots.txt should be to get this job done?

[Foggy]

maybe something like /*/~folder.tar under the not allow section?

[CBB]

i asked what's exactly referring to, not the meaning of +1 itself.

Stopping spiders from following 'folder archive' links and downloading data, thus wasting precious resources. Your 'stop spiders' option would stop them completely.

does anyone know how the robots.txt should be to get this job done?

I meant here to change attributes of references in the default template, not to add robots.txt. It would be usefull to add rel='nofollow" to "folder archive" references, see http://googleblog.blogspot.com/2005/01/preventing-comment-spam.html or http://en.wikipedia.org/wiki/Nofollow .

[rejetto]

AFAIK nofollow doesn't stop spiders.
stops the rank propagation.
i think it has truly no meaning on folder archives.

[day]

the stop spiders function doesn't work..
try this http://www.google.com/webmasters/tools/ and you will understand..