Login
Register
Menu
Home
Help
Search
rejetto forum
PROBLEMS? QUESTIONS? CLICK HERE!
rejetto forum
»
Software
»
HFS ~ HTTP File Server
»
Stop Spiders from Indexing
Stop Spiders from Indexing
maverick
·
3 ·
3412
« previous
next »
Print
Pages:
1
0 Members and 1 Guest are viewing this topic.
maverick
Tireless poster
Posts:
1052
Computer Solutions
Stop Spiders from Indexing
on:
September 03, 2006, 12:39:22 PM
Does anyone know how to stop spiders from indexing a https site?
robots.txt and <META NAME="ROBOTS" CONTENT="NOINDEX,NOFOLLOW"> only work for a http site.
Anyone know.
maverick
~GeeS~
Tireless poster
Posts:
269
"The web was made for sharing..."
Re: Stop Spiders from Indexing
Reply #1 on:
September 03, 2006, 04:06:41 PM
I would make all subdirectories passwordprotected/login and put the user:pass in a gif /jpg. Only humans can read and login, keeps the spiders stuck on your first page.
~GeeS~
maverick
Tireless poster
Posts:
1052
Computer Solutions
Re: Stop Spiders from Indexing
Reply #2 on:
September 03, 2006, 11:06:17 PM
Thanks.
maverick
Print
Pages:
1
rejetto forum
»
Software
»
HFS ~ HTTP File Server
»
Stop Spiders from Indexing
Search
Username
Password
Always stay logged in
Forgot your password?