rejetto forum

Stop Spiders from Indexing

0 Members and 1 Guest are viewing this topic.

Offline maverick

  • Tireless poster
  • ****
    • Posts: 1052
  • Computer Solutions
    • View Profile

Does anyone know how to stop spiders from indexing a https site?

robots.txt and <META NAME="ROBOTS" CONTENT="NOINDEX,NOFOLLOW"> only work for a http site.

Anyone know.  ???
maverick


Offline ~GeeS~

  • Tireless poster
  • ****
    • Posts: 269
  • "The web was made for sharing..."
    • View Profile
I would make all subdirectories passwordprotected/login and put the user:pass in a gif /jpg. Only humans can read and login, keeps the spiders stuck on your first page.
~GeeS~


Offline maverick

  • Tireless poster
  • ****
    • Posts: 1052
  • Computer Solutions
    • View Profile