Once again robots.txt is your friend... It tells the spiders where to look and where NOT to look...
Dawesi -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Andrew Scott Sent: Wednesday, 13 July 2005 12:05 PM To: CFAussie Mailing List Subject: [cfaussie] RE: Search Engines Technically I am not doing a redirect. And they would not know that they are getting a redirect, it's to block them from opening certain parts of the site. The meta tags don't stop them, and they seem to be indexing certain files that are not even in the site? Regards Andrew Scott Analyst Programmer CMS Transport Systems Level 2/33 Bank Street South Melbourne, Victoria, 3205 Phone: 03 9699 7988 - Fax: 03 9699 7976 -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Steve Onnis Sent: Wednesday, 13 July 2005 11:55 AM To: CFAussie Mailing List Subject: [cfaussie] RE: Search Engines The same way CFHTTP knows if your doing a redirect HTTP headers They can also detect javascript redirects aswell -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Behalf Of Brett Payne-Rhodes Sent: Wednesday, July 13, 2005 11:49 AM To: CFAussie Mailing List Subject: [cfaussie] RE: Search Engines How would they know? B) TRACEY, Darren wrote: > However noble your intentions may be, search engines take a _very_ dim view > of this type of behaviour. > > Regards > > Darren Tracey > Systems Analyst > HR Systems and FastTrack > Wealth and Corporate Systems > Suncorp > p: + 61 7 3232 4091 (x64091) > f: + 61 7 3232 4744 > e: [EMAIL PROTECTED] > l: Lvl 3, 388 Queen St Brisbane QLD 4000 > m: Suncorp IPC IT048, GPO Box 1453, Brisbane QLD 4000 > > > >>-----Original Message----- >>From: Andrew Scott >>Sent: Wednesday, 13 July 2005 11:27 AM >>To: CFAussie Mailing List >>Subject: [cfaussie] Search Engines >> >> >>Does anyone have a link that I could browse to get a list of known >>search engines, spiders and bots that could crawl through a web site? >> >>I am looking at identifying these and pushing them to another part of >>a website. Any help would be appreciated, I have done a quick search >>through Google but not come up with anything concrete yet. >> >> >>Regards >>Andrew Scott >>Analyst Programmer >> >>CMS Transport Systems >>Level 2/33 Bank Street >>South Melbourne, Victoria, 3205 >> >>Phone: 03 9699 7988 - Fax: 03 9699 7976 >> >> >> >>--- >>You are currently subscribed to cfaussie as: >>[EMAIL PROTECTED] To unsubscribe send a blank email to >>[EMAIL PROTECTED] >>Aussie Macromedia Developers: http://lists.daemon.com.au/ > > > ---------------------------------------------------------------------- > ---- --------- > This e-mail is sent by Suncorp-Metway Limited ABN 66 010 831 722 or > one of its related entities "Suncorp". > > Suncorp may be contacted at Level 18, 36 Wickham Terrace, Brisbane or > on 13 11 55 or at suncorp.com.au. > > The content of this e-mail is the view of the sender or stated author > and does not necessarily reflect the view of Suncorp. The content, including attachments, is a confidential communication between Suncorp and the intended recipient. If you are not the intended recipient, any use, interference with, disclosure or copying of this e-mail, including attachments, is unauthorised and expressly prohibited. If you have received this e-mail in error please contact the sender immediately and delete the e-mail and any attachments from your system. > > If this e-mail constitutes a commercial message of a type that you no longer wish to receive please reply to this e-mail by typing Unsubscribe in the subject line. > > > --- > You are currently subscribed to cfaussie as: [EMAIL PROTECTED] To > unsubscribe send a blank email to [EMAIL PROTECTED] > Aussie Macromedia Developers: http://lists.daemon.com.au/ > --- You are currently subscribed to cfaussie as: [EMAIL PROTECTED] To unsubscribe send a blank email to [EMAIL PROTECTED] Aussie Macromedia Developers: http://lists.daemon.com.au/ --- You are currently subscribed to cfaussie as: [EMAIL PROTECTED] To unsubscribe send a blank email to [EMAIL PROTECTED] Aussie Macromedia Developers: http://lists.daemon.com.au/ --- You are currently subscribed to cfaussie as: [EMAIL PROTECTED] To unsubscribe send a blank email to [EMAIL PROTECTED] Aussie Macromedia Developers: http://lists.daemon.com.au/ ---------------------------------------------------- This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. Please note that any views or opinions presented in this email are solely those of the author and do not necessarily represent those of the company. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. ---------------------------------------------------- --- You are currently subscribed to cfaussie as: [email protected] To unsubscribe send a blank email to [EMAIL PROTECTED] Aussie Macromedia Developers: http://lists.daemon.com.au/
