Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0
I would like to suggest that visitors login to a site when they first enter
it. Presently I check to see if they have a user scoped userid. If they
don't I set it to the session cookie userreference. So I was thinking that
if they didn't
Fogelson, Steve wrote:
Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0
I would like to suggest that visitors login to a site when they first enter
it. Presently I check to see if they have a user scoped userid. If they
don't I set it to the session cookie userreference. So I was
Create a robots.txt file and add it to the top of the heiarchy of the
site. In the robots.txt file, add the following
User-agent: *
Disallow: DoNotCrawlThisPage.taf
The DoNotCrawlThisPage.taf is the page you do not want robots to crawl.
Hope this helps
Fogelson, Steve wrote:
Windows
Regarding spiders, you can validate @CGIPARAM NAME=USER_AGENT against
a list of acceptable bots, though this is easily spoofed.
Unless you're using https, subsequent HTTP requests will present the
cookies in clear text. (Same is true for HTTP authentication). But
since it's acceptable for
would he be able to arguments to that file like the following?
Disallow: MightNotCrawl.taf?status=SuggestLogin
/John
[EMAIL PROTECTED] wrote:
Create a robots.txt file and add it to the top of the heiarchy of the
site. In the robots.txt file, add the following
User-agent: *
Disallow:
To: [EMAIL PROTECTED]
Subject: Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
Create a robots.txt file and add it to the top of the heiarchy of the
site. In the robots.txt file, add the following
User-agent: *
Disallow: DoNotCrawlThisPage.taf
The DoNotCrawlThisPage.taf is the page you do
To: [EMAIL PROTECTED]
Subject: Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
Fogelson, Steve wrote:
Windows 2003 Web Edition IIS 6.0, R:Tango 5, Oterro 3.0
I would like to suggest that visitors login to a site when they first enter
it. Presently I check to see if they have a user scoped
Never tried this, but remember, robots will only craw actual a href
urls. So if you have a url that is
a href=MightNotCrawl.taf?status=SuggestLogin anywhere on the
site, it is possible for the robot to crawl. I don't see why this
would not work.
would he be able to arguments to that file like
a cookie or userid,
wouldn't that stop the spider from crawling the site?
Steve
-Original Message-
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]
Sent: Thursday, March 18, 2004 9:09 AM
To: [EMAIL PROTECTED]
Subject: Re: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
Create
]
Subject: RE: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
I believe that redirect is the important phrase here. Are you
talking an actual meta redirect? or a branch. If using a meta
redirect, the robot will only follow a 301 permanent redirect,
otherwise it stops.
I have a routine
a class file? If so, will it execute the rest of the calling taf
file?
Steve
-Original Message-
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]
Sent: Thursday, March 18, 2004 9:45 AM
To: [EMAIL PROTECTED]
Subject: RE: Witango-Talk: Login/Affiliates/Cookies/Spiders (OT)
I believe
11 matches
Mail list logo
