if theres a couple of days delay, doesn't it suggest that they are doing the
scrape and then adding it to their own DB (otherwise new properties would
appear immediately if they were using a GET)

If so, you could ban try banning their IP range, either through IIS or CF +
CGI vars

Did that here once and it solved the issue

-----Original Message-----
From: Peter Dray [mailto:[EMAIL PROTECTED]
Sent: 15 September 2003 14:58
To: [EMAIL PROTECTED]
Subject: RE: [ cf-dev ] Stopping 'db scrapes'


It definitely uses almost live data. Properties added to our database turn
up on theirs a day or so later.

This is us:     www.primelocation.com
This is them: www.propertysearch.com

If you can be arsed try the same property search on both

Please excuse the horrendous design, not guilty.



-----Original Message-----
From: Rich Wild [mailto:[EMAIL PROTECTED]
Sent: 15 September 2003 14:47
To: '[EMAIL PROTECTED]'
Subject: RE: [ cf-dev ] Stopping 'db scrapes'


> or hinder that in some manner -  as your "client" is in fact
> a tool that
> is " spoofing"  or mimicking a client browser it has to have in some
> Way a noticeable pattern to its behaviour

not necessarily. What if the competitor has just hired someone to sit there
and grab all the data using just a browser?


--
** Archive: http://www.mail-archive.com/dev%40lists.cfdeveloper.co.uk/

To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
For human help, e-mail: [EMAIL PROTECTED]


-- 
** Archive: http://www.mail-archive.com/dev%40lists.cfdeveloper.co.uk/

To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
For human help, e-mail: [EMAIL PROTECTED]

-- 
** Archive: http://www.mail-archive.com/dev%40lists.cfdeveloper.co.uk/

To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
For human help, e-mail: [EMAIL PROTECTED]

Reply via email to