On Thu, 6 Apr 2006 10:13:59 +0300 (EEST) <[EMAIL PROTECTED]> wrote: > The site like www.pricegrabber.com and like other price comparison > sites. I would like to index the products information from several > online trade sites and store in them one database. After that, the > user should able to compare each products while looking the several > stores together.
I have not tried this with htdig, but I did try to help someone setting up such a search when I was supporting a commercial search engine/database. The short answer is: forget it. The slightly longer answer is that in order to make it work in any sensible way you are going to have to study the html produced by each store site and figure out how to make the query, and also how to interpret the result. You have to do this for every store, and also do it again when a store changes either its own search or catalogue method, or changes its results format. You will need to index the store site at least once every 24 hours, which may annoy them somewhat. Looking at pricegrabber I think they send off the user's query to their affiliated stores each time, and there must be a commercial agreement behind it. > Or your ht://Dig can handle this regularly in a specific content ? > (Like mobile phone nokia 6681 indexing by terms of prices, > specifications, 256 mb ram indexing to a database from different > stores and etc..) I tried "mobile phone nokia 6681" on pricegrabber and got just two results -- both were for a phone *holder*, not the phone itself. I also tried my favourite shopping site search "girls bicycle", and saw that they returned results from just two vendors, which seemed to be part of the same group. And the bicycles were junk too..... It's hard, in fact it's very hard, to make these searches work properly from the end user's point of view. If you are getting a serious amount of money for doing it, then go ahead -- but remember that you also need money for the continuing maintenence effort to keep in step with the changes that the stores make. You also need to learn something more serious in programming languages with extensive libraries, Python is my choice, but if you can live with the syntax Perl would perform as well. Good luck! Mike -- Mike Causer Email - mailto:[EMAIL PROTECTED] GPG KeyID 1C2DDA07 WWW - http://www.mikecauser.com Flood the fen again! - Wicken Fen enlargement - http://www.wicken.org.uk ------------------------------------------------------- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642 _______________________________________________ ht://Dig general mailing list: <htdig-general@lists.sourceforge.net> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-general
