How to Use Nutch to Crawl Database?

2005-10-29 Thread Victor Lee
Hi, How do I use Nutch to crawl internal database instead of web server? Does Nutch even support this option? Many thanks. __ Yahoo! FareChase: Search multiple travel sites in one click. http://farechase.yahoo.com --

I Need System Design Suggestion. Please.

2005-11-04 Thread Victor Lee
Hi, I am going to use mysql db to store some data, use lucene(java) to index these data, and use Hibernate to map them. I was originally thinking of using PHP to input the data the visitors enter into the mysql db. But if I use PHP and use mysql statement directly, it may defeat the part of the pur

Is There Other Ports of Nutch?

2005-11-05 Thread Victor Lee
Hi, I know that there are several ports of Lucene, like cLucene, pLucene, etc. Are there other ports of Nutch besides java? Many thanks. __ Yahoo! Mail - PC Magazine Editors' Choice 2005 http://mail.yahoo.com ---

Best Way To Index Database Using Lucene?

2005-11-06 Thread Victor Lee
Hi, I use php and mysql. The visitors enters data through the web and the data is stored in the database. I want to make portions of that data to be searchable using Lucene. I am thinking of giving that data to Lucene for indexing at the same time of inputing that same data into the database

Re: Best Way To Index Database Using Lucene?

2005-11-06 Thread Victor Lee
I forgot to mention that if I use php-java-bridge to use Lucene to index at the same time I input the data into the mysql db, I don't even need to use JDBC. If I index inside the business logic layer which is java, then I will have to use JDBC. --- Victor Lee <[EMAIL PROTECTED]> w

Is It a Good Idea to Save Frequently Search Results in Database to Make It Faster?

2005-11-24 Thread Victor Lee
Hi, I use Lucene to index stuff that are changed very often but don't need to be real-time to searchers. e.g. the search result can be changed couple times per minute, but I only need to show the change every 5 minutes or so. Is it a good idea to save the search result to a database like m

Re: Is It a Good Idea to Save Frequently Search Results in Database to Make It Faster?

2005-11-24 Thread Victor Lee
Sorry, actually I meant all search results, not just frequent results. And there is only one search term per search, it's the stuff that belongs to the search terms change often. Victor Lee <[EMAIL PROTECTED]> wrote: Hi, I use Lucene to index stuff that are changed very ofte

Re: Is It a Good Idea to Save Frequently Search Results in Database to Make It Faster?

2005-11-24 Thread Victor Lee
re searcher.search(Query) using a basic query type like TermQuery, I very seriously doubt you'd beat MySQL performance. What kind of Query are you using for your searches? Erik On 24 Nov 2005, at 17:54, Victor Lee wrote: > Sorry, actually I meant all search results, not just frequent

Re: Is It a Good Idea to Save Frequently Search Results in Database to Make It Faster?

2005-11-25 Thread Victor Lee
I'd put my money on Lucene beating MySQL in the TermQuery scenario you described (e=hello) ;) But you'd be wise to step out of design mode and get some real-world tests going. And even if there is a performance difference, we're talking milliseconds most likely. Erik On 24 No

How to Use Memoryindex for Lots of Queries With Sort?

2005-11-27 Thread Victor Lee
Hi, I am using Memeoryindex as described here: http://dsd.lbl.gov/nux/api/org/apache/lucene/index/memory/MemoryIndex.html . I am using it to match lots(10 thousands) of queries with one document. Then I want to rank them based on score and some other variables. I want to know if there i