Re: Solr Index problem
Are you committing? You have to commit for them to be actually added…. If DIH says it did not add any documents (added 0 documents) committing won't help. Likely, there is a problem with the mapping between DIH and the schema so that none of the fields make it into the index. We would need the DIH and the schema file, as Andy pointed out already. Cheers, Chantal -Original Message- From: ranmatrix S [mailto:ranmat...@gmail.com] Sent: Thursday, August 23, 2012 5:46 PM To: solr-user@lucene.apache.org Subject: Solr Index problem Hi, I have setup Solr to index data from Oracle DB through DIH handler. However through Solr admin I could see the DB connection is successfull, data retrieved from DB to Solr but not added into index. The message is that 0 documents added even when I am able to see that 9 records are returned back. The schema and fields in db-data-config.xml are one and the same. Please suggest if anything I should look for. -- Regards, Ran...
Re: Solr Index problem
Have you investigated the logs of your servlet container? There's probably some explanation for why the documents weren't submitted in there. Michael Della Bitta Appinions | 18 East 41st St., Suite 1806 | New York, NY 10017 www.appinions.com Where Influence Isn’t a Game On Thu, Aug 23, 2012 at 5:46 PM, ranmatrix S ranmat...@gmail.com wrote: Hi, I have setup Solr to index data from Oracle DB through DIH handler. However through Solr admin I could see the DB connection is successfull, data retrieved from DB to Solr but not added into index. The message is that 0 documents added even when I am able to see that 9 records are returned back. The schema and fields in db-data-config.xml are one and the same. Please suggest if anything I should look for. -- Regards, Ran...
Re: Solr Index problem
On Aug 23, 2012, at 4:46 PM, ranmatrix S ranmat...@gmail.com wrote: The schema and fields in db-data-config.xml are one and the same. Please attach or post both the schema and the DIH config XML files so we can see them. The DIH can be pretty tricky. You say you can see 9 records are returned back. How do you see that? xoa -- Andy Lester = a...@petdance.com = www.petdance.com = AIM:petdance
RE: Solr Index problem
Are you committing? You have to commit for them to be actually added -Original Message- From: ranmatrix S [mailto:ranmat...@gmail.com] Sent: Thursday, August 23, 2012 5:46 PM To: solr-user@lucene.apache.org Subject: Solr Index problem Hi, I have setup Solr to index data from Oracle DB through DIH handler. However through Solr admin I could see the DB connection is successfull, data retrieved from DB to Solr but not added into index. The message is that 0 documents added even when I am able to see that 9 records are returned back. The schema and fields in db-data-config.xml are one and the same. Please suggest if anything I should look for. -- Regards, Ran...
Re: solr index problem
On 7/18/07, Otis Gospodnetic [EMAIL PROTECTED] wrote: Why? Too small of a Java heap. :) Increase the size of the Java heap and lower the maxBufferedDocs number in solrconfig.xml and then try again. If it only happens after a lot of docs, it's probably not maxBufferedDocs, but when a big luicene merge is triggered. -Yonik
Re: solr index problem
On 18-Jul-07, at 11:47 AM, Yonik Seeley wrote: On 7/18/07, Otis Gospodnetic [EMAIL PROTECTED] wrote: Why? Too small of a Java heap. :) Increase the size of the Java heap and lower the maxBufferedDocs number in solrconfig.xml and then try again. If it only happens after a lot of docs, it's probably not maxBufferedDocs, but when a big luicene merge is triggered. Could happen when doDeleting the pending docs too. James: try sending commit every 500k docs or so. -Mike
Re: solr index problem
On 18-Jul-07, at 2:58 PM, Yonik Seeley wrote: On 7/18/07, Mike Klaas [EMAIL PROTECTED] wrote: Could happen when doDeleting the pending docs too. James: try sending commit every 500k docs or so. Hmmm, right... some of the memory usage will be related to the treemap keeping track of deleted items, and some of it will be related to the reader itself (the term index, and the norms). Perhaps we should have some sort of limit on the number of deletions we cache so people don't have to worry about that part. I logged this in http://issues.apache.org/jira/browse/SOLR-310 Perhaps a solrconfig.xml setting, maxPendingDocs? Default to 100k? I have experienced this from time to time... it is one of the reasons I fastidiously wipe the index and restart solr before reindexing. -Mike
Re: solr index problem
I correct it,,,i index 17M docs. not 1.7M,,,so OutOfMemory happen when it finish index ~11.3m docs It is new index. i think it maybe the reason: On 7/18/07, Otis Gospodnetic [EMAIL PROTECTED] wrote: Why? Too small of a Java heap. :) Increase the size of the Java heap and lower the maxBufferedDocs number in solrconfig.xml and then try again. If it only happens after a lot of docs, it's probably not maxBufferedDocs, but when a big luicene merge is triggered. 2007/7/19, Mike Klaas [EMAIL PROTECTED]: On 18-Jul-07, at 2:58 PM, Yonik Seeley wrote: On 7/18/07, Mike Klaas [EMAIL PROTECTED] wrote: Could happen when doDeleting the pending docs too. James: try sending commit every 500k docs or so. Hmmm, right... some of the memory usage will be related to the treemap keeping track of deleted items, and some of it will be related to the reader itself (the term index, and the norms). Perhaps we should have some sort of limit on the number of deletions we cache so people don't have to worry about that part. I logged this in http://issues.apache.org/jira/browse/SOLR-310 Perhaps a solrconfig.xml setting, maxPendingDocs? Default to 100k? I have experienced this from time to time... it is one of the reasons I fastidiously wipe the index and restart solr before reindexing. aha，，me too。 -Mike -- regards jl
