Re: Solr concurrent commit not updated
On 11-May-07, at 2:45 AM, David Xiao wrote: I have keep the id field be unique. Actually I found the problem is due to following Python code: P = subprocess.Popen(arguments, ) It seems that when the program ends, the sub-process started by that call is not finish yet. And I guess that's why staticis shows "commit but not adddoc" Anyone have similar issue? When a unix process terminates, its child processes are also terminated (well, it depends on exactly how you created them). Actually, I'm not sure about that on further thought. However, it is best to wait for your processes to complete. After spawning them all, you can use P.wait() to wait for the processes individually, or os.wait() to wait for any of them to complete. Of course, since you are using python anyway, it would be best to open () the xml file and post it yourself (threadedly if you want some concurrency). regards, -Mike
RE: Solr concurrent commit not updated
I have keep the id field be unique. Actually I found the problem is due to following Python code: P = subprocess.Popen(arguments, ) It seems that when the program ends, the sub-process started by that call is not finish yet. And I guess that's why staticis shows "commit but not adddoc" Anyone have similar issue? -Original Message- From: James liu [mailto:[EMAIL PROTECTED] Sent: Friday, May 11, 2007 11:32 AM To: solr-user@lucene.apache.org Subject: Re: Solr concurrent commit not updated u should know id is unique number. 2007/5/11, David Xiao <[EMAIL PROTECTED]>: > > Hello all, > > > > I have tested by use post.sh in example directory to add xml documents > into solr. It works when I add one by one. > > But when I have a lot of .xml file to be posted (say about 500-1000 files) > and I wrote a shell script to call post.sh one by one. I found those xml > files are not searchable after post. > > > > But from solr admin page / statistics I found that it records commited > numbers. But numDocs is not updated. > > So why, when I use post.sh to post one xml it will be fine, but if I use > post.sh for 500 times, each time one xml will be different behavior? > > > > Regards, > > David > > -- regards jl
Re: Solr concurrent commit not updated
u should know id is unique number. 2007/5/11, David Xiao <[EMAIL PROTECTED]>: Hello all, I have tested by use post.sh in example directory to add xml documents into solr. It works when I add one by one. But when I have a lot of .xml file to be posted (say about 500-1000 files) and I wrote a shell script to call post.sh one by one. I found those xml files are not searchable after post. But from solr admin page / statistics I found that it records commited numbers. But numDocs is not updated. So why, when I use post.sh to post one xml it will be fine, but if I use post.sh for 500 times, each time one xml will be different behavior? Regards, David -- regards jl
