Re: FTP mount crash when crawling with solrj

2011-12-28 Thread Chris Hostetter

: I have a lots of files in my FTP account,and i use the curlftpfs to mount
: them to folder and then start index them with solrj api, but after a minutes
: pass something strange happen and the mounted folder is not accessible and
: crash,also i can not unmount it and the message device is in use appear,
: my solrj code is OK and i test it with my local files and the result is
: great but indexing mounted folder is my terrible problem, i mention that i
: use the curlftpfs with both centOS,fedora and Ubuntu but the result of
: crashing is the same,how can i fix this problem? is the problem with the my
: code? is sombody have ever face this problem when indexed of mounted folder?

No one can guess if something is wrong with your code (or what the problem 
might be) since you haven't posted any code.  

Since the problem seems to be entirely related to crawling this special 
mount, independent of submitting the docs to Solr, i would suggest that 
you tweak your code to just do the crawling, and write log files about 
what it finds (w/o ever sending the data to Solr), and see if that still 
has the problem -- if it does, then it sounds like your problem is 
definitely related to your own code, and has nothing to do with Solr.

off the cuff, i would guess that maybe you aren't closing all the 
files/filehandles that you open.

-Hoss


FTP mount crash when crawling with solrj

2011-12-12 Thread hadi
I have a lots of files in my FTP account,and i use the curlftpfs to mount
them to folder and then start index them with solrj api, but after a minutes
pass something strange happen and the mounted folder is not accessible and
crash,also i can not unmount it and the message device is in use appear,
my solrj code is OK and i test it with my local files and the result is
great but indexing mounted folder is my terrible problem, i mention that i
use the curlftpfs with both centOS,fedora and Ubuntu but the result of
crashing is the same,how can i fix this problem? is the problem with the my
code? is sombody have ever face this problem when indexed of mounted folder?



--
View this message in context: 
http://lucene.472066.n3.nabble.com/FTP-mount-crash-when-crawling-with-solrj-tp3580982p3580982.html
Sent from the Solr - User mailing list archive at Nabble.com.