After I create directory by myself I'm getting this error: 20161213 164633 [] * FAIL: [FAILED]: Retrying to add doc at path: /u/smoke/presub/logs/cit-fg-adr-neg-rtp.rajivg.1481639632.57959_cmode_1of1/010_cleanup/06_did_bad_happen/.lucyindex/1 : Folder '/u/smoke/presub/logs/cit-fg-adr-neg-rtp.rajivg.1481639632.57959_cmode_1of1/010_cleanup/06_did_bad_happen/.lucyindex/1' failed check 20161213 164633 [] * S_init_folder at core/Lucy/Index/Indexer.c line 263 20161213 164633 [] * at /usr/software/lib/perl5/site_perl/5.14.0/x86_64-linux-thread-multi/Lucy.pm line 122.
Please help I'm badly struck now. This error is intermittent I see mostly when NFS is loaded. Ideally retry should work but that is also not working. I also tried to limit the number of files in a directories to be scanned to 10 by putting a hack in my code but that is also not working. Thanks, Rajiv Gupta -----Original Message----- From: Gupta, Rajiv [mailto:rajiv.gu...@netapp.com] Sent: Monday, December 12, 2016 10:08 AM To: user@lucy.apache.org Subject: RE: [lucy-user] LUCY_Folder_Open_Out_IMP at core/Lucy/Store/Folder.c line 119 Can't open '/u/smoke/presub/logs/cit-fg-adr-neg-rtp.rajivg.1481473130.41339_cmode_1of1/.lucyindex/1/seg_fd/lexicon-7.ixix': Invalid argument 20161211 182109 [] * LUCY_FSFolder_Local_Open_FileHandle_IMP at core/Lucy/Store/FSFolder.c line 118 20161211 182109 [] * LUCY_Folder_Local_Open_In_IMP at core/Lucy/Store/Folder.c line 101 20161211 182109 [] * LUCY_Folder_Open_In_IMP at core/Lucy/Store/Folder.c line 75 There are two more failures they also failed due so similar reasons rename from '/u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/.lucyindex/1/schema.temp' to '/u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/.lucyindex/1/schema_e4.json' failed: No such file or directory Can't delete 'lexicon-3.ix' I believe all three are related to race condition while doing parallel indexing and should go away with retries. However my retries started failing with different error which is strange to me as if directory already exists shouldn't it skip from create attempt. 20161211 182109 [] * FAIL: [FAILED]: Retrying to add doc at path: /u/smoke/presub/logs/cit-fg-adr-neg-rtp.rajivg.1481473130.41339_cmode_1of1/.lucyindex/1 : Couldn't create directory '/u/smoke/presub/logs/cit-fg-adr-neg-rtp.rajivg.1481473130.41339_cmode_1of1/.lucyindex/1': No such file or directory 20161211 182109 [] * LUCY_FSFolder_Initialize_IMP at core/Lucy/Store/FSFolder.c line 102 So my all retry attempts were also failed. Now I have put one more condition on before Index creation if directory exists or not before retry :( My failure rate is now 7/10. Target to achieve at least 9/10. -Rajiv -----Original Message----- From: Nick Wellnhofer [mailto:wellnho...@aevum.de] Sent: Sunday, December 11, 2016 3:58 PM To: user@lucy.apache.org Subject: Re: [lucy-user] LUCY_Folder_Open_Out_IMP at core/Lucy/Store/Folder.c line 119 On 10/12/2016 17:25, Gupta, Rajiv wrote: > Any timeline when 0.6.1 will be released? 0.6.1 is on schedule to be released in a few days. Nick
