Hi John, thanks for the patch. I seems to be working correctly on data I have now. However, I do not have a solid test case, since it failed during long processing of a few terrabytes of data. I'll get back on this in case something is not right.
Good work, Petr On Wed, Sep 3, 2014 at 11:48 PM, K. John Wu <[email protected]> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA512 > > Hi, Petr, > > An update using flock to ensure only one thread is writing an index > file has been implemented in SVN Revision 747. Please give it a try > if you are on a system that using posix file system. > > As for cleaning up the corrupt index files, you should be able to > using the command line tool 'ibis' to rebuild the indexes with an > additional flag of '-z' to zap away all existing index files. > > Good luck. > > John > > > > On 8/25/14 11:02 PM, Petr Velan wrote: > > Hello John, > > > > We've encountered an issue when using multiple instances of data > > access tool over the same data. When multiple instances try to build > > missing indexes for some query on the same data, they crash with > > segfault. The index is then in an undefined state and further attempts > > to query the data result in a crash as well. > > > > The solution is to build the indexes first and use the data as read > > only for multiple instances. However, in our use case, this is highly > > impractical. Is there any support for concurrent queries which create > > indexes on the fly in the FastBit library? Or any kind of locking for > > this use case? > > > > Thanks, > > Petr > > > > > > _______________________________________________ > > FastBit-users mailing list > > [email protected] > > https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users > > > -----BEGIN PGP SIGNATURE----- > Version: GnuPG/MacGPG2 v2.0.22 (Darwin) > Comment: GPGTools - https://gpgtools.org > > iF4EAREKAAYFAlQHjKQACgkQ4I69U3+CTfz3ggD/cQGk3jpQ3iwwcmCR1NyobOZ+ > 12tSa4pnbwpgm6yyIuMA/3NV4B6glboiLv5zwXu1JtmMLDswOdbS0js+ISfv1SXP > =k0hl > -----END PGP SIGNATURE----- > _______________________________________________ > FastBit-users mailing list > [email protected] > https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users >
_______________________________________________ FastBit-users mailing list [email protected] https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users
