Hi, Sunil, I see that your program generates random numbers, so I don't have to have additional data files from you. At this point in time, I am not able compile the FastBit4Java code. I won't have to time to work on this until next week end..
John On 10/27/12 12:43 AM, sunil kalva wrote: > FYI > > ---------------------------------------------------------------------- > From: [email protected] > To: [email protected] > Subject: RE: [FastBit-users] Segmentation fault with multiple threads > Date: Fri, 26 Oct 2012 22:16:12 +0530 > > John > PFA for my java test code, > depending on the system RAM play with the NO# of threads(THREADS=150), > and NO# of iterations (ITERATIONS=1000). > you will get following errors after few queries executed. > > Warning -- column[fastbit.c]::softWriteLock > -- pthread_rwlock_trywrlock(0x1001dae60) for unloadIndex returned > 16 (Resource busy) > > SunilKalva > > >> Date: Fri, 26 Oct 2012 07:58:34 -0700 >> From: [email protected] >> To: [email protected] >> Subject: Re: [FastBit-users] Segmentation fault with multiple threads >> >> Thanks for the information, but I need more information to do anything >> about your problems. Please provide a test case with java code, >> instructions, and test data. >> >> John >> >> >> On 10/26/12 7:49 AM, sunil kalva wrote: >> > >> > Iam using "https://github.com/gauravagarwal/fastbijava"; as my java >> > interface, >> > i still getting following errors with multithread calls, iam closing >> > fastbit object after every query. >> > >> > >> > > =================================================================================================== >> > >> > Invalid memory access of location 0x0 rip=0x11273f86c >> > >> > >> > Warning -- fileManager::unload yields to another thread already >> > waiting for memory ... >> > >> > Warning -- fileManager::storage::ctor unable to find 121,689,400 bytes >> > of space in memory >> > >> > Warning -- column[fastbit.gender]::softWriteLock -- >> > pthread_rwlock_trywrlock(0x1001dae60) for unloadIndex returned 16 >> > (Resource busy) >> > >> > >> > Warning -- fileManager::softWriteLock failed to acquire the write lock >> > (0x10dd47fc0) for fileManager::clear, error code = 16 >> > >> > >> > Warning -- part[fastbit]::gainWriteAccess -- >> > pthread_rwlock_trywrlock(0x102260020) for freeRIDs returned 16 >> > (Resource busy) >> > >> > Warning -- part[fastbit]::gainWriteAccess -- >> > pthread_rwlock_trywrlock(0x102260020) for freeRIDs returned 16 >> > (Resource busy) >> > >> > > =================================================================================================== >> > >> > >> > Please suggest me how should i fix these problems. >> > >> > >> > SunilKalva >> > >> > >> > >> >> Date: Thu, 25 Oct 2012 20:36:07 -0700 >> >> From: [email protected] >> >> To: [email protected] >> >> CC: [email protected] >> >> Subject: Re: [FastBit-users] Segmentation fault with multiple threads >> >> >> >> Hi, Sunil, >> >> >> >> Looks like the memory is not freed somewhere. The warning messages >> >> you included all point to this problem. This could happen in a a few >> >> different ways, >> >> >> >> - neglecting to destroy the query objects (by calling destroy_query) >> >> - memory leak in the JNI code >> >> - memory leak in the C API >> >> - memory leak in the C++ code (the core of FastBit) >> >> >> >> I would encourage you to destroy the query objects as soon as > possible >> >> in your program. The C API layer and the JNI code are not exercised >> >> nearly as much as the C++ code, so it is very possible that they >> >> contain some problems. I am willing to look into this, but would need >> >> some help from you. More specifically, I would need a small test case >> >> in java along with some test data. You can email them to me or put >> >> them in a place for me to pick them up. >> >> >> >> Thanks. >> >> >> >> John >> >> >> >> >> >> >> >> On 10/25/12 3:11 PM, sunil kalva wrote: >> >> > Hi >> >> > i get segmentation fault error, if i run queries from multiple > threads >> >> > using java API. and if restart it works for me for few queries and >> >> > again i face same problem. >> >> > >> >> > and i also following errors very frequently ...! >> >> > >> >> > Warning -- fileManager::storage::ctor unable to find 28 bytes > of space >> >> > in memory >> >> > >> >> > Warning -- part::init failed to read mask file >> >> > "/data/test/fastbit/2012-10-16-00/fastbit/-part.msk", assume > all rows >> >> > (32394899) are active >> >> > >> >> > com.globalpark.fastbit.exception.FastbitPartitionException: >> >> > storage::ctor(memory) failed >> >> > >> >> > >> >> > Warning -- part[fastbit]::gainWriteAccess -- >> >> > pthread_rwlock_trywrlock(0x102260020) for freeRIDs returned 16 >> >> > (Resource busy) >> >> > >> >> > Warning -- part[fastbit]::gainWriteAccess -- >> >> > pthread_rwlock_trywrlock(0x102260020) for freeRIDs returned 16 >> >> > (Resource busy) >> >> > >> >> > Warning -- fileManager::softWriteLock failed to acquire the > write lock >> >> > (0x10dd47fc0) for fileManager::clear, error code = 16 >> >> > >> >> > >> >> > t >> >> > SunilKalva >> >> > >> >> > >> >> > _______________________________________________ >> >> > FastBit-users mailing list >> >> > [email protected] >> >> > https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users >> >> > _______________________________________________ FastBit-users mailing list [email protected] https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users
