Hi, I've been using pylucene 4.8.0-1(the latest release) to index a lot of data(~100GB) on a machine with 16GB of memory. After the index reaches 3GB the following C++ run-time exception is being thrown:
terminate called after throwing an instance of 'std::bad_alloc' what(): std::bad_alloc Aborted I was able to recover a stacktrace with gdb(using the core dump file and the python binary) which I'm attaching to this e-mail. Has anyone bumped into this before ? P.S. I've tried using jira to report this but I get "session timed out" when I'm trying to create a new account.
Program terminated with signal 6, Aborted. #0 0x00007f353c396425 in __GI_raise (sig=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 64 ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory. (gdb) bt #0 0x00007f353c396425 in __GI_raise (sig=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 #1 0x00007f353c399b8b in __GI_abort () at abort.c:91 #2 0x00007f353b5c969d in __gnu_cxx::__verbose_terminate_handler() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6 #3 0x00007f353b5c7846 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6 #4 0x00007f353b5c7873 in std::terminate() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6 #5 0x00007f353b5c796e in __cxa_throw () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6 #6 0x00007f353b5c7e4d in operator new(unsigned long) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6 #7 0x00007f353b5c7f09 in operator new[](unsigned long) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6 #8 0x00007f353daaa44a in JCCEnv::fromPyString(_object*) const () from /home/user/.local/lib/python2.7/site-packages/libjcc.so #9 0x00007f353ae5cf60 in p2j(_object*) () from /home/user/.local/lib/python2.7/site-packages/lucene-4.8.0-py2.7-linux-x86_64.egg/lucene/_lucene.so #10 0x00007f353ae6356d in _parseArgs(_object**, unsigned int, char*, ...) () from /home/user/.local/lib/python2.7/site-packages/lucene-4.8.0-py2.7-linux-x86_64.egg/lucene/_lucene.so #11 0x00007f353abf4479 in org::apache::lucene::document::t_Field_init_(org::apache::lucene::document::t_Field*, _object*, _object*) () from /home/user/.local/lib/python2.7/site-packages/lucene-4.8.0-py2.7-linux-x86_64.egg/lucene/_lucene.so #12 0x00000000004df6d6 in ?? () #13 0x00000000004d91b6 in PyObject_Call () #14 0x000000000054c0da in PyEval_EvalFrameEx () #15 0x000000000054c272 in PyEval_EvalFrameEx () #16 0x0000000000575d92 in PyEval_EvalCodeEx () #17 0x0000000000577ab0 in ?? () #18 0x00000000004d91b6 in PyObject_Call () #19 0x00000000004c91fa in ?? () #20 0x00000000004d91b6 in PyObject_Call () #21 0x0000000000510b7e in ?? () #22 0x00000000004df6d6 in ?? () #23 0x00000000004d91b6 in PyObject_Call () #24 0x000000000054c0da in PyEval_EvalFrameEx () #25 0x0000000000575d92 in PyEval_EvalCodeEx () #26 0x00000000004c1352 in PyRun_SimpleFileExFlags () #27 0x00000000004c754f in Py_Main () #28 0x00007f353c38176d in __libc_start_main (main=0x41ba10 <main>, argc=3, ubp_av=0x7fffeaae0008, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7fffeaadfff8) at libc-start.c:226 #29 0x000000000041ba41 in _start ()