[ https://issues.apache.org/jira/browse/ARROW-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16911454#comment-16911454 ]
David Alphus commented on ARROW-6301: ------------------------------------- When recompiling I got a segfault during atexit. Not totally sure if this is a separate issue. {code:java} Program terminated with signal SIGSEGV, Segmentation fault. #0 0x00007fc08437576d in accept () at ../sysdeps/unix/syscall-template.S:84 84 ../sysdeps/unix/syscall-template.S: No such file or directory. [Current thread is 1 (Thread 0x7fc07e2f6700 (LWP 28153))] (gdb) thread apply all btThread 6 (Thread 0x7fc06249a700 (LWP 28169)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007fc0625134d8 in th_worker (tidptr=<optimized out>) at numexpr/module.cpp:59 #2 0x00007fc08436c6ba in start_thread (arg=0x7fc06249a700) at pthread_create.c:333 #3 0x00007fc08333b41d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109Thread 5 (Thread 0x7fc061498700 (LWP 28171)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007fc0625134d8 in th_worker (tidptr=<optimized out>) at numexpr/module.cpp:59 #2 0x00007fc08436c6ba in start_thread (arg=0x7fc061498700) at pthread_create.c:333 #3 0x00007fc08333b41d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109Thread 4 (Thread 0x7fc060c97700 (LWP 28172)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007fc0625134d8 in th_worker (tidptr=<optimized out>) at numexpr/module.cpp:59 #2 0x00007fc08436c6ba in start_thread (arg=0x7fc060c97700) at pthread_create.c:333 #3 0x00007fc08333b41d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109Thread 3 (Thread 0x7fc08477a700 (LWP 28151)): #0 _dl_fini () at dl-fini.c:180 #1 0x00007fc08326dff8 in __run_exit_handlers (status=1, listp=0x7fc0835f85f8 <__exit_funcs>, run_list_atexit=run_list_atexit@entry=true) at exit.c:82 #2 0x00007fc08326e045 in __GI_exit (status=<optimized out>) at exit.c:104 #3 0x000000000041b72f in uwsgi_exit () #4 0x0000000000469a81 in uwsgi_segfault () #5 <signal handler called> #6 0x00007fc0646a47aa in std::_Hashtable<std::string, std::pair<std::string const, std::shared_ptr<arrow::ExtensionType> >, std::allocator<std::pair<std::string const, std::shared_ptr<arrow::ExtensionType> > >, std::__detail::_Select1st, std::equal_to<std::string>, std::hash<std::string>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true> >::_M_find_before_node(unsigned long, std::string const&, unsigned long) const () from /home/alpha/.virtualenvs/uwsgi/lib/libarrow.so.14 #7 0x00007fc0646a4864 in std::_Hashtable<std::string, std::pair<std::string const, std::shared_ptr<arrow::ExtensionType> >, std::allocator<std::pair<std::string const, std::shared_ptr<arrow::ExtensionType> > >, std::__detail::_Select1st, std::equal_to<std::string>, std::hash<std::string>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true> >::find(std::string const&) () from /home/alpha/.virtualenvs/uwsgi/lib/libarrow.so.14 #8 0x00007fc0646a2624 in arrow::UnregisterExtensionType(std::string const&) () from /home/alpha/.virtualenvs/uwsgi/lib/libarrow.so.14 #9 0x00007fc0641976fd in arrow::py::UnregisterPyExtensionType() () from /home/alpha/.virtualenvs/uwsgi/lib/libarrow_python.so.14 #10 0x00007fc064db8486 in __pyx_pw_7pyarrow_3lib_91_unregister_py_extension_type(_object*, _object*) () from /home/alpha/.virtualenvs/uwsgi/lib/python2.7/site-packages/pyarrow/lib.so #11 0x00007fc08394630f in PyEval_EvalFrameEx () from /home/alpha/.virtualenvs/uwsgi/lib/libpython2.7.so.1.0 #12 0x00007fc083948fe8 in PyEval_EvalCodeEx () from /home/alpha/.virtualenvs/uwsgi/lib/libpython2.7.so.1.0 #13 0x00007fc0838bd3e9 in ?? () from /home/alpha/.virtualenvs/uwsgi/lib/libpython2.7.so.1.0 #14 0x00007fc08388c773 in PyObject_Call () from /home/alpha/.virtualenvs/uwsgi/lib/libpython2.7.so.1.0 #15 0x00007fc08393ee57 in PyEval_CallObjectWithKeywords () from /home/alpha/.virtualenvs/uwsgi/lib/libpython2.7.so.1.0 #16 0x00007fc08396d764 in Py_Finalize () from /home/alpha/.virtualenvs/uwsgi/lib/libpython2.7.so.1.0 #17 0x000000000046549d in uwsgi_plugins_atexit () #18 0x00007fc08326dff8 in __run_exit_handlers (status=30, listp=0x7fc0835f85f8 <__exit_funcs>, run_list_atexit=run_list_atexit@entry=true) at exit.c:82 #19 0x00007fc08326e045 in __GI_exit (status=<optimized out>) at exit.c:104 #20 0x000000000041b72f in uwsgi_exit () #21 0x00000000004655d5 in end_me () #22 <signal handler called> #23 0x00007fc08333ba13 in epoll_wait () at ../sysdeps/unix/syscall-template.S:84 #24 0x0000000000458ea2 in event_queue_wait () #25 0x000000000041d241 in wsgi_req_accept () #26 0x0000000000461c67 in simple_loop_run () #27 0x000000000046a3f4 in uwsgi_ignition () #28 0x000000000046a7a0 in uwsgi_worker_run () #29 0x000000000046ace5 in uwsgi_run () #30 0x00007fc083254830 in __libc_start_main (main=0x46acf0 <main>, argc=6, argv=0x7ffdd9a19348, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7ffdd9a19338) at ../csu/libc-start.c:291 #31 0x000000000041a3d9 in _start () ---Type <return> to continue, or q <return> to quit---Thread 2 (Thread 0x7fc061c99700 (LWP 28170)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007fc0625134d8 in th_worker (tidptr=<optimized out>) at numexpr/module.cpp:59 #2 0x00007fc08436c6ba in start_thread (arg=0x7fc061c99700) at pthread_create.c:333 #3 0x00007fc08333b41d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109Thread 1 (Thread 0x7fc07e2f6700 (LWP 28153)): #0 0x00007fc08437576d in accept () at ../sysdeps/unix/syscall-template.S:84 #1 0x0000000000481207 in uwsgi_python_tracebacker_thread () #2 0x00007fc08436c6ba in start_thread (arg=0x7fc07e2f6700) at pthread_create.c:333 #3 0x00007fc08333b41d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109 {code} > atexit: pyarrow.lib.ArrowKeyError: 'No type extension with name > arrow.py_extension_type found' > ---------------------------------------------------------------------------------------------- > > Key: ARROW-6301 > URL: https://issues.apache.org/jira/browse/ARROW-6301 > Project: Apache Arrow > Issue Type: Bug > Components: Python > Affects Versions: 0.14.1 > Environment: linux, virtualenv, uwsgi, cpython 2.7 > Reporter: David Alphus > Priority: Minor > > On interrupt, I am frequently seeing the atexit function failing in pyarrow > 0.14.1. > {code:java} > ^CSIGINT/SIGQUIT received...killing workers... > killing the spooler with pid 22640 > Error in atexit._run_exitfuncs: > Traceback (most recent call last): > File "/home/alpha/.virtualenvs/wsgi/lib/python2.7/atexit.py", line 24, in > _run_exitfuncs > func(*targs, **kargs) > File "pyarrow/types.pxi", line 1860, in > pyarrow.lib._unregister_py_extension_type > check_status(UnregisterPyExtensionType()) > File "pyarrow/error.pxi", line 91, in pyarrow.lib.check_status > raise ArrowKeyError(message) > ArrowKeyError: 'No type extension with name arrow.py_extension_type found' > Error in sys.exitfunc: > Traceback (most recent call last): > File "/home/alpha/.virtualenvs/wsgi/lib/python2.7/atexit.py", line 24, in > _run_exitfuncs > func(*targs, **kargs) > File "pyarrow/types.pxi", line 1860, in > pyarrow.lib._unregister_py_extension_type > File "pyarrow/error.pxi", line 91, in pyarrow.lib.check_status > pyarrow.lib.ArrowKeyError: 'No type extension with name > arrow.py_extension_type found' > spooler (pid: 22640) annihilated > worker 1 buried after 1 seconds > goodbye to uWSGI.{code} -- This message was sent by Atlassian Jira (v8.3.2#803003)