[issue35988] Python interpreter segfault
Hinko Kocevar added the comment: Thank you for the valuable information about the OOM beast.. -- ___ Python tracker <https://bugs.python.org/issue35988> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35988] Python interpreter segfault
Hinko Kocevar added the comment: Using python3.6 now. I've also used the 'handle SIGPIPE nostop noprint' to skip SIGPIPE. Now the interpreter is killed instead: INF 2019-02-13 15:42:19,131 web:2162 log_request - 200 GET /NPM.html (10.0.6.209) 1.10ms [Thread 0x7fffe76eb700 (LWP 8411) exited] [Thread 0x7fffe78ec700 (LWP 8410) exited] [Thread 0x7fffe7a2d700 (LWP 8409) exited] [Thread 0x7fffe7d41700 (LWP 8408) exited] [Thread 0x7fffe8542700 (LWP 8407) exited] Program terminated with signal SIGKILL, Killed. The program no longer exists. (gdb) bt No stack. (gdb) And the dmesg shows, what I think is the real reason, for python3.5/3.6 dying on me (out of memory): [26194250.313676] vmtoolsd invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0 [26194250.313691] vmtoolsd cpuset=/ mems_allowed=0 [26194250.313696] CPU: 0 PID: 29876 Comm: vmtoolsd Not tainted 3.10.0-693.21.1.el7.x86_64 #1 [26194250.313697] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016 [26194250.313698] Call Trace: [26194250.313714] [] dump_stack+0x19/0x1b [26194250.313717] [] dump_header+0x90/0x229 [26194250.313725] [] ? ktime_get_ts64+0x52/0xf0 [26194250.313733] [] ? delayacct_end+0x8f/0xb0 [26194250.313737] [] oom_kill_process+0x254/0x3d0 [26194250.313739] [] ? oom_unkillable_task+0xcd/0x120 [26194250.313740] [] ? find_lock_task_mm+0x56/0xc0 [26194250.313742] [] out_of_memory+0x4b6/0x4f0 [26194250.313744] [] __alloc_pages_slowpath+0x5d6/0x724 [26194250.313747] [] __alloc_pages_nodemask+0x405/0x420 [26194250.313752] [] alloc_pages_current+0x98/0x110 [26194250.313757] [] __page_cache_alloc+0x97/0xb0 [26194250.313759] [] filemap_fault+0x170/0x420 [26194250.313869] [] ext4_filemap_fault+0x36/0x50 [ext4] [26194250.313875] [] __do_fault+0x58/0xe0 [26194250.313876] [] do_read_fault.isra.44+0x4b/0x130 [26194250.313880] [] handle_mm_fault+0x691/0xfa0 [26194250.313888] [] ? cputime_adjust+0x94/0x150 [26194250.313893] [] __do_page_fault+0x154/0x450 [26194250.313894] [] do_page_fault+0x35/0x90 [26194250.313898] [] page_fault+0x28/0x30 [26194250.313912] Mem-Info: [26194250.313915] active_anon:317608 inactive_anon:106541 isolated_anon:0 active_file:836 inactive_file:1338 isolated_file:0 unevictable:0 dirty:0 writeback:0 unstable:0 slab_reclaimable:5892 slab_unreclaimable:7233 mapped:394 shmem:334 pagetables:5322 bounce:0 free:12861 free_pcp:12 free_cma:0 [26194250.313920] Node 0 DMA free:7624kB min:380kB low:472kB high:568kB active_anon:3680kB inactive_anon:3828kB active_file:4kB inactive_file:96kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15992kB managed:15908kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:4kB slab_reclaimable:96kB slab_unreclaimable:52kB kernel_stack:32kB pagetables:160kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:492 all_unreclaimable? yes [26194250.313925] lowmem_reserve[]: 0 1822 1822 1822 [26194250.313927] Node 0 DMA32 free:43820kB min:44672kB low:55840kB high:67008kB active_anon:1266752kB inactive_anon:422336kB active_file:3340kB inactive_file:5256kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:2080704kB managed:1867756kB mlocked:0kB dirty:0kB writeback:0kB mapped:1572kB shmem:1332kB slab_reclaimable:23472kB slab_unreclaimable:28880kB kernel_stack:3200kB pagetables:21128kB unstable:0kB bounce:0kB free_pcp:48kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:11345 all_unreclaimable? yes [26194250.313930] lowmem_reserve[]: 0 0 0 0 [26194250.313932] Node 0 DMA: 4*4kB (UEM) 9*8kB (UEM) 9*16kB (UEM) 3*32kB (E) 2*64kB (UE) 2*128kB (UE) 3*256kB (UM) 4*512kB (UEM) 4*1024kB (EM) 0*2048kB 0*4096kB = 7624kB [26194250.313939] Node 0 DMA32: 386*4kB (E) 482*8kB (UE) 324*16kB (UEM) 247*32kB (UEM) 157*64kB (UEM) 56*128kB (UEM) 18*256kB (UEM) 7*512kB (UEM) 0*1024kB 0*2048kB 0*4096kB = 43896kB [26194250.313945] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [26194250.313946] 3429 total pagecache pages [26194250.313947] 890 pages in swap cache [26194250.313950] Swap cache stats: add 52552391, delete 52551501, find 24707502/29312733 [26194250.313951] Free swap = 0kB [26194250.313951] Total swap = 2047996kB [26194250.313952] 524174 pages RAM [26194250.313953] 0 pages HighMem/MovableOnly [26194250.313953] 53258 pages reserved [26194250.313954] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name [26194250.313963] [ 564] 0 564 9307 371 23 46 0 systemd-journal [26194250.313965] [ 751]81 751 9244 104 21 89 -900 dbus-daemon [26194250.313967] [ 783] 0 783 138064 94 101 9333 0 NetworkManager [26194250.313968] [ 849] 0 849283430 58 3123 0 dhclient [26194250.313970] [ 1016] 0 1016 8818 35 19 236
[issue35988] Python interpreter segfault
Hinko Kocevar added the comment: > Are you able to reproduce the crash on Python 3.6 or 3.7? I'm running it under python3.6 as we speak. -- ___ Python tracker <https://bugs.python.org/issue35988> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35988] Python interpreter segfault
New submission from Hinko Kocevar : I'm running a tornado server with websockets client. Every now and then the python3.5 crashes, seg faults. I added code tracking (https://stackoverflow.com/questions/2663841/python-tracing-a-segmentation-fault) and this is what I see: line, /usr/lib64/python3.5/asyncio/events.py:675 call, /usr/lib64/python3.5/asyncio/events.py:621 line, /usr/lib64/python3.5/asyncio/events.py:627 line, /usr/lib64/python3.5/asyncio/events.py:628 line, /usr/lib64/python3.5/asyncio/events.py:629 return, /usr/lib64/python3.5/asyncio/events.py:629 line, /usr/lib64/python3.5/asyncio/events.py:676 line, /usr/lib64/python3.5/asyncio/events.py:677 return, /usr/lib64/python3.5/asyncio/events.py:677 line, /usr/lib64/python3.5/asyncio/futures.py:172 line, /usr/lib64/python3.5/asyncio/futures.py:173 call, /usr/lib64/python3.5/asyncio/base_events.py:1461 line, /usr/lib64/python3.5/asyncio/base_events.py:1462 return, /usr/lib64/python3.5/asyncio/base_events.py:1462 return, /usr/lib64/python3.5/asyncio/futures.py:173 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:584 call, /usr/lib64/python3.5/asyncio/futures.py:315 line, /usr/lib64/python3.5/asyncio/futures.py:322 line, /usr/lib64/python3.5/asyncio/futures.py:325 return, /usr/lib64/python3.5/asyncio/futures.py:325 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:585 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:586 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:587 call, /usr/lib64/python3.5/site-packages/tornado/iostream.py:1045 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:1046 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:1047 call, /usr/lib64/python3.5/site-packages/tornado/iostream.py:134 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:135 return, /usr/lib64/python3.5/site-packages/tornado/iostream.py:135 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:1048 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:1050 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:1051 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:1052 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:1060 call, /usr/lib64/python3.5/site-packages/tornado/iostream.py:163 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:168 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:169 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:170 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:174 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:175 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:176 return, /usr/lib64/python3.5/site-packages/tornado/iostream.py:176 call, /usr/lib64/python3.5/site-packages/tornado/iostream.py:1247 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:1248 line, /usr/lib64/python3.5/site-packages/tornado/iostream.py:1249 Program received signal SIGPIPE, Broken pipe. 0x776f7bfb in __libc_send (fd=14, buf=0x118a0b0, n=2332, flags=0) at ../sysdeps/unix/sysv/linux/x86_64/send.c:31 31ssize_t result = INLINE_SYSCALL (sendto, 6, fd, buf, n, flags, NULL, Missing separate debuginfos, use: debuginfo-install python35u-3.5.6-1.ius.centos7.x86_64 (gdb) (gdb) (gdb) (gdb) bt #0 0x776f7bfb in __libc_send (fd=14, buf=0x118a0b0, n=2332, flags=0) at ../sysdeps/unix/sysv/linux/x86_64/send.c:31 #1 0x7fffed7c6c66 in sock_send_impl () from /usr/lib64/python3.5/lib-dynload/_socket.cpython-35m-x86_64-linux-gnu.so #2 0x7fffed7c9e06 in sock_call_ex () from /usr/lib64/python3.5/lib-dynload/_socket.cpython-35m-x86_64-linux-gnu.so #3 0x7fffed7ca79f in sock_send () from /usr/lib64/python3.5/lib-dynload/_socket.cpython-35m-x86_64-linux-gnu.so #4 0x779b60d9 in PyCFunction_Call () from /lib64/libpython3.5m.so.1.0 #5 0x77a2f646 in PyEval_EvalFrameEx () from /lib64/libpython3.5m.so.1.0 #6 0x77a2ea88 in PyEval_EvalFrameEx () from /lib64/libpython3.5m.so.1.0 #7 0x77a2ea88 in PyEval_EvalFrameEx () from /lib64/libpython3.5m.so.1.0 #8 0x77a30ebc in _PyEval_EvalCodeWithName () from /lib64/libpython3.5m.so.1.0 #9 0x77a2e22f in PyEval_EvalFrameEx () from /lib64/libpython3.5m.so.1.0 #10 0x77a30ebc in _PyEval_EvalCodeWithName () from /lib64/libpython3.5m.so.1.0 #11 0x77a2e22f in PyEval_EvalFrameEx () from /lib64/libpython3.5m.so.1.0 #12 0x77a30ebc in _PyEval_EvalCodeWithName () from /lib64/libpython3.5m.so.1.0 #13 0x77a2e22f in PyEval_EvalFrameEx () from /lib64/libpython3.5m.so.1.0 #14 0x77a30ebc in _PyEval_EvalCodeWithName () from /lib64/libpython3.5m.so.1.0 #15 0x77a2e22f in PyEval_EvalFrameEx () from /lib64/libpython3.5m.so.1.0 #16 0x779924c0 in gen_send_ex () from /lib64/libpython3.5m.so.1.0 #17 0x77a2ec28 in PyEval_EvalFrameEx () from /lib64/libpython3.5m.so.1.0 #18 0x77a30ebc
