[issue37788] fix for bpo-36402 (threading._shutdown() race condition) causes reference leak

[Zhipeng Xie]

Zhipeng Xie <775350...@qq.com> added the comment:

ping

I also encountered this problem. Is there a fix now?

--
nosy: +Zhipeng Xie

___
Python tracker 
<https://bugs.python.org/issue37788>
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue39146] too much memory consumption in re.compile unicode

[Zhipeng Xie]

Zhipeng Xie <775350...@qq.com> added the comment:

> but range() was here before ebd48b4f650d.

before ebd48b4f650d, _optimize_unicode use xrange. So python2.7.8 is ok and 
python2.7.9 consume much memory in my test case.

> Obviously there are other causes of the difference between 2.7 and 3.x.

Maybe it is because my python was compiled with --enable-unicode=ucs4.

--

___
Python tracker 
<https://bugs.python.org/issue39146>
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue39146] too much memory consumption in re.compile unicode

[Zhipeng Xie]

Zhipeng Xie <775350...@qq.com> added the comment:

Hi, I tracked it down and found that this problem was introduced in python2.7.9 
by following commit:

https://hg.python.org/cpython/rev/ebd48b4f650d

--
nosy: +serhiy.storchaka

___
Python tracker 
<https://bugs.python.org/issue39146>
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue39146] too much memory consumption in re.compile unicode

[Zhipeng Xie]

Change by Zhipeng Xie <775350...@qq.com>:


--
title: to much memory consumption in re.compile unicode -> too much memory 
consumption in re.compile unicode

___
Python tracker 
<https://bugs.python.org/issue39146>
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue39146] to much memory consumption in re.compile unicode

[Zhipeng Xie]

New submission from Zhipeng Xie <775350...@qq.com>:

when running the following script, we found python2 comsume a lot memory while 
python3 does not have the issue.

import re
import time
NON_PRINTABLE = re.compile(u'[^\U0001-\U0010]')
time.sleep( 30 )

python2:
  PID USER  PR  NIVIRTRESSHR S  %CPU  %MEM TIME+ COMMAND

 6943 root  20   0  109956  93436   3956 S   0.0   1.2   0:00.30 python

python3:
  PID USER  PR  NIVIRTRESSHR S  %CPU  %MEM TIME+ COMMAND

 6952 root  20   0   28032   8880   4868 S   0.0   0.1   0:00.02 python3

--
components: Library (Lib)
messages: 358936
nosy: Zhipeng Xie
priority: normal
severity: normal
status: open
title: to much memory consumption in re.compile unicode
type: resource usage
versions: Python 2.7

___
Python tracker 
<https://bugs.python.org/issue39146>
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue38575] Child process deadlock in subprocess.Popen

[Zhipeng Xie]

New submission from Zhipeng Xie <775350...@qq.com>:

Hi, we had a child process deadlock on _disabling_gc_lock in subprocess.Popen. 
It seems that after 
https://github.com/python/cpython/commit/5e8e371364ee58dadb9a4e4e51c7e9cf6bedbfae,
 subprocess.Popen no longer support to be called in preexec_fn.

Steps to reproduce:
[root@localhost ~]# python2 --version
Python 2.7.15
[root@localhost ~]# python2 mtfork.py 

wait for a while and the child process deadlock

Here is the gdb stack:

(gdb) py-bt
Traceback (most recent call first):
  Waiting for the GIL
  File "/usr/local/lib/python2.7/subprocess.py", line 931, in _execute_child
with self._disabling_gc_lock:
  File "/usr/local/lib/python2.7/subprocess.py", line 394, in __init__
errread, errwrite)
  File "mtfork.py", line 36, in run_cmd
stderr=subprocess.PIPE)
  File "/usr/local/lib/python2.7/subprocess.py", line 989, in _execute_child
preexec_fn()
  File "/usr/local/lib/python2.7/subprocess.py", line 394, in __init__
errread, errwrite)
  File "mtfork.py", line 15, in run_command
stdout=arg_stdout, stderr=arg_stderr, shell=True)
  File "mtfork.py", line 51, in _readerthread3
status = run_command("/root/exe",preexec_fn=preexec_fn_no_args)
  File "/usr/local/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
  File "/usr/local/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
  File "/usr/local/lib/python2.7/threading.py", line 774, in __bootstrap
self.__bootstrap_inner()
(gdb) py-list
 926# The first char specifies the exception type: 0 means
 927# OSError, 1 means some other error.
 928errpipe_read, errpipe_write = self.pipe_cloexec()
 929try:
 930try:
>931with self._disabling_gc_lock:
 932gc_was_enabled = gc.isenabled()
 933# Disable gc to avoid bug where gc -> 
file_dealloc ->
 934# write to stderr -> hang.
 935# https://bugs.python.org/issue1336
 936    gc.disable()

--
components: Library (Lib)
files: mtfork.py
messages: 355290
nosy: Zhipeng Xie
priority: normal
severity: normal
status: open
title: Child process deadlock in subprocess.Popen
type: behavior
versions: Python 2.7
Added file: https://bugs.python.org/file48675/mtfork.py

___
Python tracker 
<https://bugs.python.org/issue38575>
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com