Re: Tkinter GUI freezing, used Thread then encountered RuntimeError: threads can only be started once

[MRAB]

On 2023-01-11 00:13, Cameron Simpson wrote:

On 10Jan2023 18:32, MRAB  wrote:
I don't like how you're passing Thread...start as an argument. IMHO, it 
would be better/cleaner to pass a plain function, even if the only 
thing that function does is to start the thread.


Yes, and this is likely the thing causing the cited exception "threads
can only be started once". Your setup of the button with the action
defined as:

  Thread().start

creates a _single_ new Thread _when you define the button_, and makes
hte button callback try to start it. On the second and following
callback, you're trying to start the _same_ single Thread again.


You're right! I missed that detail. :-(


Do as MRAB suggests and have the callback create-and-start a Thread
instead of just starting an _existing_ Thread.

Also, for simple quick things there's no need to use a Thread at all. If
the final version of the programme is going to do something long running
at that point, then sure.

I can't tell what 'change_flag' is doing because of the formatting 
issue. Is it doing GUI stuff? In a thread? If yes, don't do that. The 
GUI doesn't like that. Only the main thread should do GUI stuff.


Aye. This is very important in almost all GUI toolkits.

Bit me very badly with Qt once, badly in that the segfaults (yes!
segfaults! in a Python app!) were erratic and very timing dependent,
making them hard to reproduce and understand. It wasn't until I
_realised_ it was thread/concurrency related that I could fix it.

Note that in Tk you can have a callback do GUI work, just not in a
separate thread.



--
https://mail.python.org/mailman/listinfo/python-list

Re: Tkinter GUI freezing, used Thread then encountered RuntimeError: threads can only be started once

[Cameron Simpson]

On 10Jan2023 18:32, MRAB  wrote:
I don't like how you're passing Thread...start as an argument. IMHO, it 
would be better/cleaner to pass a plain function, even if the only 
thing that function does is to start the thread.


Yes, and this is likely the thing causing the cited exception "threads 
can only be started once". Your setup of the button with the action 
defined as:


Thread().start

creates a _single_ new Thread _when you define the button_, and makes 
hte button callback try to start it. On the second and following 
callback, you're trying to start the _same_ single Thread again.


Do as MRAB suggests and have the callback create-and-start a Thread 
instead of just starting an _existing_ Thread.


Also, for simple quick things there's no need to use a Thread at all. If 
the final version of the programme is going to do something long running 
at that point, then sure.


I can't tell what 'change_flag' is doing because of the formatting 
issue. Is it doing GUI stuff? In a thread? If yes, don't do that. The 
GUI doesn't like that. Only the main thread should do GUI stuff.


Aye. This is very important in almost all GUI toolkits.

Bit me very badly with Qt once, badly in that the segfaults (yes!  
segfaults! in a Python app!) were erratic and very timing dependent, 
making them hard to reproduce and understand. It wasn't until I 
_realised_ it was thread/concurrency related that I could fix it.


Note that in Tk you can have a callback do GUI work, just not in a 
separate thread.


Cheers,
Cameron Simpson 
--
https://mail.python.org/mailman/listinfo/python-list

Re: Tkinter GUI freezing, used Thread then encountered RuntimeError: threads can only be started once

[MRAB]

On 2023-01-10 14:57, Abhay Singh wrote:

Here is the entire code snippet of the same.

Please help

def change_flag(top_frame, bottom_frame, button1, button2, button3, button4, 
controller): global counter, canvas, my_image, chosen, flag, directory 
canvas.delete('all') button5['state'] = DISABLED counter += 1

chosen, options_text = function_options()
right_answer_flag = get_right_answer_flag(chosen, options_text)
#pdb.set_trace()

try:
 location = directory + chosen + format_image
except:
 controller.show_frame(PlayAgainExit)
 
my_image = PhotoImage(file=location)

canvas.create_image(160, 100, anchor=CENTER, image=my_image)

button1["text"] = options_text[0]
button2["text"] = options_text[1]
button3["text"] = options_text[2]
button4["text"] = options_text[3]

button1['state'] = NORMAL
button2['state'] = NORMAL
button3['state'] = NORMAL
button4['state'] = NORMAL
##

 button5 = Button(
 next_frame,
 width=20,
 text="next",
 fg="black",
 #command=lambda: 
change_flag(top_frame,bottom_frame,button1,button2,button3,button4,controller))
 command=Thread(target=change_flag, args 
=(top_frame,bottom_frame,button1,button2,button3,button4,controller)).start)
 
 button5.pack(side=RIGHT, padx=5, pady=5)



The formatting is messed up, which doesn't help.

Some points:

You have a 'bare' except, i.e. "except:". Don't do that. It swallows 
_all_ exceptions and can hide bugs.


I don't like how you're passing Thread...start as an argument. IMHO, it 
would be better/cleaner to pass a plain function, even if the only thing 
that function does is to start the thread.


I can't tell what 'change_flag' is doing because of the formatting 
issue. Is it doing GUI stuff? In a thread? If yes, don't do that. The 
GUI doesn't like that. Only the main thread should do GUI stuff.

--
https://mail.python.org/mailman/listinfo/python-list

Tkinter GUI freezing, used Thread then encountered RuntimeError: threads can only be started once

[Abhay Singh]

Here is the entire code snippet of the same.

Please help

def change_flag(top_frame, bottom_frame, button1, button2, button3, button4, 
controller): global counter, canvas, my_image, chosen, flag, directory 
canvas.delete('all') button5['state'] = DISABLED counter += 1

chosen, options_text = function_options()
right_answer_flag = get_right_answer_flag(chosen, options_text)
#pdb.set_trace()

try:
location = directory + chosen + format_image
except:
controller.show_frame(PlayAgainExit)

my_image = PhotoImage(file=location)
canvas.create_image(160, 100, anchor=CENTER, image=my_image)

button1["text"] = options_text[0]
button2["text"] = options_text[1]
button3["text"] = options_text[2]
button4["text"] = options_text[3]

button1['state'] = NORMAL
button2['state'] = NORMAL
button3['state'] = NORMAL
button4['state'] = NORMAL
##

button5 = Button(
next_frame,
width=20,
text="next",
fg="black",
#command=lambda: 
change_flag(top_frame,bottom_frame,button1,button2,button3,button4,controller))
command=Thread(target=change_flag, args 
=(top_frame,bottom_frame,button1,button2,button3,button4,controller)).start)

button5.pack(side=RIGHT, padx=5, pady=5)

Thanks,
Abhay
-- 
https://mail.python.org/mailman/listinfo/python-list

[issue46608] Exclude marshalled-frozen data if deep-freezing to save 300 KB space

[STINNER Victor]

STINNER Victor  added the comment:

https://docs.python.org/dev/whatsnew/3.11.html#c-api-changes documents the 
addition of the "is_package" member to the _frozen structure, but it doesn't 
mention the new "get_code" member. Can it be also documented?

--
nosy: +vstinner

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue46608] Exclude marshalled-frozen data if deep-freezing to save 300 KB space

[Kumar Aditya]

Change by Kumar Aditya :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue46608] Exclude marshalled-frozen data if deep-freezing to save 300 KB space

[Guido van Rossum]

Guido van Rossum  added the comment:


New changeset 9d4161a60ca8b470148ffd6c73e3110a0aa6d66f by Kumar Aditya in 
branch 'main':
bpo-46608: Fix argument parsing in freeze_modules.py (GH-31131)
https://github.com/python/cpython/commit/9d4161a60ca8b470148ffd6c73e3110a0aa6d66f


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue46608] Exclude marshalled-frozen data if deep-freezing to save 300 KB space

[Kumar Aditya]

Change by Kumar Aditya :


--
pull_requests: +29310
pull_request: https://github.com/python/cpython/pull/31131

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue46608] Exclude marshalled-frozen data if deep-freezing to save 300 KB space

[miss-islington]

miss-islington  added the comment:


New changeset bf95ff91f2c1fc5a57190491f9ccdc63458b089e by Kumar Aditya in 
branch 'main':
bpo-46608: exclude marshalled-frozen data if deep-freezing to save 300 KB space 
 (GH-31074)
https://github.com/python/cpython/commit/bf95ff91f2c1fc5a57190491f9ccdc63458b089e


--
nosy: +miss-islington

___
Python tracker 
<https://bugs.python.org/issue46608>
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue46608] Exclude marshalled-frozen data if deep-freezing to save 300 KB space

[Guido van Rossum]

Change by Guido van Rossum :


--
nosy: +eric.snow

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue46608] Exclude marshalled-frozen data if deep-freezing to save 300 KB space

[Kumar Aditya]

Change by Kumar Aditya :


--
keywords: +patch
pull_requests: +29259
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/31074

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue46608] Exclude marshalled-frozen data if deep-freezing to save 300 KB space

[Kumar Aditya]

New submission from Kumar Aditya :

This reduces the size of the data segment by 300 KB of the executable because 
if the modules are deep-frozen then the marshalled frozen data just wastes 
space. This was inspired by comment by @gvanrossum in #29118 (comment). Note: 
There is a new option `--deepfreeze-only` in freeze_modules.py to change this 
behavior, it is on be default to save disk space.

# du -s ./python before
27892   ./python
# du -s ./python after
27524   ./python

--
components: Build
messages: 412346
nosy: gvanrossum, kumaraditya303
priority: normal
severity: normal
status: open
title: Exclude marshalled-frozen data if deep-freezing to save 300 KB space
versions: Python 3.11

___
Python tracker 
<https://bugs.python.org/issue46608>
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Ned Deily]

Ned Deily  added the comment:

I've now verified that the _bootstrap_python fix for framework builds works - 
removing "release blocker" status. Thanks, Christian!

--
priority: release blocker -> 

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Christian Heimes]

Christian Heimes  added the comment:

Ned, I have implemented a fix for _bootstrap_python for framework builds and 
re-enabled --with-build-python for all builds. Previously I disabled the option 
for standard builds, because --with-build-python can cause build issues when a 
user runs ./configure --with-build-python with an older 3.11 alpha build.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Christian Heimes]

Christian Heimes  added the comment:


New changeset 612e59b53f0c730ce1b881f7c08dc6d49f02c123 by Christian Heimes in 
branch 'main':
bpo-45950: Fix macOS framework builds of _bootstrap_python (GH-29936)
https://github.com/python/cpython/commit/612e59b53f0c730ce1b881f7c08dc6d49f02c123


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Christian Heimes]

Christian Heimes  added the comment:

I added --enable-framework=yes to macOS GHA builder.

GH-29939 has ./configure --enable-framework=yes without proposed bootstrap fix. 
The build is failing early:

./_bootstrap_python ./Tools/scripts/deepfreeze.py 
Python/frozen_modules/importlib._bootstrap.h -m importlib._bootstrap -o 
Python/deepfreeze/importlib._bootstrap.c
make: *** [Python/deepfreeze/importlib._bootstrap.c] Bus error: 10


GH-29936 has ./configure --enable-framework=yes and introduces a 
Modules/getpath_bootstrap.o file. It is the same build as Modules/getpath.o 
except it does not use the framework feature. The target compiles getpath.c 
with an additional -DPY_BOOTSTRAP_PYTHON=1 option. The build fails later:

/bin/sh: line 1: 14772 Bus error: 10   
DYLD_FRAMEWORK_PATH=/Users/runner/work/cpython/cpython ./python.exe -E -S -m 
sysconfig --generate-posix-vars
generate-posix-vars failed

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Christian Heimes]

Change by Christian Heimes :


--
pull_requests: +28163, 28164
pull_request: https://github.com/python/cpython/pull/29939

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Christian Heimes]

Change by Christian Heimes :


--
pull_requests: +28163
pull_request: https://github.com/python/cpython/pull/29939

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Christian Heimes]

Christian Heimes  added the comment:

If the patch does not help then I can re-enable --with-build-python for 
non-cross builds.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Christian Heimes]

Christian Heimes  added the comment:

Ronald, Pablo, could you please test GH-29936 on macOS with --enable-framework?

--
nosy: +pablogsal, ronaldoussoren

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Christian Heimes]

Change by Christian Heimes :


--
pull_requests: +28160
pull_request: https://github.com/python/cpython/pull/29936

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Ned Deily]

Ned Deily  added the comment:

> Ned, does this change solve the issue with framework builds?

No. I would guess at a minimum getpath.c for _bootstrap_python might need to be 
built without WITH_NEXT_FRAMEWORK defined. But I'm out of time for today and 
don't expect to have much time available in the immediate future.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Christian Heimes]

Christian Heimes  added the comment:

Ned, does this change solve the issue with framework builds?

$ git diff
diff --git a/Makefile.pre.in b/Makefile.pre.in
index 8e6e553554d..2068db30855 100644
--- a/Makefile.pre.in
+++ b/Makefile.pre.in
@@ -106,7 +106,7 @@ PY_CFLAGS_NODIST=$(CONFIGURE_CFLAGS_NODIST) 
$(CFLAGS_NODIST) -I$(srcdir)/Include
 PY_CPPFLAGS=   $(BASECPPFLAGS) -I. -I$(srcdir)/Include $(CONFIGURE_CPPFLAGS) 
$(CPPFLAGS)
 PY_LDFLAGS=$(CONFIGURE_LDFLAGS) $(LDFLAGS)
 PY_LDFLAGS_NODIST=$(CONFIGURE_LDFLAGS_NODIST) $(LDFLAGS_NODIST)
-PY_LDFLAGS_NOLTO=$(PY_LDFLAGS) $(CONFIGURE_LDFLAGS_NOLTO) $(LDFLAGS_NODIST)
+PY_LDFLAGS_NOLTO=$(PY_LDFLAGS_NODIST) $(CONFIGURE_LDFLAGS_NOLTO) 
$(LDFLAGS_NODIST)
 NO_AS_NEEDED=  @NO_AS_NEEDED@
 CCSHARED=  @CCSHARED@
 # LINKFORSHARED are the flags passed to the $(CC) command that links

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Ned Deily]

Ned Deily  added the comment:

Framework builds on macOS now fail with a bus error when trying to run the 
newly built _bootstrap_python. A simplified example:

$ ./configure --enable-framework=$PWD/Library/Frameworks
checking for git... found
checking build system type... x86_64-apple-darwin20.6.0
checking host system type... x86_64-apple-darwin20.6.0
checking for Python interpreter freezing... ./_bootstrap_python
checking for python3.11... no
checking for python3.10... no
checking for python3.9... no
checking for python3.8... no
checking for python3.7... no
checking for python3.6... no
checking for python3... python3
checking Python for regen version... Python 3.8.9
[...]
creating Modules/Setup.local
creating Makefile

pkg-config is missing. Some dependencies may not be detected correctly.


If you want a release build with all stable optimizations active (PGO, etc),
please run ./configure --enable-optimizations


$ make
[...]
gcc -o _bootstrap_python Modules/getbuildinfo.o Parser/token.o  
Parser/pegen.o Parser/pegen_errors.o Parser/action_helpers.o Parser/parser.o 
Parser/string_parser.o Parser/peg_api.o Parser/myreadline.o Parser/tokenizer.o 
Objects/abstract.o Objects/accu.o Objects/boolobject.o Objects/bytes_methods.o 
Objects/bytearrayobject.o Objects/bytesobject.o Objects/call.o 
Objects/capsule.o Objects/cellobject.o Objects/classobject.o 
Objects/codeobject.o Objects/complexobject.o Objects/descrobject.o 
Objects/enumobject.o Objects/exceptions.o Objects/genericaliasobject.o 
Objects/genobject.o Objects/fileobject.o Objects/floatobject.o 
Objects/frameobject.o Objects/funcobject.o Objects/interpreteridobject.o 
Objects/iterobject.o Objects/listobject.o Objects/longobject.o 
Objects/dictobject.o Objects/odictobject.o Objects/memoryobject.o 
Objects/methodobject.o Objects/moduleobject.o Objects/namespaceobject.o 
Objects/object.o Objects/obmalloc.o Objects/picklebufobject.o 
Objects/rangeobject.o Objects/seto
 bject.o Objects/sliceobject.o Objects/structseq.o Objects/tupleobject.o 
Objects/typeobject.o Objects/unicodeobject.o Objects/unicodectype.o 
Objects/unionobject.o Objects/weakrefobject.o Python/_warnings.o 
Python/Python-ast.o Python/Python-tokenize.o Python/asdl.o Python/ast.o 
Python/ast_opt.o Python/ast_unparse.o Python/bltinmodule.o Python/ceval.o 
Python/codecs.o Python/compile.o Python/context.o Python/dynamic_annotations.o 
Python/errors.o Python/frame.o Python/frozenmain.o Python/future.o 
Python/getargs.o Python/getcompiler.o Python/getcopyright.o 
Python/getplatform.o Python/getversion.o Python/hamt.o Python/hashtable.o 
Python/import.o Python/importdl.o Python/initconfig.o Python/marshal.o 
Python/modsupport.o Python/mysnprintf.o Python/mystrtoul.o Python/pathconfig.o 
Python/preconfig.o Python/pyarena.o Python/pyctype.o Python/pyfpe.o 
Python/pyhash.o Python/pylifecycle.o Python/pymath.o Python/pystate.o 
Python/pythonrun.o Python/pytime.o Python/bootstrap_hash.o Python/specialize.o
  Python/structmember.o Python/symtable.o Python/sysmodule.o Python/thread.o 
Python/traceback.o Python/getopt.o Python/pystrcmp.o Python/pystrtod.o 
Python/pystrhex.o Python/dtoa.o Python/formatter_unicode.o Python/fileutils.o 
Python/suggestions.o Python/dynload_shlib.oModules/config.o Modules/main.o 
Modules/gcmodule.o Modules/atexitmodule.o  Modules/faulthandler.o  
Modules/posixmodule.o  Modules/signalmodule.o  Modules/_tracemalloc.o  
Modules/_codecsmodule.o  Modules/_collectionsmodule.o  Modules/errnomodule.o  
Modules/_io/_iomodule.o Modules/_io/iobase.o Modules/_io/fileio.o 
Modules/_io/bytesio.o Modules/_io/bufferedio.o Modules/_io/textio.o 
Modules/_io/stringio.o  Modules/itertoolsmodule.o  Modules/_sre.o  
Modules/_threadmodule.o  Modules/timemodule.o  Modules/_weakref.o  
Modules/_abc.o  Modules/_functoolsmodule.o  Modules/_localemodule.o  
Modules/_operator.o  Modules/_stat.o  Modules/symtablemodule.o  
Modules/pwdmodule.o  Modules/xxsubtype.o \
Programs/_bootstrap_python.o Modules/getpath.o -ldl  -framework 
CoreFoundation
./_bootstrap_python ./Tools/scripts/deepfreeze.py 
Python/frozen_modules/importlib._bootstrap.h -m importlib._bootstrap -o 
Python/deepfreeze/importlib._bootstrap.c
make: *** [Python/deepfreeze/importlib._bootstrap.c] Bus error: 10
$

--enable-framework causes a number of changes in interpreter building and 
initialization. Since, as it stands, _bootstrap_python executable isn't and 
doesn't need to be built as a framework, there is probably some path confusion 
in getpath.c or elsewhere.

Prior to these changes (at 3.11.0a2 at least), it was still possible to run a 
framework build executable in the build directory through some careful use of 
build variables in Makefile (like how "make test" works). Without delving 
deeper into it at the moment, I'm not sure what to suggest. It may be simpler 
to just do a clean separate non-framework build to provide _bootstrap_python. 
And/or possibly re-allow the use of --with-build-python 

[issue45950] Reintroduce bootstrap_python for freezing

[Christian Heimes]

Christian Heimes  added the comment:


New changeset 84ca1232b0f1e4be368e89550a9ceb46f64a0eff by Christian Heimes in 
branch 'main':
bpo-45950: Introduce Bootstrap Python again (#29859)
https://github.com/python/cpython/commit/84ca1232b0f1e4be368e89550a9ceb46f64a0eff


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Christian Heimes]

Change by Christian Heimes :


--
nosy: +eric.snow, gvanrossum

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Christian Heimes]

Change by Christian Heimes :


--
keywords: +patch
pull_requests: +28106
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/29859

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Christian Heimes]

Change by Christian Heimes :


--
assignee:  -> christian.heimes
dependencies: +"Deep-freeze": skip the marshal step by generating C code, Stop 
using bootstrap_python for deep-freeze in UNIX builds

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45950] Reintroduce bootstrap_python for freezing

[Christian Heimes]

New submission from Christian Heimes :

bpo-45696 introduced a _bootstrap_python interpreter, which was used to create 
frozen and deepfrozen module files. bpo-45873 dropped the _bootstrap_python 
interpreter again. Instead Python used an existing Python installation to 
bootstrap the build.

After some internal discussion we agreed that the approach is flawed and puts 
too much of a burden on users. Users have to install a fairly recent Python 
interpreter in order to build 3.11. This makes it harder to build Python on 
platforms with no or a too old Python version. It also complicated things for 
container builds and pyenv.

Let's re-introduce a _bootstrap_python interpreter. Cross compiling will still 
require a build Python interpreter.

--
components: Build
messages: 407467
nosy: christian.heimes
priority: normal
severity: normal
status: open
title: Reintroduce bootstrap_python for freezing
type: behavior
versions: Python 3.11

___
Python tracker 
<https://bugs.python.org/issue45950>
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Guido van Rossum]

Guido van Rossum  added the comment:


New changeset b0b10e146b1cbf9c5dfa44af116a2eeb0f210e8b by Kumar Aditya in 
branch 'main':
bpo-45019: Cleanup module freezing and deepfreeze (#29772)
https://github.com/python/cpython/commit/b0b10e146b1cbf9c5dfa44af116a2eeb0f210e8b


--

___
Python tracker 
<https://bugs.python.org/issue45019>
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Oleg Iarygin]

Oleg Iarygin  added the comment:

If a directory is renamed anyway, maybe `deepfrozen_modules` is better? 
`deepfreeze_modules` looks like "modules that are part of deepfreeze tool 
itself". Also it rhymes with `frozen_modules`.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Kumar Aditya]

Change by Kumar Aditya :


--
nosy: +kumaraditya303
nosy_count: 6.0 -> 7.0
pull_requests: +28009
pull_request: https://github.com/python/cpython/pull/29772

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Oleg Iarygin]

Change by Oleg Iarygin :


--
nosy: +arhadthedev
nosy_count: 5.0 -> 6.0
pull_requests: +27981
pull_request: https://github.com/python/cpython/pull/29744

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45188] De-couple the Windows builds from freezing modules.

[Eric Snow]

Change by Eric Snow :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45188] De-couple the Windows builds from freezing modules.

[Guido van Rossum]

Guido van Rossum  added the comment:

We can once GH-28375 lands.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45188] De-couple the Windows builds from freezing modules.

[Eric Snow]

Eric Snow  added the comment:

Can we close this?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45188] De-couple the Windows builds from freezing modules.

[Eric Snow]

Eric Snow  added the comment:

FYI, I have a PR up for dropping the .h files: 
https://github.com/python/cpython/pull/28375.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Eric Snow]

Eric Snow  added the comment:


New changeset 3814e2036d96e2b6c69afce61926bb0a2a34d2d9 by Eric Snow in branch 
'main':
bpo-45019: Clean up the frozen __hello__ module. (gh-28374)
https://github.com/python/cpython/commit/3814e2036d96e2b6c69afce61926bb0a2a34d2d9


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Eric Snow]

Change by Eric Snow :


--
pull_requests: +26788
pull_request: https://github.com/python/cpython/pull/28374

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Eric Snow]

Eric Snow  added the comment:


New changeset 4b30aaa0c9dc4da956199dbd48af9c06089cb271 by Eric Snow in branch 
'main':
bpo-45019: Silence a warning in test_ctypes. (gh-28362)
https://github.com/python/cpython/commit/4b30aaa0c9dc4da956199dbd48af9c06089cb271


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45188] De-couple the Windows builds from freezing modules.

[Guido van Rossum]

Guido van Rossum  added the comment:

I tried this:

- remove the generated .h files
- touched dictobject.c
- touched dictobject.h

After each step I tried to rebuild. Each case the compilation of frozen.c 
failed and then the build stopped, so apparently the .h files weren't generated 
early enough.

Here's the error message:

C:\Users\gvanrossum\cpython\Python\frozen.c(44,10): fatal error C1083: Cannot 
open include file: 'frozen_modules/abc.
h': No such file or directory 
[C:\Users\gvanrossum\cpython\PCbuild\pythoncore.vcxproj]

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45188] De-couple the Windows builds from freezing modules.

[Steve Dower]

Steve Dower  added the comment:

Should be able to, yeah. Though I didn't test that.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Eric Snow]

Change by Eric Snow :


--
pull_requests: +26776
pull_request: https://github.com/python/cpython/pull/28362

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45188] De-couple the Windows builds from freezing modules.

[Guido van Rossum]

Guido van Rossum  added the comment:

Is this now done? I.e. can we now drop the frozen .h files from the repo?

--
nosy: +gvanrossum

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Eric Snow]

Eric Snow  added the comment:

On Wed, Sep 15, 2021 at 7:51 AM Karthikeyan Singaravelan
 wrote:
> The PR 28319 seems to have introduced a new deprecation warning in tests :

I'll fix that.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45188] De-couple the Windows builds from freezing modules.

[Steve Dower]

Steve Dower  added the comment:


New changeset 09b4ad11f323f8702cde795e345b75e0fbb1a9a5 by Steve Dower in branch 
'main':
bpo-45188: Windows now regenerates frozen modules at the start of build instead 
of late (GH-28322)
https://github.com/python/cpython/commit/09b4ad11f323f8702cde795e345b75e0fbb1a9a5


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45188] De-couple the Windows builds from freezing modules.

[Eric Snow]

Eric Snow  added the comment:


New changeset cbeb81971057d6c382f45ecce92df2b204d4106a by Eric Snow in branch 
'main':
bpo-45020: Freeze some of the modules imported during startup. (gh-28335)
https://github.com/python/cpython/commit/cbeb81971057d6c382f45ecce92df2b204d4106a


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Karthikeyan Singaravelan]

Karthikeyan Singaravelan  added the comment:

The PR 28319 seems to have introduced a new deprecation warning in tests : 

0:00:13 load avg: 2.82 [ 98/427] test_ctypes passed
Hello world!
/home/karthikeyan/stuff/python/cpython/Lib/ctypes/test/test_values.py:5: 
DeprecationWarning: the imp module is deprecated in favour of importlib and 
slated for removal in Python 3.12; see the module's documentation for 
alternative uses
  import imp

--
nosy: +xtreak

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45188] De-couple the Windows builds from freezing modules.

[Eric Snow]

Change by Eric Snow :


--
pull_requests: +26747
pull_request: https://github.com/python/cpython/pull/28335

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45188] De-couple the Windows builds from freezing modules.

[Steve Dower]

Change by Steve Dower :


--
keywords: +patch
pull_requests: +26731
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/28322

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Eric Snow]

Eric Snow  added the comment:


New changeset a2d8c4b81b8e68e2ffe10945f7ca69174c14e52a by Eric Snow in branch 
'main':
bpo-45019: Do some cleanup related to frozen modules. (gh-28319)
https://github.com/python/cpython/commit/a2d8c4b81b8e68e2ffe10945f7ca69174c14e52a


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Eric Snow]

Change by Eric Snow :


--
pull_requests: +26728
pull_request: https://github.com/python/cpython/pull/28319

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45188] De-couple the Windows builds from freezing modules.

[Steve Dower]

Steve Dower  added the comment:

Only thing I'd add is that you should just be able to list the required .c 
files in _freeze_module.vcxproj (formerly known as freeze_importlib.vcxproj) 
rather than depending on pythoncore.vcxproj.

That will generate twice as many .obj files for those modules (which is fine, 
just takes a little more time at build), and will force everything to be 
regenerated if you modify them, but that's an expected part of having part of 
the interpreter depend upon itself.

--
components: +Windows
nosy: +paul.moore, tim.golden, zach.ware

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45188] De-couple the Windows builds from freezing modules.

[Eric Snow]

New submission from Eric Snow :

Currently for Windows builds, generating the frozen modules depends on first 
building python.exe.  One consequence of this is that we must keep all frozen 
module .h files in the repo (which we'd like to avoid for various reasons).

We should be able to freeze modules before building python.exe, like we already 
do via our Makefile.  From what I understand, this will require that a subset 
of the runtime be separately buildable so we can use it in _freeze_module.c and 
use that before actually building python.exe.

@Steve, please correct any details I got wrong here. :)

--
components: Build
messages: 401731
nosy: eric.snow, steve.dower
priority: normal
severity: normal
stage: needs patch
status: open
title: De-couple the Windows builds from freezing modules.
type: behavior
versions: Python 3.11

___
Python tracker 
<https://bugs.python.org/issue45188>
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Łukasz Langa]

Change by Łukasz Langa :


--
nosy: +lukasz.langa
nosy_count: 3.0 -> 4.0
pull_requests: +26565
pull_request: https://github.com/python/cpython/pull/28125

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Eric Snow]

Change by Eric Snow :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Eric Snow]

Eric Snow  added the comment:

I'm just waiting for the buildbots to finish.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Guido van Rossum]

Guido van Rossum  added the comment:

Is this ready to close?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Eric Snow]

Eric Snow  added the comment:


New changeset 044e8d866fdde3804bdb2282c7d23a8074de8f6f by Eric Snow in branch 
'main':
bpo-45019: Add a tool to generate list of modules to include for frozen modules 
(gh-27980)
https://github.com/python/cpython/commit/044e8d866fdde3804bdb2282c7d23a8074de8f6f


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Eric Snow]

Change by Eric Snow :


--
keywords: +patch
pull_requests: +26428
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/27980

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45019] Freezing modules has manual steps but could be automated.

[Eric Snow]

New submission from Eric Snow :

Currently we freeze the 3 main import-related modules, as well as one module 
for testing.  Adding more modules or otherwise making any adjustments requires 
manually editing several files (frozen.c, Makefile.pre.in, ...).  Those files 
aren't particularly obvious and it's easy to miss one.  So it would be helpful 
to have a tool that generates the necessary lines in the relevant files, to 
avoid manual editing.

I'll be putting up a PR shortly.

--
assignee: eric.snow
components: Build
messages: 400369
nosy: brett.cannon, eric.snow, gvanrossum
priority: normal
severity: normal
stage: needs patch
status: open
title: Freezing modules has manual steps but could be automated.
type: enhancement
versions: Python 3.11

___
Python tracker 
<https://bugs.python.org/issue45019>
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Alexander Boeckmann]

Alexander Boeckmann  added the comment:

So over the past week the issue resolved its self. I unfortunately did not get 
a video or a screenshot but thought you might want to know this
So maybe Apple did something or you guys fixed it. Anyways, have a good day!

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Ned Deily]

Ned Deily  added the comment:

> Would taking a video help?

It couldn't hurt and might very well help.

> I'll make one anyways

Thank you!

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Alexander Boeckmann]

Alexander Boeckmann  added the comment:

Hey! I have the exact same thing as described happening! Python freezes when I 
try to save new files which sucks. 
I'm on Catalina: 10.15.6
IDLE: 3.8.5
Brand new MacBook Air
As said earlier the only way out is to force quit. Would taking a video help?
I'll make one anyways

--
nosy: +aboeckmann

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Ned Deily]

Ned Deily  added the comment:

James, thanks very much for your detailed instructions. Alas, once again, I am 
unable to reproduce the hanging behavior under apparently similar conditions 
(10.5.6, Documents folder on iCloud, etc). I know this is frustrating to all of 
us. I have one new concrete suggestion: if someone who can reproduce this 
behavior at will is willing to allow me to screen share into their system (via 
Apple's Messages app) so they can demonstrate it live, perhaps that will allow 
us to better isolate the problem.  If anyone is interested in helping with 
this, contact me via email (nad at python dot org) and we can set up a time.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[James Franks]

James Franks  added the comment:

Hope this helps:

I'm running Python Shell 3.8.5 on MacOSx 10.15.6 (Catalina).  I can reproduce 
this hang easily.

Open any existing module or create a new one.  Can save the existing module or 
a new one just fine under the same name. (File menu - Save)

Using "Save as..." from File dropdown menu, Windows appears, change the name, 
hit Save button and IDLE hangs.

After approximately a minute the window becomes active again, but when hitting 
any button (Cancel or Save) it hangs again.  No way to get out of this but 
force quit IDLE.

My files are in iCloud documents folder.

Did the same test with a Mac running Mojave (10.14.6) Also with Python Shell 
3.8.5.  Works fine.  Seems to be something with Catalina as some have 
mentioned. 

Please help.  This is extremely frustrating for someone like me just trying to 
learn Python.  I will switch over to the machine running Mojave.  Thanks for 
helping!

--
nosy: +franksj

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Terry J. Reedy]

Terry J. Reedy  added the comment:

By 'preview', I meant the listing of existing file in the directory, such as 
Documents.  IDLE displays this but, as I inferred and you and Bev confirmed, 
this is not standard on macOS, as there is a button (which I did not noticed 
before) to show or hide the file list and other stuff. (There is no such button 
on Windows.) So *if* it is the problem culprit for some people, we could, I 
presume, leave the pane initially hidden.

Is the filelist pane a 'sheet'?  Could the recent 'sheets' fix (Christian's 
comment) for these dialogs on Catalina be involved?  What is your latest take 
on 8.6.10 for OSX?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Ned Deily]

Ned Deily  added the comment:

>To debug, and test Raymond's hypothesis, someone please try this minimal 
>(IDLE-free) code to show the dialog and print the return.  
>This does not display a preview, even after selecting a location, such as 
>Documents, on the 3rd line.

Terry, I'm not sure I know what you mean here by preview. Do you mean the 
Column view of the Save sheet?  As "Bev in TX" explained in the quote you 
supplied earlier, the standard macOS Save or Save As save sheet which nearly 
all macOS apps use including Tk in IDLE has several settings, settings that are 
usually remembered across application invocations. By default initially, a 
compact display is given with boxes for Save As, Tags, and a pull-down Where 
list of folders.  To its right, there should be an button with a "V" icon.  
When pressed, the "V" changes to a "^" and the Save sheet expands to show more 
stuff.  What stuff it shows depends on the setting of the view options which 
can be accessed by clicking on the button with an array of six little squares 
on it, usually towards the upper left side of the Save sheet.  In it are the 
three main Show Items as options: "Icons", "List", "Columns". There are other 
options in there, too. So when discussing the appearance of macOS Open or Sa
 ve dialog sheets, one has to be really precise about what options are in 
effect for that particular Save. Those are under the control of the user and, 
again, are remembered by the operating system. Note also that for Save using he 
column view, the system does not show previews of existing files; it does for 
Open files, which you should be able to see if you substitute tk_getOpenFile in 
your test code.

In any case, I ran your test on both 10.15 and 10.14 and so far have still seen 
no problems, no hanging. I don't doubt these reports that people are seeing 
hangs but we still need to be able to reproduce them.  

FWIW, for every macOS Python installer before it is permitted to be released, I 
run a smoke test that, among other things, does essentially does what is 
reported here: launch IDLE.app, open a new file window, add a few lines 
including a print function, preess F5 to Run bringing up the Save dialog, Save 
the file, and verify that the expected output shows up in the IDLE shell 
window. Each installer is tested on at least one macOS system level, always the 
latest release and usually at least one older release. In years of doing this, 
I've never seen a hang like those being reported. So that's why I'm 
particularly curious about this because there is a lot of baseline experience 
over many releases of macOS, Python, and Tk for that matter. We'll keep 
searching.  But it would still be *really* helpful if, as I requested before, 
someone who does see these hangs and can reliably reproduce them, documents 
*exactly* all the steps to do so, from exactly how IDLE is launches to exactly 
how the Sav
 e dialog is invoked (by menu bar or keyboard shortcut or ...) and what options 
of the Save dialog are in effect.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Terry J. Reedy]

Terry J. Reedy  added the comment:

Raymond, can you run the tests I suggested above?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Terry J. Reedy]

Terry J. Reedy  added the comment:

Mat Wichmann responded
"we had three of these in the last few weeks sent to
webmas...@python.org.  I just went back and pinged those folks with a
request to look in on the issue, and contribute to it if they had
anything new/useful to add."

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Terry J. Reedy]

Terry J. Reedy  added the comment:

I asked about other people's experiences on python-list and got 2 responses so 
far.
---

On macOS The default Save/Save as dialogs are short, only displaying a few 
major folders along with Favorites and Recents.  That dialog doesn’t display 
folder contents.  However, you can get an expanded dialog by clicking on the 
little arrow to the right of the Where box.  Using that dialog allows one to 
select any folder and displays folder contents.  

I tried using both Save and Save as, and was unable to duplicate the problem 
with either the short or the long dialog.

Python 3.8.2
macOS Catalina 10.15.4
Bev in TX
---

Fairly recently, Tk has got many bugfixes because of changes in OSX. Here is 
the file that implements the file dialogs:
  https://core.tcl-lang.org/tk/artifact/d72cdfbcbfaa717f
and the history:
  
https://core.tcl-lang.org/tk/finfo?name=macosx/tkMacOSXDialog.c=d72cdfbcbfaa717f

As you can see, it has been touched two days ago (!) to restore some window 
behaviour, which was switched of because of Catalina last August (this commit)
https://core.tcl-lang.org/tk/info/59b1d265c2444112


Christian Gollwitzer
---

Ned, what is your latest experience with 8.6.10?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Terry J. Reedy]

Terry J. Reedy  added the comment:

What is acting up here is the Catalina system SaveAs dialog on some systems 
with some settings when closing after being asked to display the current 
contents of the target location, allow the content to be variously filtered or 
not, and add a default extension.  (I use all of these features.)  I looked at 
3 Apple apps, Safari, Maps, and they omit the content display, and hence 
filtering. It it is only the display that is bugged, they would not show the  
problem.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Terry J. Reedy]

Terry J. Reedy  added the comment:

When I click Full Disk Access in Mohave, I see an empty box with a Header 
something like "All app to access Mail, ..., and all user data".  None of it 
has anything obviously to do with the user Documents folder.  Nor does it seem 
appropriate for a non-top-admin user on a multiuser machine.  Below the box are 
[+][-] buttons.  [+] opens the standard open dialog to select an app to add.  
There is nothing like 
  [ ] Add Python and IDLE

Ned, is Catalina known to have tightened up some security settings?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Zain Said]

Zain Said  added the comment:

Ned, I do not use DropBox nor do i have Desktop & Documents Folders checked 
under my iCloud settings. 

Someone else in the community reached out to me and suggested that if IDLE is 
acting up its not worth the hassle. And that they're alternatives. I came a 
across an editor called Atom. Seems interesting. Might give it a try.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Ned Deily]

Ned Deily  added the comment:

That enabling FullDiskAccess makes a difference makes some sense but that is 
not something we should be recommending without better understanding what's 
going on here. We still need a reproducible test case; I still am not able to 
reproduce. Raymond, your hint about Dropbox is promising; can you say more, 
i.e. do you see hangs if you the folder you are saving to is within your 
Dropbox folder hierarchy? Zain, do you use Dropbox?  And do either of you have 
your Documents folder stored in iCloud:

System Preferences -> Apple ID (top right) -> iCloud -> iCloud Drive (Options) 
-> Documents -> Desktop & Documents Folders (checked)

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Zain Said]

Zain Said  added the comment:

I posted my issue on Experts Exchange and they suggested to go to system 
preferences>Security>go to privacy tab on the top>scroll down to Full 
Disk Access>Add IDLE and Python>then check off the box next to it> 

Since then my issue with IDLE not being able to save (save as) new programs has 
gone away. 

Maybe try this and let me know if this solves you're issue. 

Also I'm fairly new to python and coding in general and i rarely use terminal.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Raymond Hettinger]

Raymond Hettinger  added the comment:

Zain, do you happen to be working in a Dropbox synced directory when you 
observe the failure?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Terry J. Reedy]

Terry J. Reedy  added the comment:

Zain, what I understand is:
> python3.8 -m idlelib # To open idle from Terminal
In IDLE, File=>New, then File=>SaveAs
In dialog opened to Documents, enter name in Save As box, then click Save.

For me 2012? Macbook Air with 10.14.6? Mohave and 3.8.3rc1, dialog disappears 
and the (blank) file is saved, with a confirmation dialog if name exits.

For you, the Documents name list disappears and maybe something else (or vice 
versa) and the dialog freezes.  I presume keys and clicks have no effect.  The 
freezing itself is almost certainly an issue between macOS and tcl/tk 8.6.8.  
If you start IDLE in Terminal, does anything error message appear?

The relevant IDLE code is idlelib.iomenu.IOBInding.asksavefile, which creates 
an instance of tkinter.filedialog.SaveAs and calls its show method, inherited 
from tkinter.commondialog.CommonDialog.  The important line there is 's = 
w.tk.call(self.command, )', where the save as command is 
'tk_getSaveFile'.  This tk command is documented in
https://www.tcl.tk/man/tcl8.6/TkCmd/getOpenFile.htm.  
There are Mac-specific items but nothing jumped out at me as significant for 
this issue.

To debug, and test Raymond's hypothesis, someone please try this minimal 
(IDLE-free) code to show the dialog and print the return.  (Interactive should 
work, at least on IDLE.)

import tkinter as tk
r = tk.Tk()
print(r.tk.call('tk_getSaveFile'))

This does not display a preview, even after selecting a location, such as 
Documents, on the 3rd line.  If that works, try deleting the 'dir' option in 
the .show call.  Other options in the SaveAs and show calls could be 
experimentally deleted if needed.  If something works, we could use 
platform.mac_ver()[0].split('.')[1] to detect Catalina and switch to the 
workaround.

--
versions: +Python 3.9

___
Python tracker 
<https://bugs.python.org/issue40553>
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Zain Said]

Zain Said  added the comment:

The screenshot link is at the top of the thread

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Zain Said]

Zain Said  added the comment:

Sure i'll supply a screenshot 
This problem doesn't effect saving in general after editing existing programs 
by the way.
My process of saving a program:
  - I'll open IDLE (Python 3.8.2)
  - write anything at all
  - I'll either hit command>s or click file>save as then ill be prompted to 
name my program and then save as (also if i want to rename an existing program 
the same issue occurs)
  - after typing in the name of the new program ill click save as then most of 
the window goes blank (you'll see in the screenshot)

--
Added file: https://bugs.python.org/file49139/Screen Shot 2020-05-07 at 3.46.02 
PM.png

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Ned Deily]

Ned Deily  added the comment:

Zain and/or Raymond: can you please give the exact steps to reproduce this 
problem, including exactly how you invoke IDLE, the Python version info and 
build date info from the IDLE shell window, the details of exactly how you 
invoke Save As (i.e whether via clicking on the menu bar File menu or instead 
by using a keyboard shortcut like shift-cmd-S. And when the SaveAs window 
appears perhaps a screen shot or at least what options you have selected 
(icons, list, etc, expanded or compressed window) and what is the default 
folder it opens to. I am not able to reproduce a hang although I do see some 
delays. Also what happens if you just use Save for a new file rather than Save 
As? If it's a new file, that should also produce a Save file window and that's 
what I always use when smoke testing.  EIther should work, of course :(

--
nosy: +ned.deily

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Raymond Hettinger]

Raymond Hettinger  added the comment:

Perhaps we could create an option in the general settings that offers a 
workaround:  open a regular text window to get the filename.  

This wouldn't be as pretty (won't display filenames, offer mouse support, won't 
show file previews), but it would be reliable.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Raymond Hettinger]

Raymond Hettinger  added the comment:

I frequently have this issue as well.  My workaround is awful:  I go to the 
terminal prompt to create an empty file with the desired name, and then open it 
up in IDLE to edit and save.  This avoids the SaveAs dialog window that 
triggers the failure.

This doesn't happen to me with new, empty directories.  So, my best guess is 
that the document preview in the SaveAs window is triggering the failure.  

This problem may go away in the future with a O/S update or with a Tcl/Tk 
update. AFAICT, IDLE doesn't have any way to ask for a simplified FileDialog 
window.

--
assignee:  -> terry.reedy
components: +IDLE
nosy: +rhettinger, terry.reedy
priority: normal -> high

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40553] Python 3.8.2 Mac freezing/not responding when saving new programs

[Zain Said]

New submission from Zain Said :

What I'm currently using: 
Mid 2012 13'' MacBook Pro OS Catalina 10.15.4
Python 3.8.2

I'm having an issue with saving a new python program. When I go to "save as" a 
program python seems to freeze/not . The only way I've been able to get python 
working again is to "Force Quit" the existing process and reopen IDLE. Running 
and writing existing programs seems to be working fine.

--
messages: 368375
nosy: Zain
priority: normal
severity: normal
status: open
title: Python 3.8.2 Mac freezing/not responding when saving new programs
type: crash
versions: Python 3.8

___
Python tracker 
<https://bugs.python.org/issue40553>
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue6461] multiprocessing: freezing apps on Windows

[Davin Potts]

Davin Potts added the comment:

The original issue now appears addressed in the docs (thanks goes to Stuart and 
Jesse) though it was not explicitly tracked here as a patch file.

The follow-on secondary issue from spongebob (if that is your real name) could 
not be reproduced by Richard.

This issue should have been marked closed-resolved some time ago.

--
nosy: +davin
resolution:  - fixed
stage:  - resolved
status: open - closed
type:  - behavior

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6461
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue6461] multiprocessing: freezing apps on Windows

[Mark Lawrence]

Changes by Mark Lawrence breamore...@yahoo.co.uk:


--
nosy:  -BreamoreBoy

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6461
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue6461] multiprocessing: freezing apps on Windows

[Richard Oudkerk]

Richard Oudkerk added the comment:

I just tried freezing the program

  from multiprocessing import freeze_support,Manager

  if __name__ == '__main__':
  freeze_support()
  m=Manager()
  l = m.list([1,2,3])
  l.append(4)
  print(l)
  print(repr(l))

using cx_Freeze with Python 2.7, and it worked fine:

  PS cxfreeze.bat foo.py
  copying C:\Python27\lib\site-packages\cx_Freeze\bases\Console.exe - 
C:\Tmp\dir\dist\foo.exe
  copying C:\Windows\system32\python27.dll - C:\Tmp\dir\dist\python27.dll
  writing zip file C:\Tmp\dir\dist\foo.exe
  ...

  PS dist\foo
  [1, 2, 3, 4]
  ListProxy object, typeid 'list' at 0x206f410

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6461
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue6461] multiprocessing: freezing apps on Windows

[Mark Lawrence]

Mark Lawrence added the comment:

Could someone answer the question posed in msg98154 please.

--
nosy: +BreamoreBoy

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6461
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue6461] multiprocessing: freezing apps on Windows

[Richard Oudkerk]

Changes by Richard Oudkerk shibt...@gmail.com:


--
nosy: +sbt

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6461
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue8771] Socket freezing under load issue on Mac.

[Charles-Francois Natali]

Charles-Francois Natali neolo...@free.fr added the comment:

As explained by Jean-Paul, it's due to the fact that the closed TCP sockets 
spend some time in TIME-WAIT state before being deallocated.
On Linux, this issue can be more or less worked-around using sysctl 
(net.ipv4.tcp_tw_{reuse,recycle}). There might be something similar on OS-X.
It's definitely an OS-level tuning issue.
Suggesting to close.

--
nosy: +neologix

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue8771
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue8771] Socket freezing under load issue on Mac.

[Alice Bevan-McGregor]

Alice Bevan-McGregor al...@gothcandy.com added the comment:

Agreed; I'm now certain it's a local tuning issue.  My first attempt to alter 
the file descriptor limits for local testing resulted in catastrophic system 
failure, though, so I have no clue as to the correct method to alter the 
TIME_WAIT time.

I will continue to investigate, thank you for the lead.

--
resolution:  - invalid
status: open - closed

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue8771
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue8771] Socket freezing under load issue on Mac.

[Terry J. Reedy]

Changes by Terry J. Reedy tjre...@udel.edu:


--
nosy:  -terry.reedy

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue8771
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue10890] IDLE Freezing

[James]

New submission from James jamgoo...@gmail.com:

Recently installed Python 2.7.1 on my MacBook running OS X 10.6.6 and have not 
been able to use IDLE without it freezing. When I force quit it doesn't show 
that it's not responding. I can run scripts fine, but if I were to try to 
copy-paste, or save via command-S, it will lock up completely.

--
assignee: ronaldoussoren
components: Macintosh
messages: 126070
nosy: jamgood96, ronaldoussoren
priority: normal
severity: normal
status: open
title: IDLE Freezing
type: crash
versions: Python 2.7

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue10890
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue10890] IDLE Freezing

[Ned Deily]

Ned Deily n...@acm.org added the comment:

Unfortunately, there are some major stability problems with IDLEs that are 
linked with the Apple-supplied Tcl/Tk 8.5 in OS X 10.6. (See, for instance, 
Issue9763 and Issue10537.) That includes the current python.org 2.7.1 64-bit 
installer.  The simplest workaround at the moment is to use the other, 
32-bit-only 2.7.1 installer for OS X available here:  
http://www.python.org/download/releases/2.7.1/

It uses the Apple Tcl/Tk 8.4 or ActiveTcl 8.4, if present, neither of which 
exhibits these kinds of problems.

--
nosy: +ned.deily
resolution:  - duplicate
stage:  - committed/rejected
status: open - closed
superseder:  - OS X IDLE 2.7 from 64-bit installer hangs when you paste 
something.

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue10890
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue8771] Socket freezing under load issue on Mac.

[Terry J. Reedy]

Terry J. Reedy tjre...@udel.edu added the comment:

This needs to be re-verified on a current version.

--
nosy: +terry.reedy
versions: +Python 2.7, Python 3.2 -Python 2.5, Python 2.6

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue8771
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue8771] Socket freezing under load issue on Mac.

[Jean-Paul Calderone]

Jean-Paul Calderone exar...@twistedmatrix.com added the comment:

Have you looked at the number of TIME_WAIT sockets you have on the system when 
your benchmark gets to the 16000 request mark?

This looks exactly like a regular TCP limitation to me.  You'll find the limit 
on any platform, not just OS X.

--
nosy: +exarkun

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue8771
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue8771] Socket freezing under load issue on Mac.

[Alice Bevan-McGregor]

New submission from Alice Bevan-McGregor al...@gothcandy.com:

Using the wsgiref simple HTTP server or any other capable of  2000 
requests/sec. demonstrates an issue with Macintosh sockets.

Mac OS X Version: 10.6.3 (Build 10D573)
Python Version: 2.6.1 (32-bit)

The minimal application needed to demonstrate the problem is:

import sys, cStringIO
from wsgiref.simple_server import make_server

sys.stderr = cStringIO.StringIO() # disable request logging

def app(environ, start_response):
start_response(200 OK, [('Content-Type', 'text/plain')])
return ['Hello world!\n']

httpd = make_server('', 8080, app)
httpd.serve_forever()

Then hammer the server using Apache Bench:

ab -n 2 -c 5 http://127.0.0.1:8080/

At almost exactly the 16000 request mark socket connections begin to time out.  
Sockets are then freed up at the rate of about 40/second (on my box).  Killing 
the ab run when it freezes then immediately re-trying (and cancelling after a 
few seconds) will show this rate.  Time must pass for some connection 'pool' to 
free the connections before you can do another 16000 requests.

This problem does not appear on the following setup:

Operating System: Gentoo Linux
Python Version: 2.6.4 (32-bit)

--
components: Library (Lib)
messages: 106117
nosy: amcgregor
priority: normal
severity: normal
status: open
title: Socket freezing under load issue on Mac.
type: behavior
versions: Python 2.6

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue8771
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue8771] Socket freezing under load issue on Mac.

[Alice Bevan-McGregor]

Alice Bevan-McGregor al...@gothcandy.com added the comment:

I can confirm this issue also effecting 2.5.4 on my Mac.

--
versions: +Python 2.5

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue8771
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue8771] Socket freezing under load issue on Mac.

[R. David Murray]

R. David Murray rdmur...@bitdance.com added the comment:

Why do you think this is a bug in Python?  I'm not yet saying it isn't, but 
we'll need additional information to show that it is.  Given that it works on 
Linux, it seems like the most likely case would be that it is an issue with the 
OS (perhaps requiring adjusting OS tuning parameters), since the Python socket 
library is a fairly thin wrapper around the OS socket library.

--
nosy: +r.david.murray

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue8771
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue8771] Socket freezing under load issue on Mac.

[Alice Bevan-McGregor]

Alice Bevan-McGregor al...@gothcandy.com added the comment:

Unfortunately, unless I can get instructions on how to properly diagnose socket 
libraries, I've exhausted my ability to debug this.  I used to be a C 
programmer, but that was 12 years ago.

I'm hoping to a) confirm the problem exists on Mac (not just my computer), and 
b) get someone familiar with Python's socket implementation and socket 
programming in general to figure out what's actually going on here.

I also don't have access to Apple's radar bug tracker to check there.  :(

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue8771
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com