[issue25588] Run test suite from IDLE idlelib.run subprocess

Terry J. Reedy added the comment: Running the file containing 'import test.autotest' directly with python gives the test_aifc failure and the same bizarre behavior after test_concurrent_futures. Testing restarts apparently in 5 parallel threads or processes. The lines of

[issue25588] Run test suite from IDLE idlelib.run subprocess

Terry J. Reedy added the comment: New changeset 0fee56c86344386bde8486ab803f564cb8a5203b by Terry Jan Reedy in branch '3.6': [3.6] bpo-25588: Document autotest in idle_test/README.txt. (GH-4000) (#4001)

[issue25588] Run test suite from IDLE idlelib.run subprocess

Change by Terry J. Reedy : -- pull_requests: +3974 stage: commit review -> patch review ___ Python tracker ___

[issue25588] Run test suite from IDLE idlelib.run subprocess

Terry J. Reedy added the comment: New changeset 620f70eed615efde35517d7ae86354de3b2a0d03 by Terry Jan Reedy in branch 'master': bpo-25588: Document autotest in idle_test/README.txt. (#4000) https://github.com/python/cpython/commit/620f70eed615efde35517d7ae86354de3b2a0d03

[issue25588] Run test suite from IDLE idlelib.run subprocess

Terry J. Reedy added the comment: The README patch will finish this issue. Fixing individual failures and investigating the crash will be new issues. -- ___ Python tracker

[issue25588] Run test suite from IDLE idlelib.run subprocess

Terry J. Reedy added the comment: As I reported on related #31761, importing autotest on Windows 10 has 3 errors with Python's shell and 4 with IDLE's, with two of those the same as the python shell failures. IDLE can be detected in at least two ways. >>> import sys;

[issue25588] Run test suite from IDLE idlelib.run subprocess

Change by Terry J. Reedy : -- pull_requests: +3973 ___ Python tracker ___ ___

[issue25588] Run test suite from IDLE idlelib.run subprocess

STINNER Victor added the comment: New changeset 6234e9068332f61f935cf13fa5b1a924a99c28b2 by Victor Stinner (Miss Islington (bot)) in branch '3.6': [3.6] bpo-25588: Fix regrtest when run inside IDLE (GH-3962) (#3987)

[issue25588] Run test suite from IDLE idlelib.run subprocess

Change by Roundup Robot : -- pull_requests: +3963 ___ Python tracker ___

[issue25588] Run test suite from IDLE idlelib.run subprocess

STINNER Victor added the comment: New changeset ccef823939d4ef602f2d8d13d0bfec29eda597a5 by Victor Stinner in branch 'master': bpo-25588: Fix regrtest when run inside IDLE (#3962) https://github.com/python/cpython/commit/ccef823939d4ef602f2d8d13d0bfec29eda597a5

[issue25588] Run test suite from IDLE idlelib.run subprocess

STINNER Victor added the comment: Serhiy: "If some tests are failed on IDLE I would prefer to fix or skip only these tests." Ok, go ahead. There are many failing tests :-) -- ___ Python tracker

[issue25588] Run test suite from IDLE idlelib.run subprocess

Serhiy Storchaka added the comment: I think it would be nice to make testing so flexible as possible. This would help to get rid of unintended assumptions. If some tests are failed on IDLE I would prefer to fix or skip only these tests. --

[issue25588] Run test suite from IDLE idlelib.run subprocess

STINNER Victor added the comment: I proposed PR 3962 to fix a few issues in regrtest when sys.stdout and sys.stderr have to file descriptor. I'm not sure that we should promote running tests with unusual sys.stdout and sys.stderr, since many tests fail in that case.

[issue25588] Run test suite from IDLE idlelib.run subprocess

Change by STINNER Victor : -- keywords: +patch pull_requests: +3940 stage: needs patch -> patch review ___ Python tracker ___

[issue25588] Run test suite from IDLE idlelib.run subprocess

Changes by Terry J. Reedy : -- versions: -Python 2.7, Python 3.4, Python 3.5 ___ Python tracker ___

[issue25588] Run test suite from IDLE idlelib.run subprocess

Terry J. Reedy added the comment: The premise of the issue is this: if IDLE is started with 'pythonx', then running 'filex' from a IDLE editor is equivalent to running "python x -i filex" at a command line. For instance, loading test.__main__ into an editor and running should give the same

[issue25588] Run test suite from IDLE idlelib.run subprocess

New submission from Terry J. Reedy: This issue proposes stress testing idlelib.run by running code that already reports whether results are as expected or not -- the test_suite. Since this one test will take at least as long as the test suite, and will probably need human intervention