[issue16079] list duplicate test names with patchcheck

[Brett Cannon]

Change by Brett Cannon :


--
nosy:  -brett.cannon

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Ned Deily]

Ned Deily  added the comment:

The open proposed PR for this issue has been languishing unreviewed for several 
months now.  Since the proposal is really a request to change our development 
process, I'm nosying Brett and Łukasz (3.9 RM).  In any case, if we would 
decide to add this to our CI, I thine we should only start with the master 
branch so I'm closing the 3.7 and 2.7 backport PRs.

--
nosy: +brett.cannon, lukasz.langa, ned.deily
versions: +Python 3.9 -Python 2.7, Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Change by Xavier de Gaye :


--
pull_requests: +12876

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Xavier de Gaye  added the comment:

Not sure the unittest module is the right place to implement these checks.
The following issues deal with duplicates that are not unittest methods:

#19127 #19128 #36711

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Change by Xavier de Gaye :


--
pull_requests: +12864

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Xavier de Gaye  added the comment:

List of issues entered for all the current duplicate method definitions in 2.7:

#19113 #36711 #36712 #36713

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Raymond Hettinger]

Raymond Hettinger  added the comment:

Should the unittest module grow a feature to scan for duplicate methods?  I 
imagine that duplicate methods are a common problem.

Possibly, inheriting from unittest can be accompanied by a metaclass that has 
__prepare__ with special dictionary that detects and warns about duplicates.

--
nosy: +rhettinger

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Xavier de Gaye  added the comment:

PR 12886 adds a check on duplicate method definitions to the travis() function 
of patchcheck.py.

False positives must be entered to Tools/scripts/duplicates_ignored.txt.

The existing duplicates have been entered to this file (with the corresponding 
bpo issue number in comment) and no duplicates are found currently by 
duplicate_meth_defs.py when run with '--ignore duplicates_ignored.txt'. It is 
expected that these entries would be removed from this file when their issues 
are closed.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Change by Xavier de Gaye :


--
pull_requests: +12812

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Xavier de Gaye  added the comment:

List of issues entered for all the current duplicate method definitions:

#19113 #19119 #36678 #36679
#36680 #36681 #36682 #36683

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Xavier de Gaye  added the comment:

Thanks for the link Gregory. I will write a script based on ast and check its 
output against pylint and against the current script based on tokenize.

The travis() function of Tools/scripts/patchcheck.py may be modified to import 
this script and run it only on files modified by the PR. This may allow the 
pre-commit duplicate check to be installed without waiting for the python test 
suite to be cleaned if the existing duplicates are temporarily added to the 
ignored_duplicates file (assuming an issue has been entered for each one of 
those existing duplicates with a note saying to remove the entry in 
ignored_duplicates when the issue is fixed). Indeed, issues #19113 and #19119 
are still open after they have been entered 5 years ago.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Gregory P. Smith]

Gregory P. Smith  added the comment:

Agreed, making duplicate method definitions a CI failure is the desired end 
state once our test suite is cleaned up and it doesn't have false positives.

FYI - pylint also implements this check quite reliably as function-redefined 
via its pylint.checkers.base.BasicErrorChecker._check_redefinition() method.

https://github.com/PyCQA/pylint/blob/2.2/pylint/checkers/base.py#L843

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Xavier de Gaye  added the comment:

False positives must be added to the 'ignored_duplicates' file in order to have 
duplicate_code_names.py exit with success. Not sure whether this may be 
considered as an annoyance by commiters, if TRAVIS would fail when 
duplicate_code_names.py fails.

All the function or class names duplicates have been removed as false positives 
from the list in my previous post and this single false positive has been 
removed from the duplicate method names:

Lib/test/test_socket.py:4115 InterruptedTimeoutBase.setAlarm

All the duplicates are method names as reported now or five years ago in msg 
198586, so this script should get another command line option to only report 
duplicate method names.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[STINNER Victor]

STINNER Victor  added the comment:

This script should be part of Python and run in the pre-commit CI like Travis 
CI!

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[miss-islington]

miss-islington  added the comment:


New changeset 9f9e029bd2223ecba46eaefecadf0ac252d891f2 by Miss Islington (bot) 
in branch '3.7':
bpo-16079: fix duplicate test method name in test_gzip. (GH-12827)
https://github.com/python/cpython/commit/9f9e029bd2223ecba46eaefecadf0ac252d891f2


--
nosy: +miss-islington

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Gregory P. Smith]

Change by Gregory P. Smith :


--
type: enhancement -> behavior

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[miss-islington]

Change by miss-islington :


--
pull_requests: +12753

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Gregory P. Smith]

Gregory P. Smith  added the comment:


New changeset cd466559c4a312b3c1223a774ad4df19fc4f0407 by Gregory P. Smith in 
branch 'master':
bpo-16079: fix duplicate test method name in test_gzip. (GH-12827)
https://github.com/python/cpython/commit/cd466559c4a312b3c1223a774ad4df19fc4f0407


--
nosy: +gregory.p.smith

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Gregory P. Smith]

Change by Gregory P. Smith :


--
components: +Tests

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Gregory P. Smith]

Change by Gregory P. Smith :


--
keywords: +easy
versions: +Python 3.7, Python 3.8 -Python 3.3, Python 3.4

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Gregory P. Smith]

Change by Gregory P. Smith :


--
pull_requests: +12752
stage:  -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Xavier de Gaye  added the comment:

Upgrading the script to account for Python changes. This is now 
duplicate_code_names_3.py

$ ./python ./duplicate_code_names_3.py --ignore ignored_duplicates Lib/test
Duplicate method names:
Lib/test/test_dataclasses.py:1406 TestCase.test_helper_asdict_builtin_containers
Lib/test/test_dataclasses.py:1579 
TestCase.test_helper_astuple_builtin_containers
Lib/test/test_dataclasses.py:700 TestCase.test_not_tuple
Lib/test/test_dataclasses.py:3245 TestReplace.test_recursive_repr_two_attrs
Lib/test/test_genericclass.py:161 TestClassGetitem.test_class_getitem
Lib/test/test_gzip.py:764 TestCommandLine.test_compress_infile_outfile
Lib/test/test_heapq.py:376 TestErrorHandling.test_get_only
Lib/test/test_importlib/test_util.py:755 
PEP3147Tests.test_source_from_cache_path_like_arg
Lib/test/test_logging.py:328 BuiltinLevelsTest.test_regression_29220
Lib/test/test_sys_setprofile.py:363 
ProfileSimulatorTestCase.test_unbound_method_invalid_args
Lib/test/test_sys_setprofile.py:354 
ProfileSimulatorTestCase.test_unbound_method_no_args
Lib/test/test_utf8_mode.py:198 UTF8ModeTests.test_io_encoding

False positives have been removed from the output of the above command and so, 
all the above methods are effectively duplicates that must be fixed.

--
Added file: https://bugs.python.org/file48265/duplicate_code_names_3.py

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Robert Collins]

Robert Collins added the comment:

FWIW testtools rejects test suites with duplicate test ids; I'm considering 
adding that feature into unittest itself. We'd need an option to make it warn 
rather than error I think, but if we did that we wouldn't need a separate 
script at all.

--
nosy: +rbcollins

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Xavier de Gaye added the comment:

The following issues have been entered for all the above duplicate
names found by duplicate_code_names_2.py:

issue 19112, issue 19113, issue 19114, issue 19115, issue 19116,
issue 19117, issue 19118, issue 19119, issue 19122, issue 19123,
issue 19125, issue 19126, issue 19127, issue 19128

except the following which should be added to ignored_duplicates:

./Lib/test/test_os.py:1290 Win32ErrorTests

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[STINNER Victor]

Changes by STINNER Victor victor.stin...@gmail.com:


--
nosy: +haypo

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Xavier de Gaye added the comment:

duplicate_code_names_2.py uses tokenize to print duplicate code names
within the same scope, excluding property setter/getter/deleter
duplicates, excluding duplicates of nested classes or functions, and
ignoring duplicates listed in a file (run with --help for more
details).  With the attached ignored_duplicates file, it prints the
following output on the root of the current default branch (in about 1
mn on an old laptop):

$ ./duplicate_code_names_2.py --ignore ignored_duplicates .
Duplicate function or class names:
./Lib/test/_test_multiprocessing.py:3047 _TestProcess
./Lib/test/test_os.py:1290 Win32ErrorTests

Duplicate method names:
./Lib/ctypes/test/test_functions.py:316 FunctionTestCase.test_errors
./Lib/distutils/tests/test_cmd.py:80 CommandTestCase.test_ensure_string_list
./Lib/lib2to3/tests/test_fixers.py:1467 Test_dict.test_14
./Lib/lib2to3/tests/test_fixers.py:1472 Test_dict.test_15
./Lib/lib2to3/tests/test_fixers.py:1477 Test_dict.test_17
./Lib/lib2to3/tests/test_fixers.py:1482 Test_dict.test_18
./Lib/lib2to3/tests/test_fixers.py:1487 Test_dict.test_19
./Lib/test/test_complex.py:104 ComplexTest.test_truediv
./Lib/test/test_dis.py:250 DisTests.test_big_linenos
./Lib/test/test_dis.py:294 DisTests.test_dis_object
./Lib/test/test_ftplib.py:537 TestFTPClass.test_mkd
./Lib/test/test_heapq.py:366 TestErrorHandling.test_get_only
./Lib/test/test_import.py:255 ImportTests.test_import_name_binding
./Lib/test/test_regrtest.py:210 ParseArgsTestCase.test_findleaks
./Lib/test/test_smtplib.py:249 DebuggingServerTests.testNotImplemented
./Lib/test/test_webbrowser.py:161 OperaCommandTest.test_open_new
./Lib/unittest/test/testmock/testmock.py:1381 MockTest.test_attribute_deletion
./Lib/xml/dom/minidom.py:379 Attr._get_name
./Mac/Tools/Doc/setup.py:123 DocBuild.makeHelpIndex

--
Added file: http://bugs.python.org/file31891/duplicate_code_names_2.py

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Changes by Xavier de Gaye xdeg...@gmail.com:


Added file: http://bugs.python.org/file31892/ignored_duplicates

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Terry J. Reedy]

Changes by Terry J. Reedy tjre...@udel.edu:


--
versions: +Python 3.4 -Python 3.2

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Xavier de Gaye added the comment:

The attached script, named duplicate_code_names.py, takes a file
name list as argument and prints duplicate code names found in these
files ordered by function, class, method and nested class or
function.

The script output on the whole std lib (see the result in the
attached file std_lib_duplicates.txt):

$ time ./python Tools/scripts/duplicate_code_names.py $(find Lib -name *py)  
std_lib_duplicates.txt
Lib/test/badsyntax_future4.py: compile error: from __future__ imports must 
occur at the beginning of the file (badsyntax_future4.py, line 3)
Lib/test/badsyntax_future6.py: compile error: from __future__ imports must 
occur at the beginning of the file (badsyntax_future6.py, line 3)
Lib/test/badsyntax_future3.py: compile error: future feature rested_snopes is 
not defined (badsyntax_future3.py, line 3)
Lib/test/badsyntax_future9.py: compile error: not a chance 
(badsyntax_future9.py, line 3)
Lib/test/bad_coding.py: compile error: unknown encoding for 
'Lib/test/bad_coding.py': uft-8
Lib/test/badsyntax_future8.py: compile error: future feature * is not defined 
(badsyntax_future8.py, line 3)
Lib/test/badsyntax_3131.py: compile error: invalid character in identifier 
(badsyntax_3131.py, line 2)
Lib/test/badsyntax_future7.py: compile error: from __future__ imports must 
occur at the beginning of the file (badsyntax_future7.py, line 3)
Lib/test/bad_coding2.py: compile error: encoding problem for 
'Lib/test/bad_coding2.py': utf-8
Lib/test/badsyntax_pep3120.py: compile error: invalid or missing encoding 
declaration for 'Lib/test/badsyntax_pep3120.py'
Lib/test/badsyntax_future5.py: compile error: from __future__ imports must 
occur at the beginning of the file (badsyntax_future5.py, line 4)
Lib/lib2to3/tests/data/different_encoding.py: compile error: invalid syntax 
(different_encoding.py, line 3)
Lib/lib2to3/tests/data/py2_test_grammar.py: compile error: invalid token 
(py2_test_grammar.py, line 31)
Lib/lib2to3/tests/data/bom.py: compile error: invalid syntax (bom.py, line 2)
Lib/lib2to3/tests/data/crlf.py: compile error: invalid syntax (crlf.py, line 1)
Lib/__phello__.foo.py: __phello__.foo not a valid module name

real6m14.854s
user6m14.455s
sys 0m0.392s


FWIW running the same command with python 3.2 takes about 2.5
minutes instead of more than 6 minutes (importlib ?).

--
Added file: http://bugs.python.org/file27375/duplicate_code_names.py

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Changes by Xavier de Gaye xdeg...@gmail.com:


Added file: http://bugs.python.org/file27376/std_lib_duplicates.txt

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Xavier de Gaye added the comment:

 I'm not sure if there is ever a use case for duplicate method
 names.  Is there?

property getter, setter, and deleter methods do have the same name.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Xavier de Gaye added the comment:

 Here are a couple examples of test method names that don't begin
 with test_:

 def testLoadTk(self):
 def testLoadTkFailure(self):

Also Lib/test/test_smtplib.py test method names start with 'test'
instead of 'test_' although the 'Regression tests package for Python'
documentation states: The test methods in the test module should
start with test_.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Chris Jerdonek]

Chris Jerdonek added the comment:

For informational purposes, here is where unittest defaults to the prefix 
test for finding test methods:

http://hg.python.org/cpython/file/f11649b21603/Lib/unittest/loader.py#l48

sqlite3 is able to use Check because it manages its own test discovery.  For 
example--

http://hg.python.org/cpython/file/f11649b21603/Lib/sqlite3/test/regression.py#l306

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

New submission from Xavier de Gaye:

See also issue 16056 for the current list of duplicate test names in
the std lib.

The attached patch improves patchcheck.py to list duplicate test
names when running 'make patchcheck'. This patch to the default
branch can also be applied asis to the 2.7 branch.

An example of patchcheck output with the patch applied:

==
$ make patchcheck
./python ./Tools/scripts/patchcheck.py
Getting the list of files that have been added/changed ... 1 file
Fixing whitespace ... 0 files
Fixing C file whitespace ... 0 files
Fixing docs whitespace ... 0 files
Duplicate test names ... 1 test:
  TestErrorHandling.test_get_only in file Lib/test/test_heapq.py
Docs modified ... NO
Misc/ACKS updated ... NO
Misc/NEWS updated ... NO
configure regenerated ... not needed
pyconfig.h.in regenerated ... not needed

Did you run the test suite?

==

--
components: Library (Lib)
files: duplicate_test_names.patch
keywords: patch
messages: 171428
nosy: chris.jerdonek, ezio.melotti, xdegaye
priority: normal
severity: normal
status: open
title: list duplicate test names with patchcheck
type: enhancement
versions: Python 2.7, Python 3.2, Python 3.3
Added file: http://bugs.python.org/file27326/duplicate_test_names.patch

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Éric Araujo]

Éric Araujo added the comment:

Nice feature to do without adding a dependency on a lint tool!

--
nosy: +eric.araujo

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Chris Jerdonek]

Chris Jerdonek added the comment:

I would like to see this written in a way that would let one run it globally or 
on a single file independent of a patch (e.g. an independent script from which 
patchcheck could import certain functions).  Or is that what you explicitly 
didn't want Éric? :)

This would let one do a report or global check as was done for issue 16056.  It 
would also make it a bit easier to check manually that the script is checking 
for duplicates correctly.

Also, some suggestions:

+def testmethod_names(code, name=[]):

It might be clearer to use the name=None form.

+test_files = [fn for fn in python_files if
+  fn.startswith(os.path.join('Lib', 'test'))]

Are you getting the test files in test/ subdirectories of subpackages?  I think 
checking that the file name starts with test_ might be sufficient to get all 
test files.

+if name[-1].startswith('test_'):

I believe 'test' is the prefix that unittest uses.  I'm pretty sure we have 
some tests that don't start with 'test_'.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Ezio Melotti]

Ezio Melotti added the comment:

 I would like to see this written in a way that would let one
 run it globally or on a single file independent of a patch

+1
It can be added to Tools/scripts and imported by patchcheck.

 I'm pretty sure we have some tests that don't start with 'test_'.

IIRC those are just test helpers that are not executed directly.
OTOH I don't see why looking for test_*, every py file might contain duplicate 
names so they should all be checked.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Chris Jerdonek]

Chris Jerdonek added the comment:

Here are a couple examples of test method names that don't begin with test_:

def testLoadTk(self):
def testLoadTkFailure(self):

http://hg.python.org/cpython/file/f1094697d7dc/Lib/tkinter/test/test_tkinter/test_loadtk.py#l9

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Éric Araujo]

Éric Araujo added the comment:

sqlite3 tests use CheckThing style (urgh).

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Ezio Melotti]

Ezio Melotti added the comment:

 Here are a couple examples of test method names that don't begin with test_:

I thought you were talking about test files.  I still don't see why looking for 
test_* methods, every class might contain duplicate method names, so they 
should all be checked.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Chris Jerdonek]

Chris Jerdonek added the comment:

 I thought you were talking about test files.

Oh, I see why you said that then.  To find the test files themselves, this 
logic was used in the patch:

+  fn.startswith(os.path.join('Lib', 'test'))]

Regarding your question for the general case, I'm not sure if there is ever a 
use case for duplicate method names.  Is there?

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Xavier de Gaye]

Xavier de Gaye added the comment:

Using the python class browser (pyclbr.py) in conjunction with the
search for duplicates in the module code object would allow to
restrict the listing of duplicates to functions and methods or even
just to methods (depending on the feature requirements), without
listing the duplicate classes and duplicate nested functions. With
an associated performance cost.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16079] list duplicate test names with patchcheck

[Ezio Melotti]

Ezio Melotti added the comment:

It doesn't necessary have to be limited to methods, anything duplicate might 
turn out to be a bug.  If the script doesn't mix scopes there shouldn't be too 
many false positives, and if they are it shouldn't be a big deal if they are 
reported on the changed file by `make patchcheck`.

 I'm not sure if there is ever a use case for duplicate
 method names.  Is there?

Nothing that can't be done in a more elegant way afaict.

It might make sense for variables though, where you have e.g.:

foo = do_something(x)
foo = do_something_more(foo)

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue16079
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com