Cheryl Sabella <[email protected]> added the comment:
There was a parameter `punctuation_chars` added to the shlex.shlex class with
issue 1521950 (implemented for 3.6). Although the comma is not one of the
default punctuation characters (setting the parameter to punctuation_chars=True
won't change the behavior), you can use `punctuation_chars=","` to see the
results reported in this issue.
>>> second = shlex.shlex('word1 word2,\nword3', punctuation_chars=',')
>>> second.get_token()
'word1'
>>> second.lineno
1
>>> second.get_token()
'word2'
>>> second.lineno
1
>>> second.get_token()
','
>>> second.lineno
2
>>>
Closing this as a duplicate of #1521950.
----------
nosy: +cheryl.sabella
resolution: -> duplicate
stage: -> resolved
status: open -> closed
superseder: -> shlex.split() does not tokenize like the shell
_______________________________________
Python tracker <[email protected]>
<https://bugs.python.org/issue19120>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe:
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
