[issue32536] ast and tokenize disagree about line number

[Arjun]

Arjun  added the comment:

Well actually, it depends on the platform?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue32536] ast and tokenize disagree about line number

[Arjun]

Arjun  added the comment:

the line numbers are different for me too (MacOS).

it seems that tokenize module is off by +1 line

--
nosy: +CCLDArjun

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue32536] ast and tokenize disagree about line number

[Irit Katriel]

Change by Irit Katriel :


--
versions: +Python 3.11 -Python 2.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue32536] ast and tokenize disagree about line number

[Nitish]

Nitish  added the comment:

What should happen ideally? The stray '\r' be treated like a whitespace?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue32536] ast and tokenize disagree about line number

[Nitish]

Change by Nitish :


--
nosy: +nitishch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue32536] ast and tokenize disagree about line number

[Mark Shannon]

New submission from Mark Shannon :

This occurs (on linux at least) when the the end of line sequence `\r\r\n` 
occurs in a comment that is indented relative to the following lines.

The attached file demonstrates the problem.

--
components: Library (Lib)
files: tokenize_fail_test.py
messages: 309852
nosy: Mark.Shannon
priority: normal
severity: normal
status: open
title: ast and tokenize disagree about line number
type: behavior
versions: Python 2.7
Added file: https://bugs.python.org/file47380/tokenize_fail_test.py

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com