Re: [PYTHON] PySpark typing hints

2017-05-23 Thread Maciej Szymkiewicz
t; Thanks, > > Assaf. > > > > *From:*Maciej Szymkiewicz [mailto:mszymkiew...@gmail.com] > *Sent:* Tuesday, May 23, 2017 3:27 PM > *To:* Mendelson, Assaf > *Subject:* Re: [PYTHON] PySpark typing hints > > > > > > > > On 05/23

Re: [PYTHON] PySpark typing hints

2017-05-23 Thread Maciej Szymkiewicz
It doesn't break anything at all. You can take stub files as-is, put these into PySpark root, and as long as users are not interested in type checking, it won't have any runtime impact. Surprisingly the current MyPy build (mypy==0.511) reports only one incompatibility with Python 2 (dynamic

RE: [PYTHON] PySpark typing hints

2017-05-23 Thread assaf.mendelson
:10 PM To: Mendelson, Assaf Subject: Re: [PYTHON] PySpark typing hints Seems useful to do. Is there a way to do this so it doesn't break Python 2.x? On Sun, May 14, 2017 at 11:44 PM, Maciej Szymkiewicz <[hidden email]> wrote: Hi everyone, For the last few months I've been working on stati

Re: [PYTHON] PySpark typing hints

2017-05-23 Thread Reynold Xin
Seems useful to do. Is there a way to do this so it doesn't break Python 2.x? On Sun, May 14, 2017 at 11:44 PM, Maciej Szymkiewicz wrote: > Hi everyone, > > For the last few months I've been working on static type annotations for > PySpark. For those of you, who are

[PYTHON] PySpark typing hints

2017-05-14 Thread Maciej Szymkiewicz
Hi everyone, For the last few months I've been working on static type annotations for PySpark. For those of you, who are not familiar with the idea, typing hints have been introduced by PEP 484 (https://www.python.org/dev/peps/pep-0484/) and further extended with PEP 526