Maciej, this looks great. Could you open a JIRA issue for improving the @udf decorator and possibly sub-tasks for the specific features from the gist? Thanks!
rb On Sat, Jan 7, 2017 at 12:39 PM, Maciej Szymkiewicz <mszymkiew...@gmail.com> wrote: > Hi, > > I've been looking at the PySpark UserDefinedFunction and I have a couple > of suggestions how it could be improved including: > > - Full featured decorator syntax. > - Docstring handling improvements. > - Lazy initialization. > > I summarized all suggestions with links to possible solutions in gist ( > https://gist.github.com/zero323/88953975361dbb6afd639b35368a97b4) and > I'll be happy to open a JIRA and submit a PR if there is any interest in > that. > > -- > Best, > Maciej > > -- Ryan Blue Software Engineer Netflix