Thanks for the swift reply! Having the patch at least means it's not a
blocker anymore.

On Mon, Sep 19, 2016 at 9:18 PM, moon soo Lee <m...@apache.org> wrote:

> Hi,
>
> Thanks for reporting the problem.
> The issue is being tracked by https://issues.apache.org/
> jira/browse/ZEPPELIN-1411 and patch is available at
> https://github.com/apache/zeppelin/pull/1404. Hope we can merge this
> patch to master soon.
>
> Thanks!
> moon
>
> On Mon, Sep 19, 2016 at 2:58 AM Michael Borst <
> michael.bo...@innovation.hrs.com> wrote:
>
>> Hi all,
>>
>> I am experiencing problems with defining UDFs on Zeppelin 0.6.1 backed by
>> spark 2.0.
>>
>> Code:
>>
>> %pyspark
>> from pyspark.sql.functions import udf
>>
>> wrapped_udf = udf(lambda x: x)
>>
>> The call to udf fails with the following error message:
>>
>> Traceback (most recent call last):
>> File 
>> "/var/folders/mr/797qcfdd0wd0vz51n4l0xmxh0000gn/T/zeppelin_pyspark-6894515524820639358.py",
>> line 266, in <module>
>> raise Exception(traceback.format_exc())
>> Exception: Traceback (most recent call last):
>> File 
>> "/var/folders/mr/797qcfdd0wd0vz51n4l0xmxh0000gn/T/zeppelin_pyspark-6894515524820639358.py",
>> line 264, in <module>
>> exec(code)
>> File "<stdin>", line 2, in <module>
>> File "/usr/local/opt/apache-spark/libexec/python/pyspark/sql/functions.py",
>> line 1789, in udf
>> return UserDefinedFunction(f, returnType)
>> File "/usr/local/opt/apache-spark/libexec/python/pyspark/sql/functions.py",
>> line 1751, in __init__
>> self._judf = self._create_judf(name)
>> File "/usr/local/opt/apache-spark/libexec/python/pyspark/sql/functions.py",
>> line 1758, in _create_judf
>> jdt = ctx._ssql_ctx.parseDataType(self.returnType.json())
>> AttributeError: 'JavaMember' object has no attribute 'parseDataType'
>>
>> The same code executed from a regular PySpark shell works fine. Anyone
>> having the same issues or able to provide help?
>>
>> Regards
>>
>> --
>>
>> *Michael Borst*
>> Software Engineer
>>
>> HRS Innovation Hub
>> Web <http://innovation.hrs.com/> • LinkedIn
>> <https://www.linkedin.com/company/hrs-innovation-hub> • Facebook
>> <https://www.facebook.com/hrsinnovation>
>>
>> We're hiring! See openings <https://hrsinnovationhub.recruiterbox.com/>
>> Terms apply to this email: http://j.mp/email-tac
>>
>


-- 

*Michael Borst*
Software Engineer

HRS Innovation Hub
Web <http://innovation.hrs.com/> • LinkedIn
<https://www.linkedin.com/company/hrs-innovation-hub> • Facebook
<https://www.facebook.com/hrsinnovation>

We're hiring! See openings <https://hrsinnovationhub.recruiterbox.com/>
Terms apply to this email: http://j.mp/email-tac

Reply via email to