Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/17671
To me, for the similar reason -
https://github.com/apache/spark/pull/17671#pullrequestreview-81100230, I think
I am less sure of adding this.
For the workaround you described @kxepal -
https://github.com/apache/spark/pull/17671#issuecomment-298768608,
> This was found as very inconvenient way since you'll have to always wrap
all your functions. Easy to forget to do.
If this is the reason to add the support of thirdparty library support, it
sounds not quite compelling. I think you can even just simply monkey-patch
`udf` or `UserDefinedFunction`. It wouldn't be too difficult.
This gives me an impression that there are many easy workarounds and I
would like to avoid adding overhead of maintaining such cases, but rather
focuses on more core stuff.
It might be best to just share documentation and the monkey patches to
mailing list.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
