GitHub user xuanyuanking opened a pull request:
https://github.com/apache/spark/pull/22326
[SPARK-25314][SQL] Fix Python UDF accessing attibutes from both side of
join in join conditions
## What changes were proposed in this pull request?
Thanks for @bahchis reporting this. It is more like a follow up work for
#16581, this PR fix the scenario of Python UDF accessing attributes from both
side of join in join condition.
## How was this patch tested?
Add regression tests in PySpark and `BatchEvalPythonExecSuite`.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/xuanyuanking/spark SPARK-25314
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22326.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22326
----
commit 23b10283500b18462a71eb525d4762dd33c3d4fa
Author: Yuanjian Li <xyliyuanjian@...>
Date: 2018-09-04T06:43:14Z
Fix Python UDF accessing attibutes from both side of join in join conditions
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
