GitHub user robert3005 opened a pull request:
https://github.com/apache/spark/pull/20914
[SPARK-23802][SQL] PropagateEmptyRelation can leave query plan in
unresolved state
## What changes were proposed in this pull request?
Add cast to nulls introduced by PropagateEmptyRelation so in cases they're
part of coalesce they will not break its type checking rules
## How was this patch tested?
Added unit test
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/robert3005/spark rk/propagate-empty-fix
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20914.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20914
----
commit 1e7dbca93fe5e0e2457ff4ba1015e170c5e59afd
Author: Robert Kruszewski <robertk@...>
Date: 2018-03-12T11:26:04Z
cast
commit 47bed8554e1f73de1f9fcf318885eb9f53629442
Author: Robert Kruszewski <robertk@...>
Date: 2018-03-27T13:22:53Z
it actually works
commit 04dd395272578500e111ccbeb928a3bea9cc19fc
Author: Robert Kruszewski <robertk@...>
Date: 2018-03-27T15:38:27Z
propagate empty fix
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
