Github user viirya commented on the pull request:
https://github.com/apache/spark/pull/6146#issuecomment-113790943
@marmbrus Although the code looks problematic, I mentioned on the JIRA that
I can't reproduce the problem. By more testing, I found that in your PR #5876
(https://github.com/apache/spark/pull/5876/files#diff-ee66e11b56c21364760a5ed2b783f863R620)
you modified how to produce hive partition objects where you populate
partition's schema from table schema.
So any newly added columns in hive table will appear in its partitions'
schema too. That is why I can't produce this problem. Thus, all non-partition
key attributions will always exist in table partitions. And this reported bug
is solved by the PR #5876. Because of that, I think I can close this PR now.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
