Github user rtreffer commented on the pull request:
https://github.com/apache/spark/pull/6796#issuecomment-113276153
I was thinking about this: Create a small parquet file with spark, load it
with hive, copy it to a new parquet table with hive, read that with spark.
If that matches the input -> win. Otherwise -> some more work.
PS: SPARK-8342 / SPARK-8359 were only problems during my initial tests.
It's a bit harder to test read/write of Decimal if the implementation has bugs.
So those are unrelated to this patch, but they might reduce the usefulness of
this patch (you can't do reliable math in the ranges you could now load/save)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
