Github user liancheng commented on the pull request:
https://github.com/apache/spark/pull/13280#issuecomment-221457588
I had once tried to upgrade Parquet to 1.8.1, and one more change needs to
be done for the upgrade:
https://github.com/apache/spark/pull/9225/files#diff-b4108187503e0f3ac64c1630d266b122R115
For the performance regression, here is the full thread of previous
discussion:
https://mail-archives.apache.org/mod_mbox/parquet-dev/201510.mbox/<[email protected]>
I had tried to bisect, but failed to find anything useful. I thought 1.8.2
would probably be release soon at that time, so didn't try hard to dig it...
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
