[
https://issues.apache.org/jira/browse/PARQUET-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17559120#comment-17559120
]
ASF GitHub Bot commented on PARQUET-2158:
-----------------------------------------
steveloughran commented on PR #976:
URL: https://github.com/apache/parquet-mr/pull/976#issuecomment-1167200968
i will do a separate PR to remove `PathGlobPattern`; not this week though.
It is used in DeprecatedFieldProjectionFilter, and that is used in
org.apache.parquet.hadoop.thrift.ThriftReadSupport if
"parquet.thrift.column.filter" is set. that use would have to be cut and rather
than just print a deprecation warning, actually fail.
nobody must be using this on anything with ASF hadoop binaries 3.2+ or they
would have complained about linkage errors by now.
> Upgrade Hadoop dependency to version 3.2.0
> ------------------------------------------
>
> Key: PARQUET-2158
> URL: https://issues.apache.org/jira/browse/PARQUET-2158
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-mr
> Affects Versions: 1.13.0
> Reporter: Steve Loughran
> Priority: Major
>
> Parquet still builds against Hadoop 2.10. This is very out of date and does
> not work with java 11, let alone later releases.
> Upgrading the dependency to Hadoop 3.2.0 makes the release compatible with
> java 11, and lines up with active work on HADOOP-18287, _Provide a shim
> library for modern FS APIs_
> This will significantly speed up access to columnar data, especially in
> cloud stores.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
