[
https://issues.apache.org/jira/browse/BEAM-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973499#comment-16973499
]
Lukasz Gajowy edited comment on BEAM-8616 at 11/13/19 4:39 PM:
---------------------------------------------------------------
[~iemejia] I agree, however, I can't find the label - which one do you have in
mind?
was (Author: łukaszg):
I agree, however, I can't find the label - which one do you have in mind?
> ParquetIO should have Hadoop dependencies as provided
> -----------------------------------------------------
>
> Key: BEAM-8616
> URL: https://issues.apache.org/jira/browse/BEAM-8616
> Project: Beam
> Issue Type: Sub-task
> Components: io-java-parquet
> Affects Versions: 2.16.0
> Reporter: Ismaël Mejía
> Assignee: Ismaël Mejía
> Priority: Major
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> ParquetIO has the hadoop-client dependency as a compile-time dependency
> however this dependency should be provided by the user as defined in
> parquet-hadoop. By pinning a hadoop version we are limiting users from
> providing different Hadoop jars (as they can with native Parquet), it also
> limits us from providing different hadoop versions to test that the Parquet
> module is compatible with Hadoop 3 (when it will).
> Note this is a 'backwards incompatible' change in the sense that users might
> need to explicitly provide the dependency from now on.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
