[
https://issues.apache.org/jira/browse/HUDI-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
张超明 updated HUDI-1586:
----------------------
Description:
In my oppions, the hadoop configuration totally read from the actual
environment. For example, the {{fs.hdfs.impl}} may be
{{org.apache.hadoop.fs.viewfs.ViewFileSyste}} but not
{{org.apache.hadoop.hdfs.DistributedFileSystem}}. Now, the implemtation was
forced to be set with {{org.apache.hadoop.hdfs.DistributedFileSystem}}, which
is not a graceful solution.
Also, the hadoop dependency scope level should be 'test'.
was:
In my oppions, the hadoop configuration totally read from the actual
environment. For example, the {{fs.hdfs.impl}} may be
{{org.apache.hadoop.fs.viewfs.ViewFileSyste}} but not
{{org.apache.hadoop.hdfs.DistributedFileSystem}}. Now, the implemtation was
forced to be set with {{org.apache.hadoop.hdfs.DistributedFileSystem}}, which
is not a graceful solution.
Also, the hadoop dependency scope level should be 'test'.
> Reduce the coupling of hadoop.
> ------------------------------
>
> Key: HUDI-1586
> URL: https://issues.apache.org/jira/browse/HUDI-1586
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Common Core, Flink Integration
> Reporter: 张超明
> Priority: Major
>
> In my oppions, the hadoop configuration totally read from the actual
> environment. For example, the {{fs.hdfs.impl}} may be
> {{org.apache.hadoop.fs.viewfs.ViewFileSyste}} but not
> {{org.apache.hadoop.hdfs.DistributedFileSystem}}. Now, the implemtation was
> forced to be set with {{org.apache.hadoop.hdfs.DistributedFileSystem}}, which
> is not a graceful solution.
> Also, the hadoop dependency scope level should be 'test'.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
