[
https://issues.apache.org/jira/browse/BEAM-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ismaël Mejía updated BEAM-8569:
-------------------------------
Description:
It seems that Hadoop 3 in production is finally happening. CDH supports it in
their latest version and Spark 3 will include support for Hadoop 3 too.
This is an uber ticket to cover the required changes to the codebase to ensure
compliance with Hadoop 3.x
Hadoop dependencies in Beam are mostly provided and APIs are until some point
compatible, but we may require changes in the CI to test that new changes work
both in Hadoop 2 and Hadoop 3 until we decide to remove support for Hadoop 2.
was:
It seems that Hadoop 3 in production is finally happening. CDH supports it in
their latest version and Spark 3 will include support for Hadoop 3 too.
This is an uber ticket to cover the required changes to the codebase to ensure
compliance with Hadoop 3.x
Hadoop dependencies in Beam are mostly provided and APIs are until some point
compatible, but we may require changes in the CI to test that new changes work
both in Hadoop 2 and Hadoop 3 until we decide to remove support for Hadoop 3.
> Support Hadoop 3 on Beam
> ------------------------
>
> Key: BEAM-8569
> URL: https://issues.apache.org/jira/browse/BEAM-8569
> Project: Beam
> Issue Type: Improvement
> Components: io-java-hadoop-file-system
> Reporter: Ismaël Mejía
> Assignee: Piotr Szuberski
> Priority: P3
>
> It seems that Hadoop 3 in production is finally happening. CDH supports it in
> their latest version and Spark 3 will include support for Hadoop 3 too.
> This is an uber ticket to cover the required changes to the codebase to
> ensure compliance with Hadoop 3.x
> Hadoop dependencies in Beam are mostly provided and APIs are until some point
> compatible, but we may require changes in the CI to test that new changes
> work both in Hadoop 2 and Hadoop 3 until we decide to remove support for
> Hadoop 2.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
