[
https://issues.apache.org/jira/browse/SUBMARINE-792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang updated SUBMARINE-792:
--------------------------------------
Description:
More recently, the precommit takes hours to complete, a lot of it is spent on
running UT for different combination of Hadoop, Spark and Ranger.
Given our direction to prioritize K8s support, it seems like a good time to
drop some Hadoop versions (we currently support Hadoop 2.9, 2.10, 3.1 and 3.2).
I propose we keep only the latest version. That'll save us about 22 minutes per
precommit.
Similarly, we now test against Ranger 1.0, 1.1, 1.2 and 2.0. I'll file another
jira to discuss the removal of old Ranger support.
was:
More recently, the precommit takes hours to complete, a lot of it is spent on
running UT for different combination of Hadoop, Spark and Ranger.
Given our direction to prioritize K8s support, it seems like a good time to
drop some Hadoop versions (we currently support Hadoop 2.9, 2.10, 3.1 and 3.2).
I propose we keep only the latest version.
Similarly, we now test against Ranger 1.0, 1.1, 1.2 and 2.0. I'll file another
jira to discuss the removal of old Ranger support.
> Drop old Hadoop version support
> -------------------------------
>
> Key: SUBMARINE-792
> URL: https://issues.apache.org/jira/browse/SUBMARINE-792
> Project: Apache Submarine
> Issue Type: Task
> Reporter: Wei-Chiu Chuang
> Assignee: Wei-Chiu Chuang
> Priority: Major
>
> More recently, the precommit takes hours to complete, a lot of it is spent on
> running UT for different combination of Hadoop, Spark and Ranger.
> Given our direction to prioritize K8s support, it seems like a good time to
> drop some Hadoop versions (we currently support Hadoop 2.9, 2.10, 3.1 and
> 3.2). I propose we keep only the latest version. That'll save us about 22
> minutes per precommit.
> Similarly, we now test against Ranger 1.0, 1.1, 1.2 and 2.0. I'll file
> another jira to discuss the removal of old Ranger support.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
