[ 
https://issues.apache.org/jira/browse/HADOOP-16358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865437#comment-16865437
 ] 

RuiChen commented on HADOOP-16358:
----------------------------------

Zhenyu Zheng and I work for [OpenLab|https://openlabtesting.org/] (a community 
to do open source project testing, this is OpenLab 
[Charter|https://github.com/theopenlab/governance/blob/master/CHARTER.md]).
 We hope to help more open source software worked on ARM, Hadoop is important 
one. We have a developer team, some ARM resources and [OpenLab CI 
infrastructure|http://status.openlabtesting.org/] (based on Zuul) to involve 
the target.

I also saw Hadoop team already had a CI infrastructure run on Jenkins, OpenLab 
can share some ARM testing resources to Hadoop Jenkins CI system in order to 
avoiding to change the current development habit. It's not necessary to change 
Jenkins CI to OpenLab CIĀ in Hadoop (OpenLab CI is valuable for some projects 
that don't have CI infrastructure)

OpenLab team will work with Hadoop team to do the following things:
 # Enable ARM resources in Hadoop Jenkins CI
 # Enable Hadoop ARM testing jobs (Compile, UT, functional tests)
 # Some developers to maintain ARM CI jobs and handle testing failures

Rome wasn't built in a day, so we plan to start a simple target to add ARM 
build job for Hadoop, to verify Hadoop and its subprojects can be compiled on 
ARM successfully, OpenLab's developers will maintain build CI jobs and address 
the CI issues, then we can add more complex test cases on ARM, like: unit tests 
and functional tests, step by step, it's a long term works. Of course, welcome 
another developers join to maintain the ARM CI.

We will start a topic to discuss these ARM works in Hadoop mail list to get 
more feedback and make a community consensus.

Thank you paying attention.

> Add an ARM CI for Hadoop
> ------------------------
>
>                 Key: HADOOP-16358
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16358
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Zhenyu Zheng
>            Priority: Major
>
> Now the CI of Hadoop is handled by jenkins. While the tests are running under 
> x86 ARCH, the ARM arch has not being considered. This leads an problem that 
> we don't have a way to test every pull request that if it'll break the Hadoop 
> deployment on ARM or not.
> We should add a CI system that support ARM arch. Using it, Hadoop can 
> officially support arm release in the future. Here I'd like to introduce 
> OpenLab to the community. [OpenLab|https://openlabtesting.org/] is a open 
> source CI system that can test any open source software on either x86 or arm 
> ARCH, it's mainly used by github projects. Now some 
> [projects|https://github.com/theopenlab/openlab-zuul-jobs/blob/master/zuul.d/jobs.yaml]
>  has integrated it already. Such as containerd (a graduated CNCF project, the 
> arm build will be triggerd in every PR, 
> [https://github.com/containerd/containerd/pulls]), terraform and so on.
> OpenLab uses the open source CI software [Zuul 
> |https://github.com/openstack-infra/zuul] for CI system. Zuul is used by 
> OpenStack community as well. integrating with OpneLab is quite easy using its 
> github app. All config info is open source as well.
> If apache Hadoop community has interested with it, we can help for the 
> integration.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to