[
https://issues.apache.org/jira/browse/HADOOP-16358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949947#comment-16949947
]
Zhenyu Zheng commented on HADOOP-16358:
---------------------------------------
It has been quite a while since anyone replied on this issue, I would like to
provide some updates on this.
We have identified some of the current blocker of making Hadoop successful
running on Aarch64 platform and sent out ML for discussion:
http://hadoop-common.472056.n3.nabble.com/DISCUSS-ARM-aarch64-support-for-Hadoop-td4190435.html
and there was discussions about protocbuf upgrade and Vinayakumar, Duo Zhang
and Akira Ajisaka have done alot about protocbuf and the progress seems well:
https://issues.apache.org/jira/browse/HADOOP-13363
At the same time, we also keep trying to build and test Hadoop components on
ARM machines and finding possible solutions, like:
https://issues.apache.org/jira/browse/HADOOP-16614
We hope that this could prove that we are willing to debugging and maintaining
ARM related stuff in Hadoop comunity in long term.
So, I would like to propose to push this again, we want to add an ARM CI to the
current CI system, we could donate servers to the existing CI system, it could
be starting with a periodic job or maybe just for one of the components, and we
can see how it goes, and judge on the next steps. This could also be good for
others that are interested on solving problems for Aarch64 platform as they can
see the log and pointing out possible causes and provide solutions, this could
speed up the whole process.
> Add an ARM CI for Hadoop
> ------------------------
>
> Key: HADOOP-16358
> URL: https://issues.apache.org/jira/browse/HADOOP-16358
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
> Reporter: Zhenyu Zheng
> Priority: Major
>
> Now the CI of Hadoop is handled by jenkins. While the tests are running under
> x86 ARCH, the ARM arch has not being considered. This leads an problem that
> we don't have a way to test every pull request that if it'll break the Hadoop
> deployment on ARM or not.
> We should add a CI system that support ARM arch. Using it, Hadoop can
> officially support arm release in the future. Here I'd like to introduce
> OpenLab to the community. [OpenLab|https://openlabtesting.org/] is a open
> source CI system that can test any open source software on either x86 or arm
> ARCH, it's mainly used by github projects. Now some
> [projects|https://github.com/theopenlab/openlab-zuul-jobs/blob/master/zuul.d/jobs.yaml]
> has integrated it already. Such as containerd (a graduated CNCF project, the
> arm build will be triggerd in every PR,
> [https://github.com/containerd/containerd/pulls]), terraform and so on.
> OpenLab uses the open source CI software [Zuul
> |https://github.com/openstack-infra/zuul] for CI system. Zuul is used by
> OpenStack community as well. integrating with OpneLab is quite easy using its
> github app. All config info is open source as well.
> If apache Hadoop community has interested with it, we can help for the
> integration.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
