[
https://issues.apache.org/jira/browse/HADOOP-16358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904887#comment-16904887
]
Zhenyu Zheng edited comment on HADOOP-16358 at 8/12/19 6:41 AM:
----------------------------------------------------------------
Hi All,
I would like to pushing this forward again and update some of our progress.
To be clear again, our goal is to make Big Data related projects more capable
to be running on ARM platforms, Openlab is just one possible tool that we are
using, we are willing to donate ARM resources.
We have now a running job for building Hadoop trunk on ARM in OpenLab
http://status.openlabtesting.org/builds?job_name=hadoop-build-arm64
we discovered some problem and made some work-arounds to made the build
successful, and we are try to pushing some of the fix like:
https://issues.apache.org/jira/browse/HADOOP-13363
We are also tring to run full tests in our platform and yet we are still
debuging.
As for the mainainers for ARM related stuff, we will have a team doing it for
upstream.
And yet we already have some progress in Flink community:
https://issues.apache.org/jira/browse/INFRA-18822
So I hope we could push this forward in Hadoop too.
was (Author: kevin_zheng):
Hi All,
I would like to pushing this forward again and update some of our progress.
To be clear again, our goal is to make Big Data related projects more capable
to be running on ARM platforms, Openlab is just one possible tool that we are
using, we are willing to donate ARM resources.
We have now a running job for building Hadoop trunk on ARM in OpenLab
http://status.openlabtesting.org/builds?job_name=hadoop-build-arm64
we discovered some problem and made some work-arounds to made the build
successful, and we are try to pushing some of the fix like:
https://issues.apache.org/jira/browse/HADOOP-13363
We are also tring to run full tests in our platform and yet we are still
debuging.
As for the mainainers for ARM related stuff, we will have a team doing it for
upstream.
> Add an ARM CI for Hadoop
> ------------------------
>
> Key: HADOOP-16358
> URL: https://issues.apache.org/jira/browse/HADOOP-16358
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
> Reporter: Zhenyu Zheng
> Priority: Major
>
> Now the CI of Hadoop is handled by jenkins. While the tests are running under
> x86 ARCH, the ARM arch has not being considered. This leads an problem that
> we don't have a way to test every pull request that if it'll break the Hadoop
> deployment on ARM or not.
> We should add a CI system that support ARM arch. Using it, Hadoop can
> officially support arm release in the future. Here I'd like to introduce
> OpenLab to the community. [OpenLab|https://openlabtesting.org/] is a open
> source CI system that can test any open source software on either x86 or arm
> ARCH, it's mainly used by github projects. Now some
> [projects|https://github.com/theopenlab/openlab-zuul-jobs/blob/master/zuul.d/jobs.yaml]
> has integrated it already. Such as containerd (a graduated CNCF project, the
> arm build will be triggerd in every PR,
> [https://github.com/containerd/containerd/pulls]), terraform and so on.
> OpenLab uses the open source CI software [Zuul
> |https://github.com/openstack-infra/zuul] for CI system. Zuul is used by
> OpenStack community as well. integrating with OpneLab is quite easy using its
> github app. All config info is open source as well.
> If apache Hadoop community has interested with it, we can help for the
> integration.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
