[
https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933001#comment-16933001
]
huangtianhua edited comment on SPARK-29106 at 9/19/19 2:31 AM:
---------------------------------------------------------------
[~dongjoon], thanks :)
Till now we made two arm test periodic jobs for spark in OpenLab, one is based
on master with hadoop 2.7, other one is based on a new branch which we made on
date 09-09, see
[http://status.openlabtesting.org/builds/job/spark-master-unit-test-hadoop-2.7-arm64]
and
[http://status.openlabtesting.org/builds/job/spark-unchanged-branch-unit-test-hadoop-2.7-arm64,|http://status.openlabtesting.org/builds/job/spark-unchanged-branch-unit-test-hadoop-2.7-arm64]
I think we only have to care about the first one when integrate arm test with
amplab jenkins. In fact we have took test for k8s on arm, see
[https://github.com/theopenlab/spark/pull/17], maybe we can integrate it later.
And we plan test on other stable branches too, and we can integrate them to
amplab when they are ready.
We have offered an arm instance and sent the infos to shane knapp, thanks shane
to add the first arm job to amplab jenkins :)
ps: the issues found and fixed list:
SPARK-28770
[https://github.com/apache/spark/pull/25673]
SPARK-28519
[https://github.com/apache/spark/pull/25279]
SPARK-28433
[https://github.com/apache/spark/pull/25186]
was (Author: huangtianhua):
[~dongjoon], thanks :)
Till now we made two arm test periodic jobs for spark in OpenLab, one is based
on master with hadoop 2.7, other one is based on a new branch which we made on
date 09-09, see
[http://status.openlabtesting.org/builds/job/spark-master-unit-test-hadoop-2.7-arm64]
and
[http://status.openlabtesting.org/builds/job/spark-unchanged-branch-unit-test-hadoop-2.7-arm64,|http://status.openlabtesting.org/builds/job/spark-unchanged-branch-unit-test-hadoop-2.7-arm64]
I think we only have to care about the first one when integrate arm test with
amplab jenkins. In fact we have took test for k8s on arm, see
[https://github.com/theopenlab/spark/pull/17], maybe we can integrate it later.
And we plan test on other stable branches too, and we can integrate them to
amplab when they are ready.
We have offered an arm instance and sent the infos to shane knapp, thanks shane
to add the first arm job to amplab jenkins :)
ps: the issues found and fixed list:
[{color:#172b4d}{color}|https://github.com/apache/spark/pull/25186]SPARK-28770
[|https://github.com/apache/spark/pull/25186]
[https://github.com/apache/spark/pull/25673]
SPARK-28519
[https://github.com/apache/spark/pull/25279]
SPARK-28433
[https://github.com/apache/spark/pull/25186]
> Add jenkins arm test for spark
> ------------------------------
>
> Key: SPARK-29106
> URL: https://issues.apache.org/jira/browse/SPARK-29106
> Project: Spark
> Issue Type: Test
> Components: Tests
> Affects Versions: 3.0.0
> Reporter: huangtianhua
> Priority: Minor
>
> Add arm test jobs to amplab jenkins. OpenLab will offer arm instances to
> amplab to support arm test for spark.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
