[
https://issues.apache.org/jira/browse/TEZ-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17249622#comment-17249622
]
Zoltan Haindrich commented on TEZ-4259:
---------------------------------------
cool; I could share a few things we've choosen when we've started using
Jenkinsfile/github PR-s which might be important:
* ci-hive is on top of a kubernetes cluster
** the Jenkinsfile not only asks for a "slave"; it asks for a kubernetes pods
*** this approach makes everything more isolated
*** easier to reproduce since all the containers running can be run lockally as
well (although in practice it's not that easy - but it can be done; I think its
easier to do than ssh into jenkins slaves and try to figure out "whats going
on")
** better control over whats code is running
** docker-in-docker can be configured in case the tests would need to utilize
docker during testing
* github PRs are great ; however the Jenkins plugin has 2 modes of "operation"
** (1) one will merge the current master with the PR head
** (2) the other will run the PR as-is (not merging the master at all)
* the jenkins job "should" be cleaned up - and for that people should enable
the "branch scanner" as well
** the problem with these last 2 points is that we want (1) when running tests;
however running the "scanner" for all the existing PRs will re-discover all
existing PRs which already had testruns in case the master has new commits -
I'll try to come up with a solution for this in the future....it needs some
tweaking....
If you guys would like to run the tez-precommit tests in a k8s like fashion -
I'll be happy to help setting it up...
> Create Jenkinsfile for use with tez-multibranch (github yetus integration)
> --------------------------------------------------------------------------
>
> Key: TEZ-4259
> URL: https://issues.apache.org/jira/browse/TEZ-4259
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Jonathan Turner Eagles
> Assignee: Jonathan Turner Eagles
> Priority: Major
> Attachments: TEZ-4259.001.patch, TEZ-4259.002.patch
>
>
> Clone hadoop-multibranch to tez-multibranch
> https://ci-hadoop.apache.org/job/tez-multibranch/
> Couple of choices to base Jenkinsfile from.
> Scan will need a Jenkins file to correctly start builds based on github PR.
> Hadoop Jenkinsfile
> https://github.com/apache/hadoop/blob/trunk/Jenkinsfile
> HBase Jenkinsfile
> https://github.com/apache/hbase/blob/master/dev-support/Jenkinsfile_GitHub
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
