[ 
https://issues.apache.org/jira/browse/TEZ-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18080098#comment-18080098
 ] 

Raghav Aggarwal commented on TEZ-4355:
--------------------------------------

[~abstractdog] , I was thinking maybe the following can be done:
 # Upload build-tools docker image in tez docker registry. I think this will 
save both time and compute by not building docker image repeatedly.
 # Build the complete project with fresh m2 repo -> Generate spotbugs, 
checkstyle, javadocs, codespell etc *only on diff patch* -> RUN UT on complete 
project irrespective of content of PR
 # Possibly print yetus like summary at end.

I haven't explored much on optimizing the stages but the current CI is prone to 
errors. Let me know if its something that I can help by picking this task or 
reviewing the current PR. _From my POV this is very high priority task — 
unless, of course, we're actively looking forward to the thrill of a ticking 
timebomb going off in prod._

> Unit test precommit improvements - full coverage
> ------------------------------------------------
>
>                 Key: TEZ-4355
>                 URL: https://issues.apache.org/jira/browse/TEZ-4355
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: László Bodor
>            Assignee: László Bodor
>            Priority: Major
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> 1. What about running all unit tests in precommit? With the current precommit 
> load in Tez project, it's worth trying (however it needs some flakiness fixes)
> 2. Run tests in splits in a parallel fashion: 2 different, deterministic 
> splits could be a) tez-tests module vs. b) all the rest



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to