[
https://issues.apache.org/jira/browse/HDDS-11877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Doroszlai updated HDDS-11877:
------------------------------------
Description:
Maven cache is not restored in CI for some checks, which use Maven only for
getting Ozone version. Looks like even these need the cache.
Background:
Acceptance check intermittently seems to be stuck before executing any tests:
{code:title=https://github.com/apache/ozone/actions/runs/12198919237/job/34037623484#step:5:1}
Fri, 06 Dec 2024 14:42:43 GMT Run pushd hadoop-ozone/dist/target/ozone-*
Fri, 06 Dec 2024 14:42:43 GMT pushd hadoop-ozone/dist/target/ozone-*
Fri, 06 Dec 2024 14:42:43 GMT sudo mkdir .aws && sudo chmod 777 .aws && sudo
chown 1000 .aws
Fri, 06 Dec 2024 14:42:43 GMT popd
Fri, 06 Dec 2024 14:42:43 GMT ./hadoop-ozone/dev-support/checks/acceptance.sh
Fri, 06 Dec 2024 14:42:43 GMT shell: /usr/bin/bash -e {0}
Fri, 06 Dec 2024 14:42:43 GMT env:
Fri, 06 Dec 2024 14:42:43 GMT ...
Fri, 06 Dec 2024 14:42:43 GMT
~/work/ozone/ozone/hadoop-ozone/dist/target/ozone-2.0.0-SNAPSHOT
~/work/ozone/ozone
Fri, 06 Dec 2024 14:42:43 GMT ~/work/ozone/ozone
Fri, 06 Dec 2024 16:10:56 GMT Error: The operation was canceled.
{code}
With {{set -x}} we can see it is executing mvn:
{code:title=https://github.com/adoroszlai/ozone/actions/runs/12202954381/job/34045955438#step:5:42}
++ mvn help:evaluate -Dexpression=ozone.version -q -DforceStdout -Dscan=false
{code}
It is downloading artifacts, which can sometimes be painfully slow (see also
HDDS-11872). Even in the "normal" case it takes almost 1 minute vs. 1 second:
{code:title=https://github.com/adoroszlai/ozone/actions/runs/12210176044/job/34065948974#step:4:154}
# with cache
[INFO] Total time: 1.817 s
{code}
{code:title=https://github.com/adoroszlai/ozone/actions/runs/12210172399/job/34065941115#step:3:830}
# no cache
[INFO] Total time: 53.632 s
{code}
was:
Acceptance check intermittently seems to be stuck before executing any tests:
{code:title=https://github.com/apache/ozone/actions/runs/12198919237/job/34037623484#step:5:1}
Fri, 06 Dec 2024 14:42:43 GMT
Run pushd hadoop-ozone/dist/target/ozone-*
Fri, 06 Dec 2024 14:42:43 GMT
pushd hadoop-ozone/dist/target/ozone-*
Fri, 06 Dec 2024 14:42:43 GMT
sudo mkdir .aws && sudo chmod 777 .aws && sudo chown 1000 .aws
Fri, 06 Dec 2024 14:42:43 GMT
popd
Fri, 06 Dec 2024 14:42:43 GMT
./hadoop-ozone/dev-support/checks/acceptance.sh
Fri, 06 Dec 2024 14:42:43 GMT
shell: /usr/bin/bash -e {0}
Fri, 06 Dec 2024 14:42:43 GMT
env:
Fri, 06 Dec 2024 14:42:43 GMT
...
Fri, 06 Dec 2024 14:42:43 GMT
~/work/ozone/ozone/hadoop-ozone/dist/target/ozone-2.0.0-SNAPSHOT
~/work/ozone/ozone
Fri, 06 Dec 2024 14:42:43 GMT
~/work/ozone/ozone
Fri, 06 Dec 2024 16:10:56 GMT
Error: The operation was canceled.
{code}
With {{set -x}} we can see it is executing mvn:
{code:title=https://github.com/adoroszlai/ozone/actions/runs/12202954381/job/34045955438#step:5:21}
+++ dirname ./hadoop-ozone/dev-support/checks/acceptance.sh
++ cd ./hadoop-ozone/dev-support/checks
++ pwd
+ DIR=/home/runner/work/ozone/ozone/hadoop-ozone/dev-support/checks
+ cd /home/runner/work/ozone/ozone/hadoop-ozone/dev-support/checks/../../..
++ pwd -P
+ OZONE_ROOT=/home/runner/work/ozone/ozone
+ :
+ : MR
+ :
+ : robot
+ : true
+ source /home/runner/work/ozone/ozone/hadoop-ozone/dev-support/checks/_lib.sh
+++ basename ./hadoop-ozone/dev-support/checks/acceptance.sh
++ check_name=acceptance.sh
++ check_name=acceptance
+++ pwd
++ : /home/runner/work/ozone/ozone/.dev-tools
++ : true
+ REPORT_DIR=/home/runner/work/ozone/ozone/target/acceptance
+ REPORT_FILE=/home/runner/work/ozone/ozone/target/acceptance/summary.txt
++ mvn help:evaluate -Dexpression=ozone.version -q -DforceStdout -Dscan=false
{code}
It is downloading artifacts, which can sometimes be painfully slow (see also
HDDS-11872).
Maven cache is not restored in CI for some checks, which use Maven only for
getting Ozone version. Looks like even these need the cache.
> Restore Maven cache for more checks
> -----------------------------------
>
> Key: HDDS-11877
> URL: https://issues.apache.org/jira/browse/HDDS-11877
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: CI
> Reporter: Attila Doroszlai
> Assignee: Attila Doroszlai
> Priority: Major
>
> Maven cache is not restored in CI for some checks, which use Maven only for
> getting Ozone version. Looks like even these need the cache.
> Background:
> Acceptance check intermittently seems to be stuck before executing any tests:
> {code:title=https://github.com/apache/ozone/actions/runs/12198919237/job/34037623484#step:5:1}
> Fri, 06 Dec 2024 14:42:43 GMT Run pushd hadoop-ozone/dist/target/ozone-*
> Fri, 06 Dec 2024 14:42:43 GMT pushd hadoop-ozone/dist/target/ozone-*
> Fri, 06 Dec 2024 14:42:43 GMT sudo mkdir .aws && sudo chmod 777 .aws &&
> sudo chown 1000 .aws
> Fri, 06 Dec 2024 14:42:43 GMT popd
> Fri, 06 Dec 2024 14:42:43 GMT
> ./hadoop-ozone/dev-support/checks/acceptance.sh
> Fri, 06 Dec 2024 14:42:43 GMT shell: /usr/bin/bash -e {0}
> Fri, 06 Dec 2024 14:42:43 GMT env:
> Fri, 06 Dec 2024 14:42:43 GMT ...
> Fri, 06 Dec 2024 14:42:43 GMT
> ~/work/ozone/ozone/hadoop-ozone/dist/target/ozone-2.0.0-SNAPSHOT
> ~/work/ozone/ozone
> Fri, 06 Dec 2024 14:42:43 GMT ~/work/ozone/ozone
> Fri, 06 Dec 2024 16:10:56 GMT Error: The operation was canceled.
> {code}
> With {{set -x}} we can see it is executing mvn:
> {code:title=https://github.com/adoroszlai/ozone/actions/runs/12202954381/job/34045955438#step:5:42}
> ++ mvn help:evaluate -Dexpression=ozone.version -q -DforceStdout -Dscan=false
> {code}
> It is downloading artifacts, which can sometimes be painfully slow (see also
> HDDS-11872). Even in the "normal" case it takes almost 1 minute vs. 1 second:
> {code:title=https://github.com/adoroszlai/ozone/actions/runs/12210176044/job/34065948974#step:4:154}
> # with cache
> [INFO] Total time: 1.817 s
> {code}
> {code:title=https://github.com/adoroszlai/ozone/actions/runs/12210172399/job/34065941115#step:3:830}
> # no cache
> [INFO] Total time: 53.632 s
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
