[
https://issues.apache.org/jira/browse/HBASE-24936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17216106#comment-17216106
]
Duo Zhang commented on HBASE-24936:
-----------------------------------
OK, I think the problem is that, we just publish all the files in our
workspaces to the htmlreports... Besides the htmlreports, we only have these
small things
{noformat}
zhangduo@zhangduo-ubuntu:~/hbase$ grep
"HBase/jobs/HBase-Find-Flaky-Tests/branches/branch-2/builds/126"
usage-hbase-find-flaky.txt | grep -v htmlreports
115M HBase/jobs/HBase-Find-Flaky-Tests/branches/branch-2/builds/126
36K HBase/jobs/HBase-Find-Flaky-Tests/branches/branch-2/builds/126/workflow
32K
HBase/jobs/HBase-Find-Flaky-Tests/branches/branch-2/builds/126/workflow/flowNodeStore.xml
32K HBase/jobs/HBase-Find-Flaky-Tests/branches/branch-2/builds/126/archive
24K HBase/jobs/HBase-Find-Flaky-Tests/branches/branch-2/builds/126/log
24K HBase/jobs/HBase-Find-Flaky-Tests/branches/branch-2/builds/126/build.xml
20K
HBase/jobs/HBase-Find-Flaky-Tests/branches/branch-2/builds/126/archive/dashboard.html
8.0K HBase/jobs/HBase-Find-Flaky-Tests/branches/branch-2/builds/126/commits
4.0K HBase/jobs/HBase-Find-Flaky-Tests/branches/branch-2/builds/126/log-index
4.0K
HBase/jobs/HBase-Find-Flaky-Tests/branches/branch-2/builds/126/commits/050b67f2-7d41-42b4-880b-99658afa3340
4.0K
HBase/jobs/HBase-Find-Flaky-Tests/branches/branch-2/builds/126/archive/includes
4.0K
HBase/jobs/HBase-Find-Flaky-Tests/branches/branch-2/builds/126/archive/excludes
0
HBase/jobs/HBase-Find-Flaky-Tests/branches/branch-2/builds/126/changelog7810497979642074129.xml
{noformat}
This is how we publish the html report
{code}
post {
always {
// Has to be relative to WORKSPACE.
archiveArtifacts artifacts: "includes,excludes,dashboard.html"
publishHTML target: [
allowMissing: true,
keepAll: true,
alwaysLinkToLastBuild: true,
// Has to be relative to WORKSPACE
reportDir: ".",
reportFiles: 'dashboard.html',
reportName: 'Flaky Test Report'
]
}
}
{code}
Let me google the meaning of the properties of publishHTML to see what is the
problem...
> review Jenkins build artifacts
> ------------------------------
>
> Key: HBASE-24936
> URL: https://issues.apache.org/jira/browse/HBASE-24936
> Project: HBase
> Issue Type: Task
> Reporter: Sean Busbey
> Assignee: Sean Busbey
> Priority: Critical
> Attachments: usage-hbase-find-flaky.zip, usage-hbase-full.zip
>
>
> Post move to the ci-hadoop build servers we are now the biggest user of
> space. That is not a problem in and of itself, but the master node has run
> out of disk space twice now. As of this snapshot we are using 125GB of
> storage and the next largest project is only using 20GB.
> https://paste.apache.org/kyrds
> We should review our builds for any issues and come up with expectations for
> what our steady-state disk usage should look like
> * we are supposed to compress any test logs (usually this gets us 90-99%
> space savings)
> * we are supposed to clean up workspaces when jobs are done
> * we are supposed to keep a fixed window of prior builds (either by days or
> number of runs)
> If all of our jobs are currently following these guidelines, another
> possibility is to push the artifacts we need over to
> [nightlies.a.o|https://nightlies.apache.org/authoring.html]. Barring that, we
> should formally request asf infra set up [a plugin for storing artifact on
> s3|https://plugins.jenkins.io/artifact-manager-s3/].
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
