On Thu, Dec 27, 2018 at 11:02 AM Ismaël Mejía <ieme...@gmail.com> wrote:
> Bringing this subject for awareness to dev@ > We are sadly part of this top. > Does somebody know what this data is? And if we can clean it periodically? > Can somebody with more sysadmin super powers take a look and act on this. > > ---------- Forwarded message --------- > From: Chris Lambertus <c...@apache.org> > Date: Thu, Dec 27, 2018 at 1:36 AM > Subject: workspace cleanups needed on jenkins master > To: <bui...@apache.org> > > > All, > > The Jenkins master needs to be cleaned up. Could the following > projects please reduce your usage significantly by 5 January. After 5 > Jan Infra will be purging more aggressively and updating job > configurations as needed. As a rule of thumb, we’d like to see > projects retain no more than 1 week or 7 builds worth of historical > data at the absolute maximum. Larger projects should retain less to > avoid using up a disproportionate amount of space on the master. > > Some workspaces without any identifiable associated Project will be > removed. > > > > 3911 GB . > 275 GB ./incubator-netbeans-linux > 270 GB ./pulsar-website-build > 249 GB ./pulsar-master > 199 GB ./Packaging > 127 GB ./HBase > 121 GB ./PreCommit-ZOOKEEPER-github-pr-build > 107 GB ./Any23-trunk > 102 GB ./incubator-netbeans-release > 79 GB ./incubator-netbeans-linux-experiment > 77 GB ./beam_PostCommit_Java_PVR_Flink_Batch > Wow, this job has huge logs (400MB+). https://builds.apache.org/view/A-D/view/Beam/view/PostCommit/job/beam_PostCommit_Java_PVR_Flink_Batch/330/console A few weeks back I suggested removing the --info flag passed to Gradle. I haven't done that yet, but it might help reduce the size of logs. (which I assume are all stored on master?) Short-term, we could reduce retention back down to 14 instead of the current 30 <https://github.com/apache/beam/blob/5716dba6d10f32dfa8ab807ffacc2e68f9267225/.test-infra/jenkins/CommonJobProperties.groovy#L46> . +Alan Myrvold <amyrv...@google.com> +Mikhail Gryzykhin <mig...@google.com> we don't need 30 days retention any longer for test dashboards, right? > 76 GB ./HBase-1.3-JDK8 > 70 GB ./Jackrabbit-Oak-Windows > 70 GB ./stanbol-0.12 > 59 GB ./HBase-Find-Flaky-Tests > 54 GB ./CouchDB > 51 GB ./beam_PostCommit_Java_PVR_Flink_Streaming > 48 GB ./incubator-netbeans-windows > 47 GB ./FlexJS > 42 GB ./HBase > 41 GB ./pulsar-pull-request > 37 GB ./ZooKeeper_branch35_jdk8 > 32 GB ./HBase-Flaky-Tests > 32 GB ./Atlas-master-NoTests > 31 GB ./Atlas-1.0-NoTests > 31 GB ./beam_PreCommit_Java_Commit > 30 GB ./Zookeeper_UT_Java18 > 29 GB ./Phoenix-4.x-HBase-1.4 > 28 GB ./HBase-2.0-hadoop3-tests > 27 GB ./flink-github-ci > 27 GB ./ZooKeeper_branch35_jdk7 > 27 GB ./oodt-trunk > 25 GB ./opennlp > 25 GB ./Trinidad > 22 GB ./Phoenix-4.x-HBase-1.3 > 21 GB ./ZooKeeper_Flaky_StressTest > 21 GB ./Atlas-master-AllTests > 21 GB ./beam_PostCommit_Java_ValidatesRunner_Flink > 20 GB ./HBase-1.3-JDK7 > 20 GB ./PreCommit-HBASE-Build > 18 GB ./hadoop-trunk-win > 18 GB ./HBase-1.2-JDK7 > 18 GB ./HBASE-14070.HLC > 18 GB ./maven-box > 17 GB ./Atlas-1.0-AllTests > 17 GB ./Archiva-TLP-Gitbox > 17 GB ./Apache > 17 GB ./Phoenix-5.x-HBase-2.0 > 17 GB ./Phoenix-omid2 > 16 GB ./Lucene-Solr-BadApples-NightlyTests-7.x > 15 GB ./HBase-2.0 > 14 GB ./flume-trunk > 14 GB ./beam_PostCommit_Java_ValidatesRunner_Samza > 14 GB ./HBase-Trunk_matrix > 13 GB ./commons-csv > 13 GB ./HBase-Flaky-Tests-old-just-master > 13 GB ./oodt-coverage > 12 GB ./incubator-rya-master-with-optionals > 12 GB ./Syncope-master-deploy > 11 GB ./PreCommit-PHOENIX-Build > 11 GB ./Stratos-Master-Nightly-Build > 11 GB ./Phoenix-master > 11 GB ./Hadoop-trunk-JACC > 10 GB ./ctakes-trunk-package > 10 GB ./FlexJS > 10 GB ./Atlas-1.0-IntegrationTests > 9 GB ./incubator-rya-master > 9 GB ./Atlas-master-IntegrationTests > 9 GB ./beam_PostCommit_Java_ValidatesRunner_Spark > 9 GB ./ZooKeeper_UT_Java7 > 9 GB ./Qpid-Broker-J-7.0.x-TestMatrix > 9 GB ./oodt-dependency-update > 9 GB ./Apache > 8 GB ./Struts-examples-JDK8-master > 8 GB ./Phoenix-4.x-HBase-1.2 > 8 GB ./flume-github-pull-request > 8 GB ./HBase-HBASE-14614 > 8 GB ./tika-trunk-jdk1.7 > 8 GB ./HBase-1.2-JDK8 > 8 GB ./HBase-1.5 > 7 GB ./Atlas-master-UnitTests > 7 GB ./tika-2.x-windows > 7 GB ./incubator-rya-master-with-optionals-pull-requests > 7 GB ./Hive-trunk > 7 GB ./beam_PreCommit_Java_Cron > 7 GB ./Atlas-1.0-UnitTests > 6 GB ./Jackrabbit > 6 GB ./beam_PostCommit_Java_PVR_Flink_PR > 6 GB ./Lucene-Solr-Clover-master > 6 GB ./Syncope-2_0_X-deploy > 6 GB ./beam_PostCommit_Java_ValidatesRunner_Apex > 6 GB ./Tika-trunk > 6 GB ./pirk > 6 GB ./Syncope-2_1_X-deploy > 6 GB ./PLC4X > 6 GB ./myfaces-current-2.0-integration-tests > 5 GB ./commons-lang > 5 GB ./Nemo > 5 GB ./Mesos-Buildbot > 5 GB ./Qpid-Broker-J-7.1.x-TestMatrix > 5 GB ./beam_PostCommit_Java_Nexmark_Flink > 5 GB ./Qpid-Broker-J-TestMatrix > 5 GB ./ZooKeeper-Hammer > 5 GB ./Camel > 5 GB ./Royale > 5 GB ./tika-branch-1x > 5 GB ./ManifoldCF-ant > 5 GB ./PreCommit-SQOOP-Build > 5 GB ./HBase-1.4 > 5 GB ./ZooKeeper_UT_Stress > 4 GB ./beam_PreCommit_Java_Phrase > 4 GB ./dir-studio > 4 GB ./Camel.trunk.notest > 4 GB ./pulsar-release-binaries > 4 GB ./Qpid-Java-Java-6.1.x-TestMatrix > 4 GB ./Oak-Win > 4 GB ./Mesos-Websitebot > 4 GB ./incubator-rya-fork > 4 GB ./Knox-master-verify > 4 GB ./Syncope-Release-Docker > 4 GB ./Lucene-Solr-Clover-7.x > 4 GB ./openmeetings > 4 GB ./Mesos > 4 GB ./apache-atlas-nightly > 4 GB ./Pig-trunk > 4 GB ./beam_PostCommit_Java_ValidatesRunner_Dataflow > 4 GB ./Camel.2.20.x.notest > 3 GB ./PreCommit-HDFS-Build > 3 GB ./airavata-master > 3 GB ./Stratos-41x-Nightly-Build > 3 GB ./oodt-2.0-development > 3 GB ./hadoop-qbt-branch2-java7-linux-x86-jhung > 3 GB ./incubator-rya-fork-with-optionals > 3 GB ./CXF-trunk-deploy > 3 GB ./Camel.trunk.notest.java9 > 3 GB ./Lens-Commit > 3 GB ./commons-imaging > 3 GB ./Giraph-trunk-site > 3 GB ./Zookeeper-trunk-single-thread > 3 GB ./brooklyn-dist-master > 3 GB ./ZooKeeper-trunk > 3 GB ./Mesos-Buildbot-Test > 3 GB ./cloudstack-pr-analysis > 3 GB ./Knox-master-daily > 2 GB ./incubator-netbeans-javadoc > 2 GB ./ZooKeeper-trunk-java10 > 2 GB ./beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow > 2 GB ./mailbox > 2 GB ./ODFToolkit > 2 GB ./beam_PostCommit_Java_ValidatesRunner_Gearpump > 2 GB ./Curator > 2 GB ./beam_PreCommit_JavaPortabilityApi_Commit > 2 GB ./ODFToolkit-windows > 2 GB ./Log4jCore > 2 GB ./Apache-Falcon-Distributed-Assembly > 2 GB ./ZooKeeper-trunk-openjdk10 > 2 GB ./Stratos-Master-Commit-Build > 2 GB ./mahout-nightly > 2 GB ./Stratos-41x-Commit-Build > 2 GB ./tika-2.x > 2 GB ./james-server-trunk > 2 GB ./ZooKeeper-trunk-java9 > 2 GB ./OpenMeetings > 2 GB ./Solr-Artifacts-master > 2 GB ./isis > 2 GB ./Solr-Artifacts-7.x > 2 GB ./Lucene-Solr-Tests-5.5 > 2 GB ./Solr-Artifacts-7.6 > 2 GB ./ZooKeeper-trunk-clover > 2 GB ./airavata-dev > 2 GB ./HBASE-16264 > 2 GB ./ZooKeeper-trunk-java11 > 2 GB ./Camel.2.19.x.notest > 2 GB ./drill-scm > 2 GB ./HBase-Trunk-IT > 2 GB ./sling-site > 2 GB ./HBase-0.98-matrix > 2 GB ./Chemistry >
smime.p7s
Description: S/MIME Cryptographic Signature
