Hi,
I am about to raise the retention using configuration slicer or a simple
"sed" on the config files. The current setting is 25. It archives the
last 25 builds. I could also set a number of days and require both to be
true. E.g, 5 days and 25 builds. So for fast builds more is preserved.
I will change also the artifact archive as suggested by Dawid in
https://github.com/apache/lucene/issues/14481
Disk space is not really a problem, all artifacts and logs are preserved
on the master (not on windows or mac build slaves with limited space):
Filesystem Size Used Avail Use% Mounted on
tmpfs 6.2G 7.6M 6.2G 1% /run
efivarfs 128K 16K 108K 13% /sys/firmware/efi/efivars
/dev/md127 938G 329G 562G 37% /
tmpfs 31G 0 31G 0% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 31G 0 31G 0% /run/qemu
/dev/nvme0n1p1 253M 323K 252M 1% /boot/efi
/dev/nvme1n1p1 253M 323K 252M 1% /boot/efi2
tmpfs 6.2G 12K 6.2G 1% /run/user/0
I just remember in older Jenkins versions there was an issue with some
n^2 problem when the number of builds to keep raised cleanup times
exponentially. Also the olde rmachines had less disk space. The new
Jenkins has 2 NVMe with each 1 TiB, configured as RAID1 (see md127 above).
Uwe
Am 14.04.2025 um 19:43 schrieb Robert Muir:
When the tests from jenkins fail, we have to be quick to save a copy
of the console.log. It can be attached to a github issue.
Policeman Jenkins runs a ton of jobs, so it does not surprise me that
the retention policy is aggressive. Each one of these console.logs
alone is around 10MB.
I don't have recommendations to make it better: these console logs are
treated special and are different from "artifacts", where you can just
compress them.
Uwe, is there any breathing room to increase retention on the Lucene
jobs? I think even an extra day would allow for fetching the logfile
on a Monday when it finds a bug over the weekend.
On Mon, Apr 14, 2025 at 1:31 PM Michael Sokolov <msoko...@gmail.com> wrote:
Hi Uwe, I just want to see the logs output by failed tests in Jenkins;
I have no need to ssh in
On Mon, Apr 14, 2025 at 1:02 PM Uwe Schindler <u...@thetaphi.de> wrote:
Hi Mike,
I can create you an account to login by SSH, just send me your SSH key.
I removed some very old accounts, but some people still have access. The
new machine basically has the exact same operating system and software
installation like before, just hardware replaced and after that switched
from VirtualBOX to KVM for Windows and macOS builds.
But I do not know what exactly you are looking for. It is not a special
machine, it just has an AMD Ryzen 7700 CPU and Ubuntu 24.04 with HWE
kernel (6.11). I doubt if you can reproduce more on the machine itsself
if you can't reproduce it on your own. It may also be a Java 25 -ea-b15
bug. I need to update the version soon, just a bit busy.
Uwe
Am 14.04.2025 um 13:43 schrieb Michael Sokolov:
I tried to investigate, but don't have (lost?) access to Policeman
Jenkins - I guess it was rebuilt recently? Is there a way to extend
access to Lucene committers at least?
On Sat, Apr 12, 2025 at 9:01 PM Policeman Jenkins Server
<jenk...@thetaphi.de> wrote:
Build: https://jenkins.thetaphi.de/job/Lucene-main-Linux/54509/
Java: 64bit/hotspot/jdk-25-ea+15 -XX:-UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.lucene.search.TestByteVectorSimilarityQuery.testTimeout
Error Message:
java.lang.AssertionError: expected:<445> but was:<444>
Stack Trace:
java.lang.AssertionError: expected:<445> but was:<444>
at
__randomizedtesting.SeedInfo.seed([BA5626C66D47353D:EA6EAD7D08AF1721]:0)
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at
org.apache.lucene.search.BaseVectorSimilarityQueryTestCase.testTimeout(BaseVectorSimilarityQueryTestCase.java:508)
at
org.apache.lucene.search.TestByteVectorSimilarityQuery.testTimeout(TestByteVectorSimilarityQuery.java:26)
at
java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
at java.base/java.lang.reflect.Method.invoke(Method.java:565)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
at
org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
at
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
at
org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
at
org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
at
org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
at
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at
org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
at
org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
at
org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
at
org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
at java.base/java.lang.Thread.run(Thread.java:1447)
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@lucene.apache.org
For additional commands, e-mail: builds-h...@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@lucene.apache.org
For additional commands, e-mail: builds-h...@lucene.apache.org
--
Uwe Schindler
Achterdiek 19, D-28357 Bremen
https://www.thetaphi.de
eMail: u...@thetaphi.de
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
--
Uwe Schindler
Achterdiek 19, D-28357 Bremen
https://www.thetaphi.de
eMail: u...@thetaphi.de
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
