Re: Java 17 and Lucene

Just circling back here with some of our (Product Search at Amazon) findings on running Lucene with JDK 17 in production (to hopefully motivate other teams to also upgrade their JDKs). We have not had any stability issues or any hanging machines so far. When we switched to JDK17 from JDK15, our pr

Re: Java 17 and Lucene

Or just keep your small heap and tweak the 200ms target to be a lower value. It is just a JVM parameter, and it is dumb as rocks: That 200ms constant doesn't consider how many cores you have, or how small your heap is. On Tue, Oct 26, 2021 at 11:42 PM Michael Sokolov wrote: > > Uwe, thanks for p

Re: Java 17 and Lucene

Uwe, thanks for pointing out that ZGC is associated with all the pauses you've observed. I'm feeling more confident now (since we are generally using G1GC anyway, although sometimes experimenting with other things). Indeed GC pauses have been much less of a problem since we started using G1 to the

RE: Java 17 and Lucene

Hi, > Is this recommended "-XX:+UseZGC options to enable ZGC." as it claims very > low pauses. You may have seen my prvious post that JDK 16, 17 and 18 have hangs on our build server. All of those hanging builds have one thing in common: They are running with ZGC. So my answer in short: Don’t u

Re: Java 17 and Lucene

Michael, Is this recommended "-XX:+UseZGC options to enable ZGC." as it claims very low pauses. For "*DY* (2021-10-19 08:14:33): Upgrade to JDK17+35" execution for "Indexing throughput " is ZGC used for the "Indexing throughput

Re: Java 17 and Lucene

The "System Requirements" page for each release lists the JDK it was built with and tested most extensively with; eg https://lucene.apache.org/core/8_10_1/SYSTEM_REQUIREMENTS.html (JDK8 there; 9.0 will target JDK11) That is pretty conservative but safe. Generally speaking we are always testing cut

Re: Java 17 and Lucene

Nightly benchmarks managed to succeed (once, so far) on JDK 17: https://home.apache.org/~mikemccand/lucenebench/ No obvious performance changes on quick look. Mike McCandless http://blog.mikemccandless.com On Tue, Oct 19, 2021 at 8:42 PM Gautam Worah wrote: > Thanks for the note of caution U

Re: Java 17 and Lucene

Thanks for the note of caution Uwe. > On our Jenkins server running with AMD Ryzen CPU it happens quite often that JDK 16, JDK 17 and JDK 18 hang during tests and stay unkillable (only a hard kill with" kill -9") Scary stuff. I'll try to reproduce the hang first and then try to get the JVM logs.

Re: Java 17 and Lucene

Thank you all for the information, it's very useful. Seems like it's best to hold off on upgrading for now, but great to know that different JDK versions are at least being exercised in CI. I'm wondering, is there a better way to assess the production readiness of a Lucene/JDK combination than jus

Re: Java 17 and Lucene

> I would a bit careful: On our Jenkins server running with AMD Ryzen CPU it > happens quite often that JDK 16, JDK 17 and JDK 18 hang during tests and stay > unkillable (only a hard kill with" kill -9"). Previous Java versions don't > hang. It happens not all the time (about 1/4th of all builds

RE: Java 17 and Lucene

Hi, > > On a side note, the Lucene codebase still uses the deprecated (as of > > JDK17) AccessController > > in the RamUsageEstimator class. > > We suppressed the warning for now (based on recommendations > > > > dev/202106.mbox/%3CJIRA.1336944

RE: Java 17 and Lucene

Hi, > Hey, > > Our team at Amazon Product Search recently ran our internal benchmarks with > JDK 17. > We saw a ~5% increase in throughput and are in the process of > experimenting/enabling it in production. > We also plan to test the new Corretto Generational Shenandoah GC. I would a bit carefu

Re: Java 17 and Lucene

Hey, Our team at Amazon Product Search recently ran our internal benchmarks with JDK 17. We saw a ~5% increase in throughput and are in the process of experimenting/enabling it in production. We also plan to test the new Corretto Generational Shenandoah GC. On a side note, the Lucene codebase sti

Re: Java 17 and Lucene

Also, I try to semi-aggressively upgrade Lucene's nightly benchmarks to new JDK releases and leave an annotation on the nightly charts: https://home.apache.org/~mikemccand/lucenebench/ I just now upgraded to JDK 17 and kicked off a new benchmark run ... in a few hours it should show the new data p

Re: Java 17 and Lucene

We test different releases on different platforms (e.g. Linux, Windows, Mac). We also test EA (Early Access) releases of openjdk versions during the development process. This finds bugs before they get released. More information about versions/EA testing: https://jenkins.thetaphi.de/ On Mon, Oct

Java 17 and Lucene

Hello, We are using Lucene 8 and planning to upgrade from Java 11 to Java 17. We are curious: - How lucene is testing against java versions. Are there correctness and performance tests using java 17? - Additionally, besides Java 17, how are new Java releases tested? - Are there any