Thank you Alexandre, this is good information. Is there a way to run nimbus and supervisor with one version and the topology with another version of JVM? For example, nimbus/supervisor and half of many topologies with Hotspot8, while the other half of topologies with AdoptOpenJdk11?
The reason why I ask is that I’d like to slowly migrate from 8 to 11 over a long period of time. Therefore, I need to support this dual configuration. What yaml property I need to set to direct each topology to run a JVM version? Thanks Ramin ----- Original Message ----- From: Alexandre Vermeerbergen <[email protected]> To: RAMIN FARAJOLLAH, [email protected] At: 13-Jun-2020 10:11:49 Hello Ramin, I have been running Storm topologies built with a JDK8 with AdopOpenJDK11 run-time for powering Nimbus and the worker (Supervisor, etc) processes. It works pretty well (we had to patch some Hadoop dependencies for HDFS/HBase bolts because they are old and have a flaky detection of Java version), but other than this we're in production with Java 11 runtime with Storm 1.2.3 for about 1 year. We have about 15 topologies, based on Kafka spouts & bolts (connected to a Kafka broker 2.3.1), with lots of Redis usage (based on vanilla Jedis client). Disclaimers: * Using AdoptOpenJDK11 with OpenJ9 for Supervisor processes leads to strange crashes in Closure storm code. We had to switch to AdoptOpenJDK11 with HotSpot to have stability. We plan to retry OpenJ9 flavor when we will have migrated to Storm 2.x * We have not yet tried to compile our topologies with JDK11 Hope it helps, Alexandre Vermeerbergen Le sam. 13 juin 2020 à 15:15, Ramin Farajollah (BLOOMBERG/ 731 LEX) <[email protected]> a écrit : > > Hi, > > We’re using Storm 1.2 with Java Hotspot 8. > We’d like to upgrade to AdoptOpenJdk 11. > > I build my app and submit the topology with the later version. Normally, I > should run nimbus and supervisor with the same version so the topology is > started with v11 as well. However I intend to run a mix of v8 and v11 > topologies with the same nimbus/supervisor. > > Questions: > 1. Is this possible or the trio must run with the same JVM version? > 2. Can I use the current Storm jar with 11 or I’ll need to rebuild it from > source? Note: we use Kafka and zookeeper too. > > Thank you > Ramin > > >
