Greetings!
We are having issues with our Artemis pod in K8S, the pod memory size slowly
grows and it is eventually OOM killed, at least our cloud ops team sees its pod
memory growing steadily.
Sometimes we also see that the pod is not OOM killed but kind of grinds to a
halt, which in my experience is consistent with mostly-exhausted JVM heap.
However... we never seem to get an OutOfMemoryError.
The command-line as reported from the pod is
/opt/java/openjdk/bin/java -XX:AutoBoxCacheMax=20000 -XX:+PrintClassHistogram
-XX:+UseG1GC -XX:+UseStringDeduplication -Xms512M -Xmx2G
-Dhawtio.disableProxy=true -Dhawtio.realm=activemq -Dhawtio.offline=true
-Dhawtio.rolePrincipalClasses=org.apache.activemq.artemis.spi.core.security.jaas.RolePrincipal
-Dhawtio.http.strictTransportSecurity=max-age=31536000;includeSubDomains;preload
-Djolokia.policyLocation=file:/var/lib/artemis-instance/./etc/jolokia-access.xml
-Dlog4j2.disableJmx=true --add-opens java.base/jdk.internal.misc=ALL-UNNAMED
-javaagent:/var/lib/artemis-instance/lib/jmx_prometheus_javaagent.jar=8080:/var/lib/artemis-instance/etc/artemis.yml
-Dcom.sun.management.jmxremote=true -Dcom.sun.management.jmxremote.port=1099
-Dcom.sun.management.jmxremote.rmi.port=1098
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.authenticate=false -Dhawtio.role=amq
-Djava.security.auth.login.config=/var/lib/artemis-instance/etc/login.config
-classpath /opt/activemq-artemis/lib/artemis-boot.jar
-Dartemis.home=/opt/activemq-artemis
-Dartemis.instance=/var/lib/artemis-instance
-Djava.library.path=/opt/activemq-artemis/bin/lib/linux-x86_64
-Djava.io.tmpdir=/var/lib/artemis-instance/tmp
-Ddata.dir=/var/lib/artemis-instance/data
-Dartemis.instance.etc=/var/lib/artemis-instance/etc
org.apache.activemq.artemis.boot.Artemis run
Seems like the heap limit of 2GB should be just fine, we are setting our K8S
pod request/limit to 3GB.
Mostly what I'm after is advice for enabling logging or diagnostics that would
help to understand what is happening.
Thanks
john
PLEASE NOTE: This e-mail from Redpoint Global Inc. ("Redpoint") is confidential
and is intended solely for the use of the individual(s) to whom it is
addressed. If you believe you received this e-mail in error, please notify the
sender immediately, delete the e-mail from your computer and do not copy, print
or disclose it to anyone else. If you properly received this e-mail as a
customer, partner or vendor of Redpoint, you should maintain its contents in
confidence subject to the terms and conditions of your agreement(s) with
Redpoint.
