[
https://issues.apache.org/jira/browse/KAFKA-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alagukannan updated KAFKA-13257:
--------------------------------
Attachment: hs_err_pid6.log
> KafkaStreams Support For Latest RocksDB Version
> -----------------------------------------------
>
> Key: KAFKA-13257
> URL: https://issues.apache.org/jira/browse/KAFKA-13257
> Project: Kafka
> Issue Type: Bug
> Components: streams
> Affects Versions: 2.8.0
> Reporter: Alagukannan
> Priority: Major
> Attachments: hs_err_pid6.log
>
>
> Hi,
> Can you please let us know if there is any plan for adding the latest
> versions of rocksDB in kafka streams. If your planning it what's the timeline
> we are looking at. If not planning to upgrade what's the reason behind it. Is
> there any significant impact on upgrading like backward combability etc..
> Just to remind this general query to know about the rocksdb upgrade and its
> impact on streams application.
> The main pain point behind this upgradation is, We tried to build an
> application with kafka streams 2.8.0 on an alpine based OS and the docker
> base image is as follows
> azul/zulu-openjdk-alpine:11.0.12-11.50.19-jre-headless. The streams
> application worked fine until it had an interaction with state
> store(rocksdb). The jvm crashed with the following error:
> #
> # A fatal error has been detected by the Java Runtime Environment:
> #
> # SIGSEGV (0xb) at pc=0x00007f9551951b27, pid=6, tid=207
> #
> # JRE version: OpenJDK Runtime Environment Zulu11.45+27-CA (11.0.10+9)
> (build 11.0.10+9-LTS)
> # Java VM: OpenJDK 64-Bit Server VM Zulu11.45+27-CA (11.0.10+9-LTS, mixed
> mode, tiered, compressed oops, g1 gc, linux-amd64)
> # Problematic frame:
> # C [librocksdbjni15322693993163550519.so+0x271b27]
> std::_Rb_tree<std::string, std::string, std::_Identity<std::string>,
> std::less<std::string>, std::allocator<std::string>
> >::_M_erase(std::_Rb_tree_node<std::string>*)+0x27
> Then we found out rocksdb works well on glibc and not musl lib, where as
> alpine supports musl lib alone for native dependencies. Further looking into
> rocksdb for a solution we found that they have started supporting both glib
> and musl native libs from 6.5.x versions.
> But latest kafka streams(2.8.0) is having rocksdb(5.18.x) version. This is
> the main reason behind asking for the rocksDB upgrade in kafka streams as
> well.
> Have attached the PID log where JVM failures are happening.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)