Re: JNI linker issue on ARM (Raspberry PI)

2020-08-27 Thread Guozhang Wang
Thanks for the update Steve! This is very helpful and I find the blog is a good read too! Appreciate your contribution to the community. Guozhang On Thu, Aug 27, 2020 at 11:06 AM Steve Jones wrote: > Ok so an update here, it's just a learning thing alongside the day job so > it took a little

Re: JNI linker issue on ARM (Raspberry PI)

2020-08-27 Thread Steve Jones
Ok so an update here, it's just a learning thing alongside the day job so it took a little longer than expected. I upgraded to 2.6 but the same thing happened, the reason is that rocksDB doesn't include the .so for the Raspberry Pi platform, hence the linker error. Solution was to build the JNI

Re: JNI linker issue on ARM (Raspberry PI)

2020-08-24 Thread John Roesler
Ah, yes, before messing with rocksjni. As Sophie said, you'll probably just want to try using 2.6.0. It should work "out of the box". Thanks, -John On Mon, Aug 24, 2020, at 21:08, Steve Jones wrote: > Version: *kafka_2.12-2.5.0* > > RocksDB compiles fine, Kafka compiles fine, I'm just trying

Re: JNI linker issue on ARM (Raspberry PI)

2020-08-24 Thread Steve Jones
Version: *kafka_2.12-2.5.0* RocksDB compiles fine, Kafka compiles fine, I'm just trying to work out where the linking is done and if that can be changed to a static rather than a dynamic link. Any hints appreciated, and I'll document out what I've found. Its very stable on the Raspberry Pi as

Re: JNI linker issue on ARM (Raspberry PI)

2020-08-24 Thread Sophie Blee-Goldman
Yeah, if you weren't already running it, try upgrading Streams to 2.6. They recently added support for "all" platforms to rocksdb and we updated the dependency to get this fix in 2.6. See KAFKA-9225 If you already were running 2.6, then, that's

Re: JNI linker issue on ARM (Raspberry PI)

2020-08-24 Thread John Roesler
Hi Steve, Which version of Streams is this? I vaguely recall that we updated to a version of Rocks that’s compiled for ARM, and I think some people have used it on ARM, but I might be misremembering. I’m afraid I can’t be much help in debugging this, but maybe some others on the list have

JNI linker issue on ARM (Raspberry PI)

2020-08-24 Thread Steve Jones
I'm trying to install Kafka Streams on a Raspberry PI, it works fine as a broker, works fine as both a producer and consumer, but when I try and run streams on the PI rather than on the Mac there is a linker issue: Exception in thread