Unfortunately we had a regression in streams and KAFKA-4716 is now deemed a Blocker. https://issues.apache.org/jira/browse/KAFKA-4716 <https://issues.apache.org/jira/browse/KAFKA-4716>
Eno > On 7 Feb 2017, at 23:56, Jun Rao <j...@confluent.io> wrote: > > Hi, Ewen, > > KAFKA-4725 has been committed to 0.10.2. > > Thanks, > > Jun > > On Mon, Feb 6, 2017 at 11:18 PM, Ewen Cheslack-Postava <e...@confluent.io> > wrote: > >> All, >> >> It sounds like https://issues.apache.org/jira/browse/KAFKA-4725 is a >> regression in an earlier release and worth fixing. I've marked it blocker >> for 0.10.2.0. I'll plan to roll a new RC once it is committed (some stress >> testing of the one-line patch is currently ongoing). >> >> -Ewen >> >> On Fri, Feb 3, 2017 at 3:35 PM, Vahid S Hashemian < >> vahidhashem...@us.ibm.com >>> wrote: >> >>> Hi Ewen, >>> >>> I tested the quickstart with this release candidate on Ubuntu, Windows >> (32 >>> and 64 bit) and Mac. >>> Everything looks good, except for one issue on Windows 7 32 bit when >>> running the WordCount demo application from the Kafka Streams step. >>> >>> Running that command gave me this error, and as a result, no data was >>> written to the output topic: >>> >>> [2017-02-03 14:11:23,444] WARN Unexpected state transition from >>> ASSIGNING_PARTITIONS to NOT_RUNNING >>> (org.apache.kafka.streams.processor.internals.StreamThread) >>> Exception in thread "StreamThread-1" java.lang. >> ExceptionInInitializerError >>> at org.rocksdb.RocksDB.loadLibrary(RocksDB.java:64) >>> at org.rocksdb.RocksDB.<clinit>(RocksDB.java:35) >>> at org.rocksdb.Options.<clinit>(Options.java:22) >>> at >>> org.apache.kafka.streams.state.internals.RocksDBStore. >>> openDB(RocksDBStore.java:115) >>> at >>> org.apache.kafka.streams.state.internals.RocksDBStore. >>> init(RocksDBStore.java:148) >>> at >>> org.apache.kafka.streams.state.internals.ChangeLoggingKeyValueBytesStor >>> e.init(ChangeLoggingKeyValueBytesStore.java:39) >>> at >>> org.apache.kafka.streams.state.internals.MeteredKeyValueStore$7.run( >>> MeteredKeyValueStore.java:100) >>> at >>> org.apache.kafka.streams.processor.internals.StreamsMetricsImpl. >>> measureLatencyNs(StreamsMetricsImpl.java:188) >>> at >>> org.apache.kafka.streams.state.internals.MeteredKeyValueStore.init( >>> MeteredKeyValueStore.java:131) >>> at >>> org.apache.kafka.streams.state.internals.CachingKeyValueStore.init( >>> CachingKeyValueStore.java:62) >>> at >>> org.apache.kafka.streams.processor.internals.AbstractTask. >>> initializeStateStores(AbstractTask.java:86) >>> at >>> org.apache.kafka.streams.processor.internals. >> StreamTask.<init>(StreamTask. >>> java:141) >>> at >>> org.apache.kafka.streams.processor.internals. >>> StreamThread.createStreamTask(StreamThread.java:834) >>> at >>> org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator. >>> createTask(StreamThread.java:1207) >>> at >>> org.apache.kafka.streams.processor.internals.StreamThread$ >>> AbstractTaskCreator.retryWithBackoff(StreamThread.java:1180) >>> at >>> org.apache.kafka.streams.processor.internals. >> StreamThread.addStreamTasks( >>> StreamThread.java:937) >>> at >>> org.apache.kafka.streams.processor.internals.StreamThread.access$500( >>> StreamThread.java:69) >>> at >>> org.apache.kafka.streams.processor.internals.StreamThread$1. >>> onPartitionsAssigned(StreamThread.java:236) >>> at >>> org.apache.kafka.clients.consumer.internals.ConsumerCoordinator. >>> onJoinComplete(ConsumerCoordinator.java:255) >>> at >>> org.apache.kafka.clients.consumer.internals.AbstractCoordinator. >>> joinGroupIfNeeded(AbstractCoordinator.java:339) >>> at >>> org.apache.kafka.clients.consumer.internals.AbstractCoordinator. >>> ensureActiveGroup(AbstractCoordinator.java:303) >>> at >>> org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll( >>> ConsumerCoordinator.java:286) >>> at >>> org.apache.kafka.clients.consumer.KafkaConsumer. >>> pollOnce(KafkaConsumer.java:1030) >>> at >>> org.apache.kafka.clients.consumer.KafkaConsumer.poll( >>> KafkaConsumer.java:995) >>> at >>> org.apache.kafka.streams.processor.internals.StreamThread.runLoop( >>> StreamThread.java:582) >>> at >>> org.apache.kafka.streams.processor.internals. >>> StreamThread.run(StreamThread.java:368) >>> Caused by: java.lang.UnsupportedOperationException >>> at >>> org.rocksdb.util.Environment.getJniLibraryName(Environment.java:48) >>> at >>> org.rocksdb.NativeLibraryLoader.<clinit>(NativeLibraryLoader.java:19) >>> ... 26 more >>> [2017-02-03 14:11:26,319] WARN Unexpected state transition from >>> NOT_RUNNING to PENDING_SHUTDOWN >>> (org.apache.kafka.streams.processor.internals.StreamThread) >>> >>> >>> This step worked fine on the other environments. I'm not sure if it is >> due >>> to a bug, or it's isolated to my test environment. >>> >>> --Vahid >>> >>> >>> >>> >>> From: Ewen Cheslack-Postava <e...@confluent.io> >>> To: dev@kafka.apache.org, "us...@kafka.apache.org" >>> <us...@kafka.apache.org>, "kafka-clie...@googlegroups.com" >>> <kafka-clie...@googlegroups.com> >>> Date: 02/01/2017 03:45 PM >>> Subject: [VOTE] 0.10.2.0 RC0 >>> >>> >>> >>> Hello Kafka users, developers and client-developers, >>> >>> This is the first candidate for release of Apache Kafka 0.10.2.0. >>> >>> This is a minor version release of Apache Kafka. It includes 19 new KIPs. >>> See the release notes and release plan ( >>> https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.10.2.0) >>> for more details. A few feature highlights: SASL-SCRAM support, improved >>> client compatibility to allow use of clients newer than the broker, >>> session >>> windows and global tables in the Kafka Streams API, single message >>> transforms in the Kafka Connect framework. >>> >>> Release notes for the 0.10.2.0 release: >>> http://home.apache.org/~ewencp/kafka-0.10.2.0-rc0/RELEASE_NOTES.html >>> >>> *** Please download, test and vote by Monday February 6th 5pm PST *** >>> (Note the longer window to vote to account for the normal 7 days ending >> in >>> the middle of the weekend.) >>> >>> Kafka's KEYS file containing PGP keys we use to sign the release: >>> http://kafka.apache.org/KEYS >>> >>> * Release artifacts to be voted upon (source and binary): >>> http://home.apache.org/~ewencp/kafka-0.10.2.0-rc0/ >>> >>> * Maven artifacts to be voted upon: >>> https://repository.apache.org/content/groups/staging/ >>> >>> * Javadoc: >>> http://home.apache.org/~ewencp/kafka-0.10.2.0-rc0/javadoc/ >>> >>> * Tag to be voted upon (off 0.10.2 branch) is the 0.10.2.0 tag: >>> https://git-wip-us.apache.org/repos/asf?p=kafka.git;a=tag;h= >>> 33ebac1f138f17b86002df05e55a9f5cff47f48a >>> >>> >>> >>> * Documentation: >>> http://kafka.apache.org/0102/documentation.html >>> >>> * Protocol: >>> http://kafka.apache.org/0102/protocol.html >>> >>> * Successful Jenkins builds for the 0.10.2 branch: >>> Unit/integration tests: >>> https://builds.apache.org/job/kafka-0.10.2-jdk7/60/ >>> System tests: >>> https://jenkins.confluent.io/job/system-test-kafka-branch-builder/697 >>> >>> Thanks, >>> Ewen Cheslack-Postava >>> >>> >>> >>> >>> >>