Thanks Michael Hopefully the upgrade story evolves as 0.10.1+ advances to maturity
Just my 2 cents Decoupling the kafka streams from the core kafka changes will help so that the broker can be upgraded without notice and streaming apps can evolve to newer streaming features on their own pace Regards Sai On Wednesday, October 19, 2016, Michael Noll <[email protected]> wrote: > Apps built with Kafka Streams 0.10.1 only work against Kafka clusters > running 0.10.1+. This explains your error message above. > > Unfortunately, Kafka's current upgrade story means you need to upgrade your > cluster in this situation. Moving forward, we're planning to improve the > upgrade/compatibility story of Kafka so that you could, for example, run a > newer version of Kafka Streams (or any other Kafka client) against an older > version of Kafka. > > > > On Tue, Oct 18, 2016 at 10:56 PM, saiprasad mishra < > [email protected]> wrote: > > > Hi All > > > > Was testing with 0.10.1.0 rc3 build for my new streams app > > > > Seeing issues starting my kafk streams app( 0.10.1.0) on the old version > > broker 0.10.0.1. I dont know if it is supposed to work as is. Will > upgrade > > the broker to same version and see whether it goes away > > > > client side issues > > > > ================== > > > > java.io.EOFException > > > > at > > org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel( > > NetworkReceive.java:83) > > ~[kafka-clients-0.10.1.0.jar!/:?] > > > > at > > org.apache.kafka.common.network.NetworkReceive. > > readFrom(NetworkReceive.java:71) > > ~[kafka-clients-0.10.1.0.jar!/:?] > > > > at > > org.apache.kafka.common.network.KafkaChannel.receive( > > KafkaChannel.java:154) > > ~[kafka-clients-0.10.1.0.jar!/:?] > > > > at org.apache.kafka.common.network.KafkaChannel.read( > > KafkaChannel.java:135) > > ~[kafka-clients-0.10.1.0.jar!/:?] > > > > at > > org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector. > > java:343) > > [kafka-clients-0.10.1.0.jar!/:?] > > > > at org.apache.kafka.common.network.Selector.poll(Selector.java:291) > > [kafka-clients-0.10.1.0.jar!/:?] > > > > at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:260) > > [kafka-clients-0.10.1.0.jar!/:?] > > > > at > > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll( > > ConsumerNetworkClient.java:232) > > [kafka-clients-0.10.1.0.jar!/:?] > > > > at > > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll( > > ConsumerNetworkClient.java:209) > > [kafka-clients-0.10.1.0.jar!/:?] > > > > at > > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient. > > awaitMetadataUpdate(ConsumerNetworkClient.java:148) > > [kafka-clients-0.10.1.0.jar!/:?] > > > > at > > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient. > > awaitMetadataUpdate(ConsumerNetworkClient.java:136) > > [kafka-clients-0.10.1.0.jar!/:?] > > > > at > > org.apache.kafka.clients.consumer.internals.AbstractCoordinator. > > ensureCoordinatorReady(AbstractCoordinator.java:197) > > [kafka-clients-0.10.1.0.jar!/:?] > > > > at > > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll( > > ConsumerCoordinator.java:248) > > [kafka-clients-0.10.1.0.jar!/:?] > > > > at > > org.apache.kafka.clients.consumer.KafkaConsumer. > > pollOnce(KafkaConsumer.java:1013) > > [kafka-clients-0.10.1.0.jar!/:?] > > > > at > > org.apache.kafka.clients.consumer.KafkaConsumer.poll( > > KafkaConsumer.java:979) > > [kafka-clients-0.10.1.0.jar!/:?] > > > > at > > org.apache.kafka.streams.processor.internals.StreamThread.runLoop( > > StreamThread.java:407) > > [kafka-streams-0.10.1.0.jar!/:?] > > > > at > > org.apache.kafka.streams.processor.internals. > > StreamThread.run(StreamThread.java:242) > > [kafka-streams-0.10.1.0.jar!/:?] > > > > > > > > On the broker side the following message appears > > > > ============================================= > > > > kafka.network.InvalidRequestException: Error getting request for > apiKey: 3 > > and apiVersion: 2 > > > > at > > kafka.network.RequestChannel$Request.liftedTree2$1( > > RequestChannel.scala:95) > > > > at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:87) > > > > at > > kafka.network.Processor$$anonfun$processCompletedReceives$1. > > apply(SocketServer.scala:488) > > > > at > > kafka.network.Processor$$anonfun$processCompletedReceives$1. > > apply(SocketServer.scala:483) > > > > at scala.collection.Iterator$class.foreach(Iterator.scala:893) > > > > at scala.collection.AbstractIterator.foreach(Iterator.scala:1336) > > > > at scala.collection.IterableLike$class.foreach(IterableLike.scala:72) > > > > at scala.collection.AbstractIterable.foreach(Iterable.scala:54) > > > > at kafka.network.Processor.processCompletedReceives( > > SocketServer.scala:483) > > > > at kafka.network.Processor.run(SocketServer.scala:413) > > > > at java.lang.Thread.run(Thread.java:745) > > > > Caused by: java.lang.IllegalArgumentException: Invalid version for API > key > > 3: 2 > > > > at org.apache.kafka.common.protocol.ProtoUtils.schemaFor( > > ProtoUtils.java:31) > > > > at > > org.apache.kafka.common.protocol.ProtoUtils.requestSchema( > ProtoUtils.java: > > 44) > > > > at > > org.apache.kafka.common.protocol.ProtoUtils.parseRequest( > ProtoUtils.java: > > 60) > > > > at > > org.apache.kafka.common.requests.MetadataRequest. > > parse(MetadataRequest.java:96) > > > > at > > org.apache.kafka.common.requests.AbstractRequest. > > getRequest(AbstractRequest.java:48) > > > > at > > kafka.network.RequestChannel$Request.liftedTree2$1( > > RequestChannel.scala:92) > > > > Regards > > > > Sai > > >
