Re: Deserialization Exception when performing state store operations

Hello Carl, I think that the problem you are facing is a "poison pill" You can take a look at this video for approches on different solutions : https://www.confluent.io/kafka-summit-san-francisco-2019/streaming-apps-and-poison-pills-handle-the-unexpected-with-kafka-streams/ Best regards,

Re: Deserialization Exception when performing state store operations

Hi Carl, That sounds pretty frustrating; sorry about that. I think I got a hint, but I'm not totally clear on the situation. It shouldn't be possible for data to get into the store if it can't be handled by the serde. There is a specific issue with global stores, but it doesn't sound like that's

Re: Unknown topic at org.apache.kafka.streams.TopologyTestDriver.pipeRecord

Hi Dumitru The TopologyTestDriver you are using was designed to unit test your topology, and will not work with the stack you run locally. That said, if you want to test your topology, you first need to create the fake input topic by calling “topologyDriver.createInputTopic()” (assuming you are

Deserialization Exception when performing state store operations

I have a state store being built from a stream with a custom set of value serdes. In the stream processing I am able to handle errors appropriately with the exception handler, but if I attempt to do a state store getAll and use the iterator.hasNext() or next() or peek methods, any exceptions in

Re: Retrieve Kafka Principal from Client

Hi Brandt, The username is used as the principal for SALS/PLAIN. Check *sals.jaas.config* value at the client's configuration file. Let me know if I haven't understood you correctly. Best regards Dave Newton, Brandt (CAI - Burlington) schrieb am Mo., 20. Apr. 2020, 21:30: > Hi All, > > I’d

Re: Kafka Streams - issues with windowing and suppress

Yes, thanks, Liam! By the way, There's actually already a ticket to try and improve the API, and the discussed solution is basically the same thing I said had never occurred to me before, so I'm not sure what to say about that... https://issues.apache.org/jira/browse/KAFKA-8924 The ticket

Retrieve Kafka Principal from Client

Hi All, I’d like to determine the principal of the credentials that were used to authenticate so I can check that the principal’s ACLs. I’m using the Kafka client libraries (NetworkClient specifically but that’s not a requirement) to connect to a Kafka cluster using the SASL_SSL security

Unknown topic at org.apache.kafka.streams.TopologyTestDriver.pipeRecord

Hello kafka community, I am getting the stack trace below in an attempt at an integration test for a new kafka-streams ETL between two topics (where the source topic is a new one). The way the local framework is organized, initially a local confluent stack is started such as the schema registry

RE: Help with setting up Kafka Node

How are you starting it? -Original Message- From: i...@fluent-software.de Sent: Monday, April 20, 2020 11:56 AM To: users@kafka.apache.org Subject: AW: Help with setting up Kafka Node I can't see any errors. Changing the debug level to debug I got the following log: [2020-04-20

AW: Help with setting up Kafka Node

I can't see any errors. Changing the debug level to debug I got the following log: [2020-04-20 18:25:28,956] DEBUG Reading reply sessionid:0x10868ec81a70001, packet:: clientPath:/config/brokers/0 serverPath:/config/brokers/0 finished:false h

Re: Sybase Connection

if Sybase supports JDBC then you can probably use the JDBC Source connector for Kafka Connect Ref: https://www.confluent.io/blog/kafka-connect-deep-dive-jdbc-source-connector/ -- Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff On Mon, 20 Apr 2020 at 17:31, Jonatan

Sybase Connection

Hi, I would like to know if Kafka can connect to a sybase Db in order to replicate data to another database. Thanks. Frank-Saucedo

Re: Help with setting up Kafka Node

Seems zk's log is normal, the KeeperException dose not matter when you start a fresh cluster. Could you post your zk's config? Was there any error / exception in kafka's log? if not, you can change your log level to debug to find if there is something wrong? Best, Lisheng 于2020年4月20日周一

Help with setting up Kafka Node

Hi, I have a problem with an kafka installation and need some help to go ahead with my issue. Maybe someone can help. If I start kafka, the process is being killed during the startup phrase after some seconds: [2020-04-20 17:12:26,244] INFO [ThrottledChannelReaper-Fetch]: Starting

Re: Retention period for __consumer_offsets topic

Is that possible to make __consumer_offsets retention to be size-based instead of time-based like with "retention.bytes" property? Sergi On Sun, Apr 19, 2020 at 12:37 PM Liam Clarke wrote: > Hi Nitin, > > Default in Kafka 2.0+ is 7 days, previously it was 24 hours IIRC. Only > reason you need

Re: Kafka Streams - issues with windowing and suppress

Thanks for the PR! On 4/19/20 10:04 PM, Liam Clarke-Hutchinson wrote: > PR submitted :) https://github.com/apache/kafka/pull/8520 > > On Mon, Apr 20, 2020 at 2:34 PM John Roesler wrote: > >> Hi Liam, >> >> That sounds like a good idea to me. In fact, I’d go so far as to say we >> should just