Re: Kafka Connect: How to set log level for connectors?

Class loading isolation is a known requested feature and we have plans to add it in one of the forthcoming releases. Re: the appenders, we should be seeing duplicate messages if there was an issue there, but I'll double check. Glad it worked after all. Regards, Konstantine On Tue, Jan 17, 2017

Re: Kafka Connect: How to set log level for connectors?

Related to what I discussed below, could there be a bug? For example, this line (for kafka): https://github.com/confluentinc/cp-docker-images/blob/master/debian/kafka/include/etc/confluent/docker/log4j.properties.template#L25 looks different from this line (appends ,stdout) is that expected?

Re: kafka streams consumer partition assignment is uneven

btw. in case you didn't find out yet (I just discovered this...), you can get the entire topology by starting the stream, waiting a bit and then printing "KafkaStreams.toString()" to console. I found it useful and cool :) On Tue, Jan 17, 2017 at 3:19 PM, Matthias J. Sax

Re: kafka streams consumer partition assignment is uneven

Sorry for answering late. The mapping from partitions to threads also depend on the structure of your topology. As you mention that you have a quite complex one, I assume that this is the reason for the uneven distribution. I you want to dig deeper, it would be helpful to know the structure of

Re: Kafka Streams: got bit by WindowedSerializer (only window.start is serialized)

With regard to the JIRA. I guess we do not want to put the end timestamp into the key. For general usage, windows of different type are written into different topics. Thus, Nicolas' use case is quite special and using custom Serde is the better approach to handle it, instead of changing Kafka

Re: Kafka Connect: How to set log level for connectors?

Hi Konstantine, I appreciate you taking the time to respond So I have set CONNECT_LOG4J_ROOT_LEVEL=INFO and that’s the output I got below Now I understand I need to set CONNECT_LOG4J_LOGGERS also. Can I please have an example of how to set that value to suppress some debug statements? For

Re: Correlation Id errors for both console producer and consumer

Hi Jeff, Versions: Kafka: kafka_2.11-0.10.0.0 ZK: zookeeper-3.4.6 Let me know if you need any more details/info. Thanks! -Zac From: Jeff Widman Sent: Tuesday, January 17, 2017 4:38:07 PM To: users@kafka.apache.org Subject: Re: Correlation

Re: Correlation Id errors for both console producer and consumer

What versions of Kafka and Zookeeper are you using? On Tue, Jan 17, 2017 at 11:57 AM, Zac Harvey wrote: > I have 2 Kafkas backed by 3 ZK nodes. I want to test the Kafka nodes by > running the kafka-console-producer and -consumer locally on each node. > > So I SSH into

Re: Kafka Connect: How to set log level for connectors?

Hi Stephane, if you are using the docker images from confluent, a way to set the levels to specific loggers is described here: http://docs.confluent.io/3.1.1/cp-docker-images/docs/operations/logging.html#log4j-log-levels For Connect, you would need to set the environment variable

Correlation Id errors for both console producer and consumer

I have 2 Kafkas backed by 3 ZK nodes. I want to test the Kafka nodes by running the kafka-console-producer and -consumer locally on each node. So I SSH into one of my Kafka brokers using 2 different terminals. In terminal #1 I run the consumer like so:

Re: Import into IntelliJ with Gradle 3.3 fails

Trying with latest 2016.3.2 version all works fine without the workaround, thanks ! Paolo Patierno Senior Software Engineer (IoT) @ Red Hat Microsoft MVP on Windows Embedded & IoT Microsoft Azure Advisor Twitter : @ppatierno Linkedin :

Re: Import into IntelliJ with Gradle 3.3 fails

I'll try it ! Thanks, Paolo Paolo Patierno Senior Software Engineer (IoT) @ Red Hat Microsoft MVP on Windows Embedded & IoT Microsoft Azure Advisor Twitter : @ppatierno Linkedin : paolopatierno Blog :

Re: Import into IntelliJ with Gradle 3.3 fails

I suggest using 2016.3.x, which is the latest stable release and supports Gradle 3.x correctly. Ismael On Tue, Jan 17, 2017 at 2:34 PM, Paolo Patierno wrote: > Hi Ismael, > > > it's the following > > > 2016.1.4 > > Build #IC - 145.2070 > > > Thanks, > > Paolo > > > Paolo

Re: Import into IntelliJ with Gradle 3.3 fails

Hi Ismael, it's the following 2016.1.4 Build #IC - 145.2070 Thanks, Paolo Paolo Patierno Senior Software Engineer (IoT) @ Red Hat Microsoft MVP on Windows Embedded & IoT Microsoft Azure Advisor Twitter : @ppatierno Linkedin :

Re: Import into IntelliJ with Gradle 3.3 fails

Hi Paolo, Perhaps the IntelliJ version is the issue then, what version are you using? Ismael On Tue, Jan 17, 2017 at 12:59 PM, Paolo Patierno wrote: > Hi Ismael, > > > I have just cloned and used trunk. > > Executed the gradle command and then importing from IntelliJ (with

Re: Import into IntelliJ with Gradle 3.3 fails

Hi Ismael, I have just cloned and used trunk. Executed the gradle command and then importing from IntelliJ (with the import wizard as a Gradle project). Paolo. Paolo Patierno Senior Software Engineer (IoT) @ Red Hat Microsoft MVP on Windows Embedded & IoT Microsoft Azure Advisor Twitter :

Re: Import into IntelliJ with Gradle 3.3 fails

Hi Paolo, IntelliJ with Gradle 3.x should work fine in trunk. Were you perhaps using an older branch/commit? Ismael On Tue, Jan 17, 2017 at 11:30 AM, Paolo Patierno wrote: > Hi all, > > > using IntelliJ IDEA and Gradle 3.3 I had following problem importing the > Kafka

Kafka - topics not getting deleted

Hi Kafka-users, Could anyone please suggest why am I not being able to delete the kafka topic from broker. Below are the commands I've executed $ ./kafka-topics.sh --list --zookeeper /kafka Shows ProducerConsumerOffsetTestTopic001 - marked for deletion $ ./kafka-topics.sh --describe

Import into IntelliJ with Gradle 3.3 fails

Hi all, using IntelliJ IDEA and Gradle 3.3 I had following problem importing the Kafka project : Unable to build Scala project configuration Details: groovy.lang.MissingPropertyException: No such property: daemonServer for class: org.gradle.api.tasks.scala.ScalaCompileOptions I solved

Re: Kafka Streams: from a KStream, aggregating records with the same key and updated metrics ?

Thanks for sharing back your findings/code, Nicolas! -Michael On Mon, Jan 16, 2017 at 11:15 PM, Nicolas Fouché wrote: > If anyone is interested, here is my custom timestamp extractor: > https://gist.github.com/nfo/54d5830720e163d2e7e848b6e4baac20 . > > 2017-01-16 15:52

Re: Kafka Streams: got bit by WindowedSerializer (only window.start is serialized)

For changes that may be backwards incompatible or change the APIs we usually do a short KIP first (e.g., I just did one yesterday: https://cwiki.apache.org/confluence/display/KAFKA/KIP-114%3A+KTable+materialization+and+improved+semantics