Connect remote kafka server(2.11-1.0.1) from local

2018-05-23 Thread Soundarrajan Chellappan
Hello , I wish to connect the remote kafka server hosted in gcp cloud from my local network kafka version: kafka_2.11-1.0.1 In config/server.properties : Added : advertised.port=9092 advertised.host.name = 10.140.0.17 host.name = 10.140.0.17 port=9092 leaving the following as uncommented :

[jira] [Created] (KAFKA-6939) Change the default of log.message.timestamp.difference.max.ms to 500 years

2018-05-23 Thread Badai Aqrandista (JIRA)
Badai Aqrandista created KAFKA-6939: --- Summary: Change the default of log.message.timestamp.difference.max.ms to 500 years Key: KAFKA-6939 URL: https://issues.apache.org/jira/browse/KAFKA-6939

[jira] [Created] (KAFKA-6938) Add documentation for accessing Headers on Kafka Streams Processor API

2018-05-23 Thread Jorge Quilcate (JIRA)
Jorge Quilcate created KAFKA-6938: - Summary: Add documentation for accessing Headers on Kafka Streams Processor API Key: KAFKA-6938 URL: https://issues.apache.org/jira/browse/KAFKA-6938 Project:

Re: [DISCUSS] KIP-289: Improve the default group id behavior in KafkaConsumer

2018-05-23 Thread Ted Yu
Looks good to me. Original message From: Vahid S Hashemian Date: 5/23/18 11:19 AM (GMT-08:00) To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-289: Improve the default group id behavior in KafkaConsumer Hi Ted, Thanks for reviewing the KIP. I

[VOTE] KIP-228 Negative record timestamp support

2018-05-23 Thread Konstantin Chukhlomin
All, Thanks for the feedback on KIP-228. I've updated the KIP, and would like to start to start a vote. KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-228+Negative+record+timestamp+support

[jira] [Created] (KAFKA-6937) In-sync replica delayed during fetch if replica throttle is exceeded

2018-05-23 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-6937: -- Summary: In-sync replica delayed during fetch if replica throttle is exceeded Key: KAFKA-6937 URL: https://issues.apache.org/jira/browse/KAFKA-6937 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk8 #2669

2018-05-23 Thread Apache Jenkins Server
See Changes: [lindong28] MINOR: Remove dependence on __consumer_offsets in AdminClient -- [...truncated 423.59 KB...] kafka.admin.ResetConsumerGroupOffsetTest >

[jira] [Created] (KAFKA-6936) Scala API Wrapper for Streams uses default serializer for table aggregate

2018-05-23 Thread Daniel Heinrich (JIRA)
Daniel Heinrich created KAFKA-6936: -- Summary: Scala API Wrapper for Streams uses default serializer for table aggregate Key: KAFKA-6936 URL: https://issues.apache.org/jira/browse/KAFKA-6936 Project:

Re: [DISCUSS] KIP-289: Improve the default group id behavior in KafkaConsumer

2018-05-23 Thread Vahid S Hashemian
Hi Ted, Thanks for reviewing the KIP. I updated the KIP and introduced an error code for the scenario described. --Vahid From: Ted Yu To: dev@kafka.apache.org Date: 04/27/2018 04:31 PM Subject:Re: [DISCUSS] KIP-289: Improve the default group id

Re: [VOTE] KIP-176: Remove deprecated new-consumer option for tools

2018-05-23 Thread Ted Yu
lgtm On Wed, May 23, 2018 at 9:04 AM, Paolo Patierno wrote: > Sorry ... I hope it's not too late but I created the KIP-176 on September > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 176%3A+Remove+deprecated+new-consumer+option+for+tools > > but due to be a

[jira] [Resolved] (KAFKA-6356) UnknownTopicOrPartitionException & NotLeaderForPartitionException and log deletion happening with retention bytes kept at -1.

2018-05-23 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-6356. -- Resolution: Not A Problem old data is discarded after log retention period or when the log reaches

[VOTE] KIP-176: Remove deprecated new-consumer option for tools

2018-05-23 Thread Paolo Patierno
Sorry ... I hope it's not too late but I created the KIP-176 on September https://cwiki.apache.org/confluence/display/KAFKA/KIP-176%3A+Remove+deprecated+new-consumer+option+for+tools but due to be a breaking change, I needed to wait for a major release ... and the right time is now. Can you

TLS settings in librdkafka

2018-05-23 Thread ValentĂ­n Gutierrez
Hi, At the Wikimedia Foundation (WMF) we are currently conducting a security review regarding TLS on our kafka stack[1]. As part of this review we identified some gaps regarding TLS customization in librdkafka and we submitted a PR to the project[2]. The ultimate goal of the PR is allowing us to

Apache Kafka 2.0.0 Release Progress

2018-05-23 Thread Rajini Sivaram
Hi all, Thanks to everyone for participating in KIP discussions and voting in time for KIP-freeze. The list of KIPs that have passed vote are in the release plan: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=80448820 Feature freeze is on the 29th of May, just a week away,

[jira] [Created] (KAFKA-6935) KIP-295 Add Streams Config for Optional Optimization

2018-05-23 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-6935: -- Summary: KIP-295 Add Streams Config for Optional Optimization Key: KAFKA-6935 URL: https://issues.apache.org/jira/browse/KAFKA-6935 Project: Kafka Issue Type:

Incorrect result Kstream-Kstream Join with asymmetric time window

2018-05-23 Thread maxime.dejeux
Hello, I work on the version 0.11 of Kafka, 14.04.5 of Ubuntu and 8 of Java. I have a bug when I want to use an asymmetric time window in the Kstream-Kstream join. More detail on this page

[jira] [Created] (KAFKA-6934) Csv reporter doesn't work for ConsoleConsumer

2018-05-23 Thread Sandor Murakozi (JIRA)
Sandor Murakozi created KAFKA-6934: -- Summary: Csv reporter doesn't work for ConsoleConsumer Key: KAFKA-6934 URL: https://issues.apache.org/jira/browse/KAFKA-6934 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-6933) Broker reports Corrupted index warnings apparently infinitely

2018-05-23 Thread Franco Bonazza (JIRA)
Franco Bonazza created KAFKA-6933: - Summary: Broker reports Corrupted index warnings apparently infinitely Key: KAFKA-6933 URL: https://issues.apache.org/jira/browse/KAFKA-6933 Project: Kafka

Re: [VOTE] KIP-305: Add Connect primitive number converters

2018-05-23 Thread Rahul Singh
+1 non binding -- Rahul Singh rahul.si...@anant.us Anant Corporation On May 22, 2018, 9:31 PM -0400, Yeva Byzek , wrote: > +1 > > Thanks, > Yeva > > > On Tue, May 22, 2018 at 7:48 PM, Magesh Nandakumar wrote: > > > +1 (non-binding) > > > > Thanks > >

Re: Running Kafka locally - no logs

2018-05-23 Thread M. Manna
I have managed to load the broker from within Eclipse Scala IDE. I only needed to put server.properties and -Dlog4j.configuration in program arguments area. How did you set up classpath? You need to set up classpath such that it can find all the jars necessary. And you shouldn’t have to remove

Running Kafka locally - no logs

2018-05-23 Thread Lerh Chuan Low
Hi Kafka devs, I've been trying to debug Kafka locally. I've been following the guides available on the website/confluence, which are: - Installing gradle (already have Java and Scala) - git clone kafka - cd git repository - gradle - ./gradlew idea I then open IntellIJ IDEA and open the kafka