Build failed in Jenkins: kafka-trunk-jdk8 #2599

2018-04-27 Thread Apache Jenkins Server
See -- [...truncated 2.50 KB...] at hudson.Proc$LocalProc.(Proc.java:218) at hudson.Launcher$LocalLauncher.launch(Launcher.java:930) at

Re: Write access required to Confluence wiki

2018-04-27 Thread Piyush Vijay
Hi, Can someone please help/guide me here? I really appreciate it. Thanks Piyush Vijay On Thu, Apr 26, 2018 at 6:37 PM, Piyush Vijay wrote: > Ping :) > > > Piyush Vijay > > On Wed, Apr 25, 2018 at 7:45 PM, Piyush Vijay > wrote: > >> >> I want

Re: [DISCUSS] KIP-280: Enhanced log compaction

2018-04-27 Thread Luís Cabral
Hi, The KIP is now updated with the results of the byte array discussion. This is my first contribution to Kafka, so I'm not sure on what the processes are. Is it now acceptable to take this into a vote, or should I ask for more contributors to join the discussion first? Kind Regards,Luis

[jira] [Created] (KAFKA-6832) Wrong start position in the log file on the leader, on fetch request.

2018-04-27 Thread Ciprian Pascu (JIRA)
Ciprian Pascu created KAFKA-6832: Summary: Wrong start position in the log file on the leader, on fetch request. Key: KAFKA-6832 URL: https://issues.apache.org/jira/browse/KAFKA-6832 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk8 #2598

2018-04-27 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H32 (ubuntu xenial) in workspace

Jenkins build is back to normal : kafka-trunk-jdk8 #2600

2018-04-27 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-280: Enhanced log compaction

2018-04-27 Thread Luís Cabral
Hi, I was updating the PR to match the latest decisions and noticed (or rather, the integration tests noticed) that without storing the offset, then the cache doesn't know when to keep the record itself. This is because, after the cache is populated, all the records are compared against the

Permission request

2018-04-27 Thread Adam Kotwasinski
Hello, Could you please add me to the contributor list, so I could like to assign https://issues.apache.org/jira/browse/KAFKA-6830 to myself? Thank you. Best regards, Adam Kotwasinski

[jira] [Created] (KAFKA-6833) KafkaProducer throws "Invalid partition given with record" exception

2018-04-27 Thread Arjun Satish (JIRA)
Arjun Satish created KAFKA-6833: --- Summary: KafkaProducer throws "Invalid partition given with record" exception Key: KAFKA-6833 URL: https://issues.apache.org/jira/browse/KAFKA-6833 Project: Kafka

Re: [VOTE] KIP-219 - Improve Quota Communication

2018-04-27 Thread Becket Qin
The reason we wanted to bump up all the request versions was let the clients know whether the broker has already throttled the request or not. This avoids double throttling in both brokers and clients, if the clients implementation supports KIP-219. The new change uses only ApiVersionRequest,

Re: Kafka mirror maker help

2018-04-27 Thread Hans Jespersen
Sorry I hit send a bit too soon. I was so focused on the systemd part of the email and not the Mirror Maker part. Confluent packages include Mirror Maker but the systemd scripts are setup to use Confluent Replicator rather than Mirror Maker. My apologies. -hans /** * Hans Jespersen, Director

Re: Kafka mirror maker help

2018-04-27 Thread Andrew Otto
Hiya, Saravanan, I saw you emailed my colleague Alex about WMF’s old debian packaging. I’ll reply here. We now use Confluent’s Kafka debian packaging which does not (or did not?) ship with init scripts. We don’t use Sys V init.d scripts anymore either, but use systemd instead. Our systemd

Re: [DISCUSS] KIP-280: Enhanced log compaction

2018-04-27 Thread Guozhang Wang
Hello Luis, When the comparing the version returns `equal`, the original proposal is to use the offset as the tie breaker. My previous comment is that 1) when we build the map calling `put`, if there is already an entry for the key, compare its stored version, and replace if the put record's

Re: [DISCUSS] KIP-285: Connect Rest Extension Plugin

2018-04-27 Thread Randall Hauch
Great work, Magesh. I like the overall approach a lot, so I left some pretty nuanced comments about specific details. Best regards, Randall On Wed, Apr 25, 2018 at 3:03 PM, Magesh Nandakumar wrote: > Thanks Randall for your thoughts. I have created a replica of the

Re: Kafka mirror maker help

2018-04-27 Thread Hans Jespersen
The latest Confluent packages now ship with systemd scripts. That is since Confluent Version 4.1 - which included Apache Kafka 1.1 -hans /** * Hans Jespersen, Director Systems Engineering, Confluent Inc. * h...@confluent.io (650)924-2670 */ On Fri, Apr 27, 2018 at 11:15 AM, Andrew Otto

Re: [VOTE] KIP-219 - Improve Quota Communication

2018-04-27 Thread Jonghyun Lee
Thanks, Becket. Assuming that requiring new client implementations to issue ApiVersionsRequest before issuing any other requests is reasonable as you mentioned, I am wondering if keeping track of brokers that support KIP-219 is actually simpler than keeping a map from each request type to its min

Re: Kafka mirror maker help

2018-04-27 Thread Amrit Jangid
You should share related info, such source-destination Kafka versions, sample Config or error if any. FYI, Go through https://kafka.apache.org/documentation/#basic_ops_mirror_maker

[jira] [Created] (KAFKA-6834) log cleaner should handle the case when the size of a message set is larger than the max message size

2018-04-27 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-6834: -- Summary: log cleaner should handle the case when the size of a message set is larger than the max message size Key: KAFKA-6834 URL: https://issues.apache.org/jira/browse/KAFKA-6834

Re: [DISCUSS] KIP-289: Improve the default group id behavior in KafkaConsumer

2018-04-27 Thread Ted Yu
bq. If they attempt an offset commit they will receive an error. Can you outline what specific error would be encountered ? Thanks On Fri, Apr 27, 2018 at 2:17 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Hi all, > > I have drafted a proposal for improving the behavior of

Build failed in Jenkins: kafka-0.10.0-jdk7 #218

2018-04-27 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: use jdk8 to build/run system tests (#4944) -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on

[DISCUSS] KIP-289: Improve the default group id behavior in KafkaConsumer

2018-04-27 Thread Vahid S Hashemian
Hi all, I have drafted a proposal for improving the behavior of KafkaConsumer when using the default group id: https://cwiki.apache.org/confluence/display/KAFKA/KIP-289%3A+Improve+the+default+group+id+behavior+in+KafkaConsumer The proposal based on the issue and suggestion reported in

Re: Kafka mirror maker help

2018-04-27 Thread Peter Bukowinski
I run instances of Mirror Maker as supervisord tasks (http://supervisord.org ). I’d recommend looking into it. In addition to letting you sidestep the service issue, supervisord watches the processes and can auto-restart them if they stop for any reason. — Peter

Build failed in Jenkins: kafka-trunk-jdk7 #3382

2018-04-27 Thread Apache Jenkins Server
See Changes: [github] HOTFIX: rename run_test to execute in streams simple benchmark (#4941) [wangguoz] MINOR: Streams web doc table fix (#4942) -- [...truncated 415.21

Build failed in Jenkins: kafka-0.11.0-jdk7 #366

2018-04-27 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: use jdk8 to build/run system tests (#4925) -- [...truncated 835.89 KB...] kafka.api.SslEndToEndAuthorizationTest >

Build failed in Jenkins: kafka-0.10.1-jdk7 #135

2018-04-27 Thread Apache Jenkins Server
See -- [...truncated 588.74 KB...] org.apache.kafka.streams.processor.internals.StreamPartitionAssignorTest > shouldMapUserEndPointToTopicPartitions PASSED

Build failed in Jenkins: kafka-0.10.1-jdk7 #134

2018-04-27 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: use jdk8 to build/run system tests (#4944) -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on

Build failed in Jenkins: kafka-0.10.2-jdk7 #208

2018-04-27 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: use jdk8 to build/run system tests (#4944) -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on

Jenkins build is back to normal : kafka-0.10.2-jdk7 #209

2018-04-27 Thread Apache Jenkins Server
See

Jenkins build is back to normal : kafka-1.0-jdk7 #187

2018-04-27 Thread Apache Jenkins Server
See

Jenkins build is back to normal : kafka-trunk-jdk7 #3383

2018-04-27 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #2602

2018-04-27 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Streams web doc table fix (#4942) [wangguoz] Fix streams web doc configs tables (#4943) -- [...truncated 3.60 MB...]

Build failed in Jenkins: kafka-0.10.0-jdk7 #219

2018-04-27 Thread Apache Jenkins Server
See -- [...truncated 228.63 KB...] org.apache.kafka.streams.kstream.TimeWindowsTest > advanceIntervalMustNotBeZero PASSED org.apache.kafka.streams.kstream.TimeWindowsTest >

Build failed in Jenkins: kafka-0.11.0-jdk7 #367

2018-04-27 Thread Apache Jenkins Server
See -- [...truncated 2.45 MB...] org.apache.kafka.streams.integration.EosIntegrationTest > shouldBeAbleToCommitMultiplePartitionOffsets PASSED

Build failed in Jenkins: kafka-trunk-jdk8 #2597

2018-04-27 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H32 (ubuntu xenial) in workspace