[jira] [Resolved] (KAFKA-6085) Streams rebalancing may cause a first batch of fetched records to be dropped

2017-10-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6085. -- Resolution: Not A Problem Fix Version/s: (was: 1.0.0) This is actually not a bug,

[GitHub] kafka pull request #4096: HOTFIX: Poll with zero milliseconds during restora...

2017-10-18 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/4096 HOTFIX: Poll with zero milliseconds during restoration phase 1. After the poll call, re-check if the state has been changed or not; if yes, initialize the tasks again. 2. Cherry-pick

[GitHub] kafka pull request #4086: [WIP] KAFKA-6085: Pause all partitions before task...

2017-10-18 Thread guozhangwang
Github user guozhangwang closed the pull request at: https://github.com/apache/kafka/pull/4086 ---

[GitHub] kafka pull request #4086: [WIP] KAFKA-6085: Pause all partitions before task...

2017-10-18 Thread guozhangwang
Github user guozhangwang closed the pull request at: https://github.com/apache/kafka/pull/4086 ---

[GitHub] kafka pull request #4086: [WIP] KAFKA-6085: Pause all partitions before task...

2017-10-18 Thread guozhangwang
GitHub user guozhangwang reopened a pull request: https://github.com/apache/kafka/pull/4086 [WIP] KAFKA-6085: Pause all partitions before tasks are initialized Mirror of #4085 against trunk. This PR contains two fixes (one major and one minor): Major: on rebalance, pause

[GitHub] kafka pull request #4095: KAFKA-5140: Fix reset integration test

2017-10-18 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/4095 KAFKA-5140: Fix reset integration test The MockTime was incorrectly used across multiple test methods within the class, as a class rule. Instead we set it on each test case; also remove the

[jira] [Resolved] (KAFKA-6088) Kafka Consumer slows down when reading from highly compacted topics

2017-10-18 Thread James Cheng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Cheng resolved KAFKA-6088. Resolution: Won't Fix It is fixed in kafka client 0.11.0.0, and 0.11.0.0 clients can be used

[jira] [Created] (KAFKA-6088) Kafka Consumer slows down when reading from highly compacted topics

2017-10-18 Thread James Cheng (JIRA)
James Cheng created KAFKA-6088: -- Summary: Kafka Consumer slows down when reading from highly compacted topics Key: KAFKA-6088 URL: https://issues.apache.org/jira/browse/KAFKA-6088 Project: Kafka

Re: [DISCUSS] KIP-205: Add getAllKeys() API to ReadOnlyWindowStore

2017-10-18 Thread Richard Yu
Soliciting more feedback before vote. On Wed, Oct 18, 2017 at 8:26 PM, Richard Yu wrote: > Is this KIP close to completion? Because we could start working on the > code itself now. (Its at about this stage). > > On Mon, Oct 16, 2017 at 7:37 PM, Richard Yu

Re: [DISCUSS] KIP-205: Add getAllKeys() API to ReadOnlyWindowStore

2017-10-18 Thread Richard Yu
Is this KIP close to completion? Because we could start working on the code itself now. (Its at about this stage). On Mon, Oct 16, 2017 at 7:37 PM, Richard Yu wrote: > As Guozhang Wang mentioned earlier, we want to mirror the structure of > similar Store class

[GitHub] kafka pull request #4094: MINOR: Correct KafkaProducer Javadoc spelling of p...

2017-10-18 Thread hmcl
GitHub user hmcl opened a pull request: https://github.com/apache/kafka/pull/4094 MINOR: Correct KafkaProducer Javadoc spelling of property 'max.in.flight.requests.per.connection' Currently, in branches _trunk_, _0.11.0_, and _1.0_ the property

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

2017-10-18 Thread efeg
Github user efeg closed the pull request at: https://github.com/apache/kafka/pull/4093 ---

[GitHub] kafka pull request #4093: KAFKA-6083: The Fetcher should add the InvalidReco...

2017-10-18 Thread efeg
GitHub user efeg reopened a pull request: https://github.com/apache/kafka/pull/4093 KAFKA-6083: The Fetcher should add the InvalidRecordException as a cause to the KafkaException when invalid record is found. You can merge this pull request into a Git repository by running:

[GitHub] kafka pull request #4093: [KAFKA-6083] The Fetcher should add the InvalidRec...

2017-10-18 Thread efeg
GitHub user efeg opened a pull request: https://github.com/apache/kafka/pull/4093 [KAFKA-6083] The Fetcher should add the InvalidRecordException as a cause to the KafkaException when invalid record is found. You can merge this pull request into a Git repository by running: $

Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

2017-10-18 Thread Ted Yu
Please fill out 'Rejected Alternatives' section. Thanks On Wed, Oct 18, 2017 at 4:45 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Hi all, > > I created a KIP to address the group offset expiration issue reported in > KAFKA-4682: >

[GitHub] kafka pull request #4092: KAFKA-6087: Scanning plugin.path needs to support ...

2017-10-18 Thread kkonstantine
GitHub user kkonstantine opened a pull request: https://github.com/apache/kafka/pull/4092 KAFKA-6087: Scanning plugin.path needs to support relative symlinks. You can merge this pull request into a Git repository by running: $ git pull https://github.com/kkonstantine/kafka

[jira] [Created] (KAFKA-6087) Scanning plugin.path needs to support relative symlinks

2017-10-18 Thread Konstantine Karantasis (JIRA)
Konstantine Karantasis created KAFKA-6087: - Summary: Scanning plugin.path needs to support relative symlinks Key: KAFKA-6087 URL: https://issues.apache.org/jira/browse/KAFKA-6087 Project:

[DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

2017-10-18 Thread Vahid S Hashemian
Hi all, I created a KIP to address the group offset expiration issue reported in KAFKA-4682: https://cwiki.apache.org/confluence/display/KAFKA/KIP-211%3A+Revise+Expiration+Semantics+of+Consumer+Group+Offsets Your feedback is welcome! Thanks. --Vahid

[jira] [Created] (KAFKA-6086) KIP-210 Provide for custom error handling when Kafka Streams fails to produce

2017-10-18 Thread Matt Farmer (JIRA)
Matt Farmer created KAFKA-6086: -- Summary: KIP-210 Provide for custom error handling when Kafka Streams fails to produce Key: KAFKA-6086 URL: https://issues.apache.org/jira/browse/KAFKA-6086 Project:

Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

2017-10-18 Thread Matt Farmer
I’ll create the JIRA ticket. I think that config name will work. I’ll update the KIP accordingly. On Wed, Oct 18, 2017 at 6:09 PM Ted Yu wrote: > Can you create JIRA that corresponds to the KIP ? > > For the new config, how about naming it >

[jira] [Resolved] (KAFKA-5911) Avoid creation of extra Map for futures in KafkaAdminClient

2017-10-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved KAFKA-5911. --- Resolution: Later > Avoid creation of extra Map for futures in KafkaAdminClient >

Jenkins build is back to normal : kafka-trunk-jdk7 #2901

2017-10-18 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk9 #134

2017-10-18 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Remove dead code -- [...truncated 1.41 MB...] kafka.security.auth.SimpleAclAuthorizerTest > testHighConcurrencyDeletionOfResourceAcls STARTED

[jira] [Created] (KAFKA-6085) Streams rebalancing may cause a first batch of fetched records to be dropped

2017-10-18 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-6085: Summary: Streams rebalancing may cause a first batch of fetched records to be dropped Key: KAFKA-6085 URL: https://issues.apache.org/jira/browse/KAFKA-6085 Project:

[jira] [Resolved] (KAFKA-3083) a soft failure in controller may leave a topic partition in an inconsistent state

2017-10-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-3083. Resolution: Fixed Assignee: Onur Karaman (was: Mayuresh Gharat) Fix Version/s: 1.1.0 This

[jira] [Resolved] (KAFKA-3038) Speeding up partition reassignment after broker failure

2017-10-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-3038. Resolution: Duplicate This is now fixed in KAFKA-5642. > Speeding up partition reassignment after broker

[jira] [Resolved] (KAFKA-4444) Aggregate requests sent from controller to broker during controlled shutdown

2017-10-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-. Resolution: Duplicate This is now fixed in KAFKA-5642. > Aggregate requests sent from controller to broker

[GitHub] kafka pull request #4091: Test branch

2017-10-18 Thread dnangel026
Github user dnangel026 closed the pull request at: https://github.com/apache/kafka/pull/4091 ---

[GitHub] kafka pull request #4091: Test branch

2017-10-18 Thread dnangel026
GitHub user dnangel026 opened a pull request: https://github.com/apache/kafka/pull/4091 Test branch Test You can merge this pull request into a Git repository by running: $ git pull https://github.com/Microsoft/kafka testBrach Alternatively you can review and apply these

Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

2017-10-18 Thread Ted Yu
Can you create JIRA that corresponds to the KIP ? For the new config, how about naming it production.exception.processor.class ? This way it is clear that class name should be specified. Cheers On Wed, Oct 18, 2017 at 2:40 PM, Matt Farmer wrote: > Hello everyone, > > This is the

Build failed in Jenkins: kafka-trunk-jdk7 #2900

2017-10-18 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Remove dead code -- [...truncated 379.38 KB...] kafka.server.epoch.LeaderEpochFileCacheTest >

[GitHub] kafka pull request #4090: [KAFKA-6084] Propagate JSON parsing errors in Reas...

2017-10-18 Thread viktorsomogyi
GitHub user viktorsomogyi opened a pull request: https://github.com/apache/kafka/pull/4090 [KAFKA-6084] Propagate JSON parsing errors in ReassignPartitionsCommand You can merge this pull request into a Git repository by running: $ git pull

[DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

2017-10-18 Thread Matt Farmer
Hello everyone, This is the discussion thread for the KIP that I just filed here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-210+-+Provide+for+custom+error+handling++when+Kafka+Streams+fails+to+produce Looking forward to getting some feedback from folks about this idea and working

[jira] [Created] (KAFKA-6084) ReassignPartitionsCommand should propagate JSON parsing failures

2017-10-18 Thread Viktor Somogyi (JIRA)
Viktor Somogyi created KAFKA-6084: - Summary: ReassignPartitionsCommand should propagate JSON parsing failures Key: KAFKA-6084 URL: https://issues.apache.org/jira/browse/KAFKA-6084 Project: Kafka

[GitHub] kafka pull request #4087: MINOR: Remove dead code

2017-10-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4087 ---

[GitHub] kafka-site pull request #100: MINOR: Pinterest link correction

2017-10-18 Thread manjuapu
Github user manjuapu commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/100#discussion_r145538033 --- Diff: 0110/streams/index.html --- @@ -111,23 +93,41 @@ Streams API use cases -

Re: [kafka-clients] [VOTE] 1.0.0 RC2

2017-10-18 Thread Guozhang Wang
Thanks for pointing out, Jun, Ismael. Will update the statement. Guozhang On Wed, Oct 18, 2017 at 9:51 AM, Ismael Juma wrote: > Also, only part 1 of KIP-113 landed. The release planning page has the > correct info for what it's worth. > > Ismael > > On 18 Oct 2017 5:42 pm,

[GitHub] kafka-site pull request #100: MINOR: Pinterest link correction

2017-10-18 Thread guozhangwang
Github user guozhangwang commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/100#discussion_r145530925 --- Diff: 0110/streams/index.html --- @@ -82,26 +82,8 @@ The easiest way to write mission-critical real-time ap Streams API use cases

[GitHub] kafka-site pull request #100: MINOR: Pinterest link correction

2017-10-18 Thread guozhangwang
Github user guozhangwang commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/100#discussion_r145531542 --- Diff: 0110/streams/index.html --- @@ -111,23 +93,41 @@ Streams API use cases -

[jira] [Created] (KAFKA-6083) The Fetcher should add the InvalidRecordException as a cause to the KafkaException when invalid record is found.

2017-10-18 Thread Jiangjie Qin (JIRA)
Jiangjie Qin created KAFKA-6083: --- Summary: The Fetcher should add the InvalidRecordException as a cause to the KafkaException when invalid record is found. Key: KAFKA-6083 URL:

Build failed in Jenkins: kafka-trunk-jdk7 #2899

2017-10-18 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-6051; Close the ReplicaFetcherBlockingSend earlier on shutdown -- [...truncated 1.83 MB...] org.apache.kafka.streams.KafkaStreamsTest >

[jira] [Created] (KAFKA-6082) consider fencing zookeeper updates with controller epoch zkVersion

2017-10-18 Thread Onur Karaman (JIRA)
Onur Karaman created KAFKA-6082: --- Summary: consider fencing zookeeper updates with controller epoch zkVersion Key: KAFKA-6082 URL: https://issues.apache.org/jira/browse/KAFKA-6082 Project: Kafka

[jira] [Created] (KAFKA-6081) response error code checking

2017-10-18 Thread Onur Karaman (JIRA)
Onur Karaman created KAFKA-6081: --- Summary: response error code checking Key: KAFKA-6081 URL: https://issues.apache.org/jira/browse/KAFKA-6081 Project: Kafka Issue Type: Sub-task

Jenkins build is back to normal : kafka-trunk-jdk8 #2145

2017-10-18 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-5083) always leave the last surviving member of the ISR in ZK

2017-10-18 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Onur Karaman resolved KAFKA-5083. - Resolution: Fixed This has been fixed in KAFKA-5642. > always leave the last surviving member of

[GitHub] kafka pull request #4089: KAFKA-6071: Use ZookeeperClient in LogManager

2017-10-18 Thread omkreddy
GitHub user omkreddy opened a pull request: https://github.com/apache/kafka/pull/4089 KAFKA-6071: Use ZookeeperClient in LogManager You can merge this pull request into a Git repository by running: $ git pull https://github.com/omkreddy/kafka KAFKA-6071-ZK-LOGMANAGER

[jira] [Created] (KAFKA-6080) Transactional EoS for source connectors

2017-10-18 Thread Antony Stubbs (JIRA)
Antony Stubbs created KAFKA-6080: Summary: Transactional EoS for source connectors Key: KAFKA-6080 URL: https://issues.apache.org/jira/browse/KAFKA-6080 Project: Kafka Issue Type: New

[jira] [Created] (KAFKA-6079) Idempotent production for source connectors

2017-10-18 Thread Antony Stubbs (JIRA)
Antony Stubbs created KAFKA-6079: Summary: Idempotent production for source connectors Key: KAFKA-6079 URL: https://issues.apache.org/jira/browse/KAFKA-6079 Project: Kafka Issue Type: New

Jenkins build is back to normal : kafka-trunk-jdk9 #133

2017-10-18 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk7 #2898

2017-10-18 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-5642; Use async ZookeeperClient in Controller -- [...truncated 1.83 MB...] org.apache.kafka.streams.KafkaStreamsTest >

[GitHub] kafka pull request #4088: MINOR: Controller and async ZookeeperClient improv...

2017-10-18 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/4088 MINOR: Controller and async ZookeeperClient improvements (WIP) More to come. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka

[GitHub] kafka pull request #4056: KAFKA-6051 Close the ReplicaFetcherBlockingSend ea...

2017-10-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4056 ---

Re: [kafka-clients] [VOTE] 1.0.0 RC2

2017-10-18 Thread Ismael Juma
Also, only part 1 of KIP-113 landed. The release planning page has the correct info for what it's worth. Ismael On 18 Oct 2017 5:42 pm, "Jun Rao" wrote: > Hi, Guozhang, > > Thanks for running the release. Just a quick clarification. The statement > that "* Controller

Re: [kafka-clients] [VOTE] 1.0.0 RC2

2017-10-18 Thread Jun Rao
Hi, Guozhang, Thanks for running the release. Just a quick clarification. The statement that "* Controller improvements: async ZK access for faster administrative request handling" is not accurate. What's included in 1.0.0 is a logging change improvement in the controller, which does give

Unit test failure in ClientUtilsTest - corporate firewall - InetSocketAddress.isUnresolved

2017-10-18 Thread michael.guyver
Hi everyone, I've tried to build kafka-0.11.0.1 and see a unit-test error with the following stack trace: org.apache.kafka.common.config.ConfigException: No resolvable bootstrap urls given in bootstrap.servers at

[GitHub] kafka pull request #3765: KAFKA-5642: Use async ZookeeperClient in Controlle...

2017-10-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3765 ---

Re: [VOTE] KIP-207:The Offsets which ListOffsetsResponse returns should monotonically increase even during a partition leader change

2017-10-18 Thread Colin McCabe
On Wed, Oct 18, 2017, at 04:09, Ismael Juma wrote: > Thanks for the KIP, +1 (binding). A few comments: > > 1. I agree with Jun about LEADER_NOT_AVAILABLE for the error code for > older > versions. > 2. OffsetNotAvailableException seems clear enough (i.e. we don't need the > "ForPartition" part)

[jira] [Resolved] (KAFKA-5642) Use async ZookeeperClient in Controller

2017-10-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-5642. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 3765

Re: working on KAFKA-4928

2017-10-18 Thread Ted Yu
There was a PR https://github.com/apache/kafka/pull/2889 which was closed. It would be good for committers to chime in on the previous attempt. On Wed, Oct 18, 2017 at 8:39 AM, Pavel Drankov wrote: > Hi, > > My name is Pavel and I'm a very new to Kafka. I actually would

Re: [VOTE] KIP-207:The Offsets which ListOffsetsResponse returns should monotonically increase even during a partition leader change

2017-10-18 Thread Colin McCabe
On Tue, Oct 17, 2017, at 13:26, Jun Rao wrote: > Hi, Colin, > > Thanks for the KIP. +1. Just a minor comment. For the old client > requests, > would it be better to return a LEADER_NOT_AVAILABLE error instead? Good idea. I changed it to LeaderNotAvailableException. best, Colin > > Jun > >

Re: [DISCUSS] KIP-204 : adding records deletion operation to the new Admin Client API

2017-10-18 Thread Colin McCabe
Having a class there makes sense to me. It also helps clarify what the Long represents (a record offset). regards, Colin On Wed, Oct 18, 2017, at 06:19, Dong Lin wrote: > Sure. This makes sense. I agree it is better to replace Long with a new > class. > > On Wed, Oct 18, 2017 at 6:16 AM,

[GitHub] kafka pull request #4087: MINOR: Remove dead code

2017-10-18 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/4087 MINOR: Remove dead code You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka remove-dead-code Alternatively you can review and apply

[GitHub] kafka-site pull request #100: MINOR: Pinterest link correction

2017-10-18 Thread manjuapu
GitHub user manjuapu opened a pull request: https://github.com/apache/kafka-site/pull/100 MINOR: Pinterest link correction @guozhangwang Pleas review You can merge this pull request into a Git repository by running: $ git pull https://github.com/manjuapu/kafka-site asf-site

working on KAFKA-4928

2017-10-18 Thread Pavel Drankov
Hi, My name is Pavel and I'm a very new to Kafka. I actually would like to work on KAFKA-4928, which is for newbies. Can someone point me out what DumpLogSegments is and where I can start? Which cases should I use in order to test it? Best wishes, Pavel

Re: KIP Access

2017-10-18 Thread Damian Guy
Hi Matt, You should have permission now. Thanks, Damian On Wed, 18 Oct 2017 at 15:54 Matt Farmer wrote: > Hey everyone, > > I'm a software engineer at MailChimp working on our Data Systems team. I'm > looking to file a KIP to improve the error handling hooks that Kafka > Streams

KIP Access

2017-10-18 Thread Matt Farmer
Hey everyone, I'm a software engineer at MailChimp working on our Data Systems team. I'm looking to file a KIP to improve the error handling hooks that Kafka Streams exposes when producing messages. We've got a use case internally that requires us to be able to ignore certain classes of errors

Re: [VOTE] KIP-203: Add toLowerCase support to sasl.kerberos.principal.to.local rule

2017-10-18 Thread Rajini Sivaram
+1 (binding) On Mon, Oct 9, 2017 at 5:32 PM, Manikumar wrote: > I'm bumping this up to get some attention :) > > On Wed, Sep 27, 2017 at 8:46 PM, Tom Bentley > wrote: > > > +1 (nonbinding) > > > > On 27 September 2017 at 16:10, Manikumar

Re: [DISCUSS] KIP-204 : adding records deletion operation to the new Admin Client API

2017-10-18 Thread Dong Lin
Sure. This makes sense. I agree it is better to replace Long with a new class. On Wed, Oct 18, 2017 at 6:16 AM, Ismael Juma wrote: > Hi Dong, > > Yes, I mean replacing the `Long` with a class in the map. The class would > have static factory methods for the various use cases.

Re: [DISCUSS] KIP-204 : adding records deletion operation to the new Admin Client API

2017-10-18 Thread Ismael Juma
Hi Dong, Yes, I mean replacing the `Long` with a class in the map. The class would have static factory methods for the various use cases. To use the `createPartitions` example, there is a `NewPartitions.increaseTo` method. Not sure why you think it's too complicated. It provides better type

[jira] [Created] (KAFKA-6078) Investigate failure of ReassignPartitionsClusterTest.shouldExpandCluster

2017-10-18 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6078: --- Summary: Investigate failure of ReassignPartitionsClusterTest.shouldExpandCluster Key: KAFKA-6078 URL: https://issues.apache.org/jira/browse/KAFKA-6078 Project: Kafka

Re: [DISCUSS] KIP-204 : adding records deletion operation to the new Admin Client API

2017-10-18 Thread Dong Lin
Hey Ismael, To clarify, I think you are saying that we should replace "deleteRecords(Map partitionsAndOffsets)" with "deleteRecords(Map partitionsAndOffsets)", where DeleteRecordsParameter should be include a "Long value", and probably

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-10-18 Thread Jeyhun Karimov
Hi, The main intuition is to solve [1], which is part of this KIP. I agree with you that this might not seem semantically correct as we are not committing record state. Alternatively, we can remove commit() from RecordContext and add ProcessorContext (which has commit() method) as an extra

[GitHub] kafka pull request #2555: MINOR: Javadoc typo

2017-10-18 Thread astubbs
Github user astubbs closed the pull request at: https://github.com/apache/kafka/pull/2555 ---

Re: [DISCUSS] KIP-204 : adding records deletion operation to the new Admin Client API

2017-10-18 Thread Ismael Juma
Hi Dong, I think it makes sense to use the parameters to define the specifics of the request. However, we would probably want to replace the `Long` with a class (similar to `createPartitions`) instead of relying on `DeleteRecordsOptions`. The latter is typically used for defining additional

Re: [VOTE] KIP-207:The Offsets which ListOffsetsResponse returns should monotonically increase even during a partition leader change

2017-10-18 Thread Ismael Juma
Thanks for the KIP, +1 (binding). A few comments: 1. I agree with Jun about LEADER_NOT_AVAILABLE for the error code for older versions. 2. OffsetNotAvailableException seems clear enough (i.e. we don't need the "ForPartition" part) 3. The KIP seems to be missing the compatibility section. 4. It

Re: [VOTE] KIP-204 : adding records deletion operation to the new Admin Client API

2017-10-18 Thread Viktor Somogyi
+1 (non-binding) On Wed, Oct 18, 2017 at 8:23 AM, Manikumar wrote: > + (non-binding) > > > Thanks, > Manikumar > > On Tue, Oct 17, 2017 at 7:42 AM, Dong Lin wrote: > > > Thanks for the KIP. +1 (non-binding) > > > > On Wed, Oct 11, 2017 at 2:27

Build failed in Jenkins: kafka-trunk-jdk9 #132

2017-10-18 Thread Apache Jenkins Server
See Changes: [damian.guy] KAFKA-6023 ThreadCache#sizeBytes() should check overflow -- [...truncated 1.40 MB...] kafka.message.MessageTest > testFieldValues STARTED

Build failed in Jenkins: kafka-trunk-jdk8 #2144

2017-10-18 Thread Apache Jenkins Server
See Changes: [damian.guy] KAFKA-6023 ThreadCache#sizeBytes() should check overflow -- [...truncated 1.77 MB...]

[GitHub] kafka pull request #4041: KAFKA-6023 ThreadCache#sizeBytes() should check ov...

2017-10-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4041 ---

[jira] [Resolved] (KAFKA-6023) ThreadCache#sizeBytes() should check overflow

2017-10-18 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-6023. --- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 4041

[GitHub] kafka-site pull request #99: Rephrase mailing lists section to avoid incorre...

2017-10-18 Thread scholzj
Github user scholzj commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/99#discussion_r145347106 --- Diff: contact.html --- @@ -11,16 +11,16 @@ -

[GitHub] kafka-site pull request #99: Rephrase mailing lists section to avoid incorre...

2017-10-18 Thread scholzj
Github user scholzj commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/99#discussion_r145345710 --- Diff: contact.html --- @@ -11,16 +11,16 @@ -

[GitHub] kafka-site pull request #99: Rephrase mailing lists section to avoid incorre...

2017-10-18 Thread tombentley
Github user tombentley commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/99#discussion_r145345640 --- Diff: contact.html --- @@ -11,16 +11,16 @@ -

Re: KafkaSpout not consuming the first uncommitted offset data from kafka

2017-10-18 Thread Michael Noll
Hi Senthil, you should ask this question in the Apache Storm mailing list. At first sight this looks like a problem with Storm's KafkaSpout implementation, not with Kafka. Best wishes, Michael On Thu, Sep 28, 2017 at 8:47 PM, senthil kumar wrote: > Hi Kafka, > > I

[GitHub] kafka-site pull request #99: Rephrase mailing lists section to avoid incorre...

2017-10-18 Thread tombentley
Github user tombentley commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/99#discussion_r145344978 --- Diff: contact.html --- @@ -11,16 +11,16 @@ -

[GitHub] kafka-site issue #81: MINOR: Fix typo in the gradle command for code style c...

2017-10-18 Thread scholzj
Github user scholzj commented on the issue: https://github.com/apache/kafka-site/pull/81 Can someone have a look at this? It is just a simple typo, so it should be very easy to review and merge. ---

[GitHub] kafka-site pull request #99: Rephrase mailing lists section to avoid incorre...

2017-10-18 Thread scholzj
GitHub user scholzj opened a pull request: https://github.com/apache/kafka-site/pull/99 Rephrase mailing lists section to avoid incorrect subscribe emails The user@ and dev@ mailing lists seem to receive lot of emails from users who are not subscribed but are trying to subscribe. I

[jira] [Created] (KAFKA-6077) Let SimpleConsumer support Kerberos authentication

2017-10-18 Thread huangjianan (JIRA)
huangjianan created KAFKA-6077: -- Summary: Let SimpleConsumer support Kerberos authentication Key: KAFKA-6077 URL: https://issues.apache.org/jira/browse/KAFKA-6077 Project: Kafka Issue Type:

Re: [VOTE] KIP-204 : adding records deletion operation to the new Admin Client API

2017-10-18 Thread Manikumar
+ (non-binding) Thanks, Manikumar On Tue, Oct 17, 2017 at 7:42 AM, Dong Lin wrote: > Thanks for the KIP. +1 (non-binding) > > On Wed, Oct 11, 2017 at 2:27 AM, Ted Yu wrote: > > > +1 > > > > On Mon, Oct 2, 2017 at 10:51 PM, Paolo Patierno