[GitHub] kafka pull request #2072: Kafka-4351: Topic regex behavioral change with Mir...

GitHub user amethystic reopened a pull request: https://github.com/apache/kafka/pull/2072 Kafka-4351: Topic regex behavioral change with MirrorMaker new consumer Support CSV values in the regexp for MirrorMaker new consumer as OldConsumer does. You can merge this pull request into

[GitHub] kafka pull request #2072: Kafka-4351: Topic regex behavioral change with Mir...

Github user amethystic closed the pull request at: https://github.com/apache/kafka/pull/2072 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [DISCUSS] Deprecating the old consumers in trunk

Not sure it is worth doing, but a simple migration approach that avoids *service* downtime could be as follows: - Add a “migration mode” to the old consumer that disables its fetchers and disables offset commits. i.e., the consumers rebalance and own partitions but do basically nothing.

Re: [DISCUSS] Deprecating the old consumers in trunk

Thanks James. I had read your post and was planning to find it in order to share it here so you saved me some work. :) Ismael On Fri, Nov 18, 2016 at 3:21 AM, James Cheng wrote: > Sorry to self-plug, but I wrote a blog post that talks about this, with > respect to mirrormaker. I came to the sam

Re: [DISCUSS] Deprecating the old consumers in trunk

Sorry to self-plug, but I wrote a blog post that talks about this, with respect to mirrormaker. I came to the same 3 solutions that Onur described. https://logallthethings.com/2016/10/07/mirrormaker-gotchas-when-moving-from-the-old-consumer-to-the-new-consumer/

Jenkins build is back to normal : kafka-0.10.1-jdk7 #86

See

Re: [VOTE] KIP-72 - Allow putting a bound on memory consumed by Incoming requests

Hi, Radai, 2. Yes, on the server side, the timeout is hardcoded at 300ms. That's not too bad. We can just leave it as it is. 3. Another thing. Do we plan to expose some JMX metrics so that we can monitor if there is any memory pressure in the pool? Thanks, Jun On Thu, Nov 17, 2016 at 8:57 AM,

Jenkins build is back to normal : kafka-trunk-jdk7 #1699

See

[GitHub] kafka pull request #2148: KAFKA-4420; Group StopReplicaRequests for partitio...

GitHub user lindong28 opened a pull request: https://github.com/apache/kafka/pull/2148 KAFKA-4420; Group StopReplicaRequests for partitions on the same broker into one StopReplicaRequest You can merge this pull request into a Git repository by running: $ git pull https://gith

[jira] [Commented] (KAFKA-4420) Group StopReplicaRequests for partitions on the same broker into one StopReplicaRequest

[ https://issues.apache.org/jira/browse/KAFKA-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675326#comment-15675326 ] ASF GitHub Bot commented on KAFKA-4420: --- GitHub user lindong28 opened a pull request

[jira] [Created] (KAFKA-4420) Group StopReplicaRequests for partitions on the same broker into one StopReplicaRequest

Dong Lin created KAFKA-4420: --- Summary: Group StopReplicaRequests for partitions on the same broker into one StopReplicaRequest Key: KAFKA-4420 URL: https://issues.apache.org/jira/browse/KAFKA-4420 Project:

Build failed in Jenkins: kafka-trunk-jdk8 #1050

See Changes: [me] KAFKA-4417: Update build dependencies for 0.10.2 cycle -- [...truncated 14417 lines...] org.apache.kafka.streams.KafkaStreamsTest > shouldNotGetTaskWithKeyAndSerializerWhenNo

Re: Kafka 0.7 - problem with link to config

Hi, Thanks for reporting. Derrick Or (our resident site guru) was kind enough to send PR 31 to fix the issue. I merged the PR and it looks good. Hope it works for you too :) Gwen On Thu, Nov 17, 2016 at 1:57 AM, Arik Sher wrote: > Hi, > > I'm browsing to this link: > http://kafka.apache.org/07/

[GitHub] kafka-site pull request #31: Documentation nav updates for older versions of...

Github user asfgit closed the pull request at: https://github.com/apache/kafka-site/pull/31 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] kafka pull request #2147: revert corrupted commit 10cfc1628df024f7596d3af5c1...

GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/2147 revert corrupted commit 10cfc1628df024f7596d3af5c168fa90f59035ca You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka hotfixBadCommit Alte

[GitHub] kafka pull request #2144: KAFKA-4417: Update build dependencies for 0.10.2 c...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2144 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4417) Update build dependencies for 0.10.2 cycle

[ https://issues.apache.org/jira/browse/KAFKA-4417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675031#comment-15675031 ] ASF GitHub Bot commented on KAFKA-4417: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-4417) Update build dependencies for 0.10.2 cycle

[ https://issues.apache.org/jira/browse/KAFKA-4417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4417. -- Resolution: Fixed Issue resolved by pull request 2144 [https://github.com/apache

Build failed in Jenkins: kafka-trunk-jdk8 #1049

See Changes: [wangguoz] KAFKA-4366: KafkaStreams.close() blocks indefinitely [wangguoz] KAFKA-3825: Allow users to specify different types of state stores in -- [...truncated 7959 lines...] ka

Build failed in Jenkins: kafka-trunk-jdk7 #1698

See Changes: [wangguoz] KAFKA-4366: KafkaStreams.close() blocks indefinitely [wangguoz] KAFKA-3825: Allow users to specify different types of state stores in -- [...truncated 3873 lines...] ka

[jira] [Commented] (KAFKA-4272) Kafka Connect batch scripts are missing under `bin/windows/`

[ https://issues.apache.org/jira/browse/KAFKA-4272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674942#comment-15674942 ] ASF GitHub Bot commented on KAFKA-4272: --- GitHub user vahidhashemian opened a pull re

[jira] [Updated] (KAFKA-4272) Kafka Connect batch scripts are missing under `bin/windows/`

[ https://issues.apache.org/jira/browse/KAFKA-4272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-4272: --- Status: Patch Available (was: Open) > Kafka Connect batch scripts are missing under `bin/wind

[GitHub] kafka pull request #2146: KAFKA-4272: Add missing 'connect' Windows batch sc...

GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/2146 KAFKA-4272: Add missing 'connect' Windows batch scripts You can merge this pull request into a Git repository by running: $ git pull https://github.com/vahidhashemian/kafka KAFKA-4272

[jira] [Commented] (KAFKA-4419) Unable to GetOffset when the ACL of topic is defined

[ https://issues.apache.org/jira/browse/KAFKA-4419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674826#comment-15674826 ] Rajini Sivaram commented on KAFKA-4419: --- {{GetOffsetShell}} doesn't currently suppor

[GitHub] kafka-site pull request #31: Documentation nav updates for older versions of...

GitHub user derrickdoo opened a pull request: https://github.com/apache/kafka-site/pull/31 Documentation nav updates for older versions of our docs plus new meetup links on Events page - Remove subnav for old versions of our docs to avoid confusion - Make the navigation/page lay

[GitHub] kafka-site pull request #26: add trademark symbol on all pages plus longer f...

Github user derrickdoo closed the pull request at: https://github.com/apache/kafka-site/pull/26 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (KAFKA-4366) KafkaStreams.close() blocks indefinitely

[ https://issues.apache.org/jira/browse/KAFKA-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674774#comment-15674774 ] ASF GitHub Bot commented on KAFKA-4366: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-1941) Timeout connections in the clients

[ https://issues.apache.org/jira/browse/KAFKA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-1941. -- Resolution: Duplicate Yes, I think this is resolved by KAFKA-1282. > Timeout connections in the clients

[jira] [Commented] (KAFKA-4413) Kakfa should support default SSLContext

[ https://issues.apache.org/jira/browse/KAFKA-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674795#comment-15674795 ] Rajini Sivaram commented on KAFKA-4413: --- Truststore is an optional config. If you do

[GitHub] kafka pull request #1588: KAFKA-3825: Allow users to specify different types...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1588 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-3825) Allow users to specify different types of state stores in Streams DSL

[ https://issues.apache.org/jira/browse/KAFKA-3825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3825: - Resolution: Fixed Fix Version/s: 0.10.2.0 Status: Resolved (was: Patch Available

[jira] [Commented] (KAFKA-3825) Allow users to specify different types of state stores in Streams DSL

[ https://issues.apache.org/jira/browse/KAFKA-3825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674787#comment-15674787 ] ASF GitHub Bot commented on KAFKA-3825: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #2097: KAFKA-4366: KafkaStreams.close() blocks indefinite...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2097 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4366) KafkaStreams.close() blocks indefinitely

[ https://issues.apache.org/jira/browse/KAFKA-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4366: - Resolution: Fixed Fix Version/s: 0.10.2.0 Status: Resolved (was: Patch Available

[jira] [Commented] (KAFKA-1941) Timeout connections in the clients

[ https://issues.apache.org/jira/browse/KAFKA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674679#comment-15674679 ] Jeff Widman commented on KAFKA-1941: Shouldn't this be closed? I think it was handled

[jira] [Updated] (KAFKA-4211) Change system tests to use the new consumer by default

[ https://issues.apache.org/jira/browse/KAFKA-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-4211: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Change system tests to us

Re: [DISCUSS] KIP-87 - Add Compaction Tombstone Flag

Hi Ismael, Thanks for the explanation. Specially I like this part where in you mentioned we can get rid of the older null value support for log compaction later on, here : We can't change semantics of the message format without having a long transition period. And we can't rely on people reading d

Re: [VOTE] KIP-72 - Allow putting a bound on memory consumed by Incoming requests

Hi Jun, 1. will do. 2. true. for several reasons: 2.1. which selector? there's a single pool but 16 selectors (linkedin typical, num.network.threads defaults to 3) 2.2. even if i could figure out which selector (all?) the better thing to do would be resume reading not when any memory become

[GitHub] kafka pull request #2145: MINOR: Remove unused code in `LeaderAndIsr`, `ApiU...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2145 MINOR: Remove unused code in `LeaderAndIsr`, `ApiUtils` and `TopicMetadataRequest` You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka un

[jira] [Commented] (KAFKA-3209) Support single message transforms in Kafka Connect

[ https://issues.apache.org/jira/browse/KAFKA-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674120#comment-15674120 ] Nisarg Shah commented on KAFKA-3209: Hey Juan. I have started working on this, have on

Kafka 0.7 - problem with link to config

Hi, I'm browsing to this link: http://kafka.apache.org/07/documentation and from there I'm clicking Configuration http://kafka.apache.org/07/configuration.html it seems to lead no where. Can you please fix it? We are still using Kafka 0.7 and really want to refer your docs. Thanks, Appreciate i

[jira] [Created] (KAFKA-4419) Unable to GetOffset when the ACL of topic is defined

Mohammed amine GARMES created KAFKA-4419: Summary: Unable to GetOffset when the ACL of topic is defined Key: KAFKA-4419 URL: https://issues.apache.org/jira/browse/KAFKA-4419 Project: Kafka

[jira] [Commented] (KAFKA-4418) Broker Leadership Election Fails If Missing ZK Path Raises Exception

[ https://issues.apache.org/jira/browse/KAFKA-4418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674040#comment-15674040 ] Michael Pedersen commented on KAFKA-4418: - I don't have a definitive answer for th

[jira] [Commented] (KAFKA-4418) Broker Leadership Election Fails If Missing ZK Path Raises Exception

[ https://issues.apache.org/jira/browse/KAFKA-4418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674023#comment-15674023 ] Ismael Juma commented on KAFKA-4418: Thanks for the report. Why was the path missing?

[jira] [Created] (KAFKA-4418) Broker Leadership Election Fails If Missing ZK Path Raises Exception

Michael Pedersen created KAFKA-4418: --- Summary: Broker Leadership Election Fails If Missing ZK Path Raises Exception Key: KAFKA-4418 URL: https://issues.apache.org/jira/browse/KAFKA-4418 Project: Kaf

Re: [DISCUSS] Deprecating the old consumers in trunk

Hi Onur, It is a good point that there is currently no out of the box solution for migrating from the old consumer to the new consumer where neither downtime or duplicate consumption are acceptable. As I understand, this is important for some of the usages at LinkedIn. Do you have any plans to tac

[jira] [Commented] (KAFKA-3209) Support single message transforms in Kafka Connect

[ https://issues.apache.org/jira/browse/KAFKA-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15673513#comment-15673513 ] Juan Jesus Chorro commented on KAFKA-3209: -- Hi! I'm interested in this feature an

[jira] [Commented] (KAFKA-4417) Update build dependencies for 0.10.2 cycle

[ https://issues.apache.org/jira/browse/KAFKA-4417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15673388#comment-15673388 ] ASF GitHub Bot commented on KAFKA-4417: --- GitHub user ijuma opened a pull request:

[GitHub] kafka pull request #2144: KAFKA-4417: Update build dependencies for 0.10.2 c...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2144 KAFKA-4417: Update build dependencies for 0.10.2 cycle Notes on the updates: * Gradle to 3.2: better incremental build and faster IDE import times (https://docs.gradle.org/3.2/release-notes) *

[jira] [Created] (KAFKA-4417) Update build dependencies for 0.10.2 cycle

Ismael Juma created KAFKA-4417: -- Summary: Update build dependencies for 0.10.2 cycle Key: KAFKA-4417 URL: https://issues.apache.org/jira/browse/KAFKA-4417 Project: Kafka Issue Type: Improvement

[jira] [Updated] (KAFKA-4376) Add scala 2.12 support

[ https://issues.apache.org/jira/browse/KAFKA-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4376: --- Assignee: Bernard Leach > Add scala 2.12 support > -- > > Key: KAF

Kafka gives very few number of messages

Hello, I would like to ask you a question related to the size of Kafka stream. I want to put a large file data (e.g., file *.csv) to Kafka then use Spark streaming to get the output from Kafka. The file size is about 100MB with ~250K messages/rows (Each row has about 10 fields of integer). I see t

Jenkins build is back to normal : kafka-trunk-jdk7 #1697

See