i have charset question about kafka

2016-10-18 Thread /kun????????
i hava test my kafka programe using kafka-console-producer.sh and kafka-console-consumer.sh.

[GitHub] kafka pull request #2035: Replaced unnecessary map and getOrElse with exists

2016-10-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2035 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: client use high cpu which caused by delayedFetch operation immediately return

2016-10-18 Thread Json Tu
Thanks. I patch it, and everything goes ok. > 在 2016年10月9日,下午12:39,Becket Qin 写道: > > Can you check if you have KAFKA-3003 when you run the code? > > On Sat, Oct 8, 2016 at 12:52 AM, Kafka wrote: > >> Hi all, >>we found our consumer have high

Lots of warn log in Kafka broker

2016-10-18 Thread Json Tu
Hi all, I have a kafka 0.9.0.0 cluster with 11 nodes. First,I found server logs as below, server.log.2016-10-17-22:[2016-10-17 22:22:13,885] WARN [ReplicaFetcherThread-0-4], Error in fetch kafka.server.ReplicaFetcherThread$FetchRequest@367c9f98. Possible cause:

Jenkins build is back to normal : kafka-trunk-jdk7 #1635

2016-10-18 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-4238) consumer-subscription not working, when accessing a newly created topic immediately after its creation with the AdminUtils

2016-10-18 Thread Florian Witteler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584849#comment-15584849 ] Florian Witteler commented on KAFKA-4238: - That's exactly what I thought. Maybe you could

Re: KStreams / add support for sink processor with dynamic topics

2016-10-18 Thread Damian Guy
Hi Florian, Do you know the set of subtypes in advance? I.e, could you use: KStream[] branches = stream.branch(predicates); to split the stream based on the subtypes? Thanks, Damian On Tue, 18 Oct 2016 at 00:43 Matthias J. Sax wrote: > -BEGIN PGP SIGNED

[GitHub] kafka pull request #2035: Replaced unnecessary map and getOrElse with exists

2016-10-18 Thread himani1
GitHub user himani1 opened a pull request: https://github.com/apache/kafka/pull/2035 Replaced unnecessary map and getOrElse with exists You can merge this pull request into a Git repository by running: $ git pull https://github.com/himani1/kafka code_refactored Alternatively

[GitHub] kafka pull request #2036: MINOR: Update rocksDB dependency to 4.11.2

2016-10-18 Thread jozi-k
GitHub user jozi-k opened a pull request: https://github.com/apache/kafka/pull/2036 MINOR: Update rocksDB dependency to 4.11.2 There are 32 failing tests on both trunk and my branch. You can merge this pull request into a Git repository by running: $ git pull

[jira] [Created] (KAFKA-4310) kafka-consumer-groups script for Windows platform does not exist

2016-10-18 Thread huxi (JIRA)
huxi created KAFKA-4310: --- Summary: kafka-consumer-groups script for Windows platform does not exist Key: KAFKA-4310 URL: https://issues.apache.org/jira/browse/KAFKA-4310 Project: Kafka Issue Type:

[jira] [Work started] (KAFKA-4310) kafka-consumer-groups script for Windows platform does not exist

2016-10-18 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4310 started by huxi. --- > kafka-consumer-groups script for Windows platform does not exist >

[GitHub] kafka pull request #2037: add Windows script 'kafka-consumer-groups.bat' as ...

2016-10-18 Thread amethystic
GitHub user amethystic opened a pull request: https://github.com/apache/kafka/pull/2037 add Windows script 'kafka-consumer-groups.bat' as issue Kafka-4310 mentions add file 'kafka-consumer-groups.bat' for Windows platform You can merge this pull request into a Git repository by

[jira] [Commented] (KAFKA-4311) Exception in NamedCache.flush - Key found in dirty key set, but entry is null

2016-10-18 Thread Frank Lyaruu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585901#comment-15585901 ] Frank Lyaruu commented on KAFKA-4311: - | Which version of kafka are you running? I was running a

[jira] [Commented] (KAFKA-2200) kafkaProducer.send() should not call callback.onCompletion()

2016-10-18 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585030#comment-15585030 ] Jiangjie Qin commented on KAFKA-2200: - [~andrew.musselman] Yep, still a problem. [~omkreddy] There

Re: client use high cpu which caused by delayedFetch operation immediately return

2016-10-18 Thread Becket Qin
Glad to know :) On Tue, Oct 18, 2016 at 1:24 AM, Json Tu wrote: > Thanks. I patch it, and everything goes ok. > > 在 2016年10月9日,下午12:39,Becket Qin 写道: > > > > Can you check if you have KAFKA-3003 when you run the code? > > > > On Sat, Oct 8, 2016 at 12:52

[jira] [Commented] (KAFKA-4311) Exception in NamedCache.flush - Key found in dirty key set, but entry is null

2016-10-18 Thread Frank Lyaruu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585912#comment-15585912 ] Frank Lyaruu commented on KAFKA-4311: - I see another stacktrace: java.lang.ClassCastException:

[jira] [Commented] (KAFKA-4311) Exception in NamedCache.flush - Key found in dirty key set, but entry is null

2016-10-18 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585914#comment-15585914 ] Damian Guy commented on KAFKA-4311: --- [~flyaruu] by merge do you mean join? Is it possible for you to

[GitHub] kafka pull request #2038: HOTFIX: Fix put logic

2016-10-18 Thread enothereska
GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/2038 HOTFIX: Fix put logic You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka hotfix-put-cache Alternatively you can review and

[jira] [Resolved] (KAFKA-3995) Add a new configuration "enable.comrpession.ratio.estimation" to the producer config

2016-10-18 Thread Mayuresh Gharat (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayuresh Gharat resolved KAFKA-3995. Resolution: Workaround > Add a new configuration "enable.comrpession.ratio.estimation" to

[jira] [Created] (KAFKA-4311) Exception in NamedCache.flush - Key found in dirty key set, but entry is null

2016-10-18 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-4311: - Summary: Exception in NamedCache.flush - Key found in dirty key set, but entry is null Key: KAFKA-4311 URL: https://issues.apache.org/jira/browse/KAFKA-4311 Project:

[jira] [Created] (KAFKA-4312) void writeAsText(String filePath) throws NullPointerException when filePath is empty

2016-10-18 Thread Seweryn Habdank-Wojewodzki (JIRA)
Seweryn Habdank-Wojewodzki created KAFKA-4312: - Summary: void writeAsText(String filePath) throws NullPointerException when filePath is empty Key: KAFKA-4312 URL:

[jira] [Assigned] (KAFKA-4312) void KTableImpl.writeAsText(String filePath) throws NullPointerException when filePath is empty String

2016-10-18 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck reassigned KAFKA-4312: -- Assignee: Bill Bejeck > void KTableImpl.writeAsText(String filePath) throws

[jira] [Updated] (KAFKA-4312) void KTableImpl.writeAsText(String filePath) throws NullPointerException when filePath is empty String

2016-10-18 Thread Seweryn Habdank-Wojewodzki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Seweryn Habdank-Wojewodzki updated KAFKA-4312: -- Description: The KTableImpl method void writeAsText(String filePath)

[jira] [Updated] (KAFKA-4312) void writeAsText(String filePath) throws NullPointerException when filePath is empty String

2016-10-18 Thread Seweryn Habdank-Wojewodzki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Seweryn Habdank-Wojewodzki updated KAFKA-4312: -- Summary: void writeAsText(String filePath) throws NullPointerException

[jira] [Updated] (KAFKA-4312) void KTableImpl.writeAsText(String filePath) throws NullPointerException when filePath is empty String

2016-10-18 Thread Seweryn Habdank-Wojewodzki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Seweryn Habdank-Wojewodzki updated KAFKA-4312: -- Summary: void KTableImpl.writeAsText(String filePath) throws

[jira] [Updated] (KAFKA-4312) void writeAsText(String filePath) throws NullPointerException when filePath is empty String

2016-10-18 Thread Seweryn Habdank-Wojewodzki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Seweryn Habdank-Wojewodzki updated KAFKA-4312: -- Description: The KTable method void writeAsText(String filePath)

Re: KStreams / add support for sink processor with dynamic topics

2016-10-18 Thread Florian Hussonnois
Thank you Matthias for your answers. The mailing list that you linked shows a solution using the Processor API. Actually, the set of subtypes is not known in advance this is why I need to compute output topics from messages. So the branch method is of any help in my context. I think, this

[jira] [Resolved] (KAFKA-4310) kafka-consumer-groups script for Windows platform does not exist

2016-10-18 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-4310. Resolution: Fixed Resolved here: https://github.com/apache/kafka/pull/2037. >

[jira] [Work started] (KAFKA-2066) Replace FetchRequest / FetchResponse with their org.apache.kafka.common.requests equivalents

2016-10-18 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-2066 started by Jason Gustafson. -- > Replace FetchRequest / FetchResponse with their >

[GitHub] kafka pull request #2037: add Windows script 'kafka-consumer-groups.bat' as ...

2016-10-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2037 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4275) Check of State-Store-assignment to Processor-Nodes is not enabled

2016-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586399#comment-15586399 ] ASF GitHub Bot commented on KAFKA-4275: --- GitHub user mjsax opened a pull request:

[GitHub] kafka pull request #2039: HOTFIX: follow up on KAFKA-4275

2016-10-18 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/2039 HOTFIX: follow up on KAFKA-4275 You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka hotfix-ktableLeftJoin Alternatively you can review

[jira] [Updated] (KAFKA-4161) Decouple flush and offset commits

2016-10-18 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shikhar Bhushan updated KAFKA-4161: --- Issue Type: Improvement (was: New Feature) > Decouple flush and offset commits >

Jenkins build is back to normal : kafka-trunk-jdk8 #984

2016-10-18 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #2040: KAFKA-4161: prototype for exploring API change

2016-10-18 Thread shikhar
GitHub user shikhar opened a pull request: https://github.com/apache/kafka/pull/2040 KAFKA-4161: prototype for exploring API change You can merge this pull request into a Git repository by running: $ git pull https://github.com/shikhar/kafka kafka-4161 Alternatively you can

[jira] [Commented] (KAFKA-4161) Decouple flush and offset commits

2016-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586495#comment-15586495 ] ASF GitHub Bot commented on KAFKA-4161: --- GitHub user shikhar opened a pull request:

[jira] [Updated] (KAFKA-3462) Allow SinkTasks to disable consumer offset commit

2016-10-18 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shikhar Bhushan updated KAFKA-3462: --- Issue Type: Improvement (was: Bug) > Allow SinkTasks to disable consumer offset commit >

[jira] [Commented] (KAFKA-4306) Connect workers won't shut down if brokers are not available

2016-10-18 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586568#comment-15586568 ] Shikhar Bhushan commented on KAFKA-4306: KAFKA-4154 is another issue relating to

[GitHub] kafka pull request #2021: MINOR: remove duplicate doc headers

2016-10-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2021 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #2041: MINOR: Clarify how to fix conversion issues when p...

2016-10-18 Thread ewencp
GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/2041 MINOR: Clarify how to fix conversion issues when plain JSON data is used with schemas.enable=true You can merge this pull request into a Git repository by running: $ git pull

[GitHub] kafka pull request #2033: Documentation for Throttled Replication

2016-10-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2033 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

i have charset question about kafka

2016-10-18 Thread /kun????????
i hava test my kafka programe using kafka-console-producer.sh and kafka-console-consumer.sh. setp1 : [oracle@bd02 bin]$ ./kafka-console-producer.sh --broker-list 133.224.217.175:9092 --topic oggtopic setp2: [oracle@bd02 bin]$ ./kafka-console-consumer.sh --zookeeper

Re: [DISCUSS] KIP-68 Add a consumed log retention before log retention

2016-10-18 Thread Mayuresh Gharat
Hi David, Thanks for the KIP. I had some questions/suggestions : It would be great if you can explain with an example about how the min offset for all the consumers will be calculated, in the KIP. What I meant was, it would be great to understand with a pseudo code/workflow if possible, how

[jira] [Work started] (KAFKA-4312) void KTableImpl.writeAsText(String filePath) throws NullPointerException when filePath is empty String

2016-10-18 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4312 started by Bill Bejeck. -- > void KTableImpl.writeAsText(String filePath) throws NullPointerException when >

Build failed in Jenkins: kafka-trunk-jdk7 #1638

2016-10-18 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Remove duplicate doc headers [cshapi] DOC: Documentation for Throttled Replication -- [...truncated 14211 lines...]

[jira] [Commented] (KAFKA-4313) ISRs may thrash when replication quota is enabled

2016-10-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587386#comment-15587386 ] Jun Rao commented on KAFKA-4313: One way to fix this is that we avoid throttling those replicas in the

[jira] [Created] (KAFKA-4313) ISRs may thrash when replication quota is enabled

2016-10-18 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-4313: -- Summary: ISRs may thrash when replication quota is enabled Key: KAFKA-4313 URL: https://issues.apache.org/jira/browse/KAFKA-4313 Project: Kafka Issue Type: Bug

Build failed in Jenkins: kafka-trunk-jdk8 #986

2016-10-18 Thread Apache Jenkins Server
See Changes: [cshapi] DOC: Documentation for Throttled Replication -- [...truncated 14207 lines...] org.apache.kafka.streams.StreamsConfigTest > shouldSupportPrefixedProducerConfigs PASSED

[jira] [Commented] (KAFKA-4313) ISRs may thrash when replication quota is enabled

2016-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587404#comment-15587404 ] ASF GitHub Bot commented on KAFKA-4313: --- GitHub user junrao opened a pull request:

[GitHub] kafka pull request #2043: KAFKA-4313: ISRs may thrash when replication quota...

2016-10-18 Thread junrao
GitHub user junrao opened a pull request: https://github.com/apache/kafka/pull/2043 KAFKA-4313: ISRs may thrash when replication quota is enabled You can merge this pull request into a Git repository by running: $ git pull https://github.com/junrao/kafka kafka-4313

[GitHub] kafka pull request #2020: Removed unnecessary if/else clause.

2016-10-18 Thread himani1
Github user himani1 closed the pull request at: https://github.com/apache/kafka/pull/2020 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #2042: KAFKA-4312: If filePath is empty string writeAsTex...

2016-10-18 Thread bbejeck
GitHub user bbejeck opened a pull request: https://github.com/apache/kafka/pull/2042 KAFKA-4312: If filePath is empty string writeAsText should have more m… …eaningful error message You can merge this pull request into a Git repository by running: $ git pull

Build failed in Jenkins: kafka-trunk-jdk8 #985

2016-10-18 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Remove duplicate doc headers -- [...truncated 14188 lines...] org.apache.kafka.streams.StreamsConfigTest > shouldSupportPrefixedProducerConfigs PASSED

Kafka(9.0.1) error : org.apache.kafka.common.network.InvalidReceiveException: Invalid receive (size = 1164731757 larger than 104857600)

2016-10-18 Thread Arun Rai
Hello Kafka/Cassandra experts, *I am getting below error….* org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel( NetworkReceive.java:91) at org.apache.kafka.common.network.NetworkReceive. readFrom(NetworkReceive.java:71) at

[jira] [Commented] (KAFKA-4312) void KTableImpl.writeAsText(String filePath) throws NullPointerException when filePath is empty String

2016-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587296#comment-15587296 ] ASF GitHub Bot commented on KAFKA-4312: --- GitHub user bbejeck opened a pull request:

[jira] [Updated] (KAFKA-4312) void KTableImpl.writeAsText(String filePath) throws NullPointerException when filePath is empty String

2016-10-18 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck updated KAFKA-4312: --- Component/s: streams > void KTableImpl.writeAsText(String filePath) throws NullPointerException when

[jira] [Updated] (KAFKA-4312) void KTableImpl.writeAsText(String filePath) throws NullPointerException when filePath is empty String

2016-10-18 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck updated KAFKA-4312: --- Fix Version/s: 0.10.1.1 Status: Patch Available (was: In Progress) > void