Re: Release date for 0.11.0.1

2017-07-07 Thread Ismael Juma
Hi Nishkam, Not yet. Is there a particular fix that you are interested in? Ismael On Fri, Jul 7, 2017 at 6:53 PM, Nishkam Ravi wrote: > Hi All, > Do we have an expected release date for 0.11.0.1 ? > > Thanks, > Nishkam >

Build failed in Jenkins: kafka-0.11.0-jdk7 #214

2017-07-07 Thread Apache Jenkins Server
See Changes: [damian.guy] HOTFIX: fix paths in streams index -- [...truncated 2.42 MB...] org.apache.kafka.streams.integration.KTableKTableJoinIntegrationTest >

Re: [DISCUSS] KIP-175: Additional '--describe' views for ConsumerGroupCommand

2017-07-07 Thread Vahid S Hashemian
Thanks Jeff for your feedback on the usefulness of the current tool. --Vahid From: Jeff Widman To: dev@kafka.apache.org Cc: Kafka User Date: 07/06/2017 02:25 PM Subject:Re: [DISCUSS] KIP-175: Additional '--describe' views for

Re: Dealing with noisy timestamps in kafka streams + 10.1

2017-07-07 Thread Greg Fodor
After more digging, a good solution seems to be to set the topic timetstamp policy to LogAppendTime and also update our timestamp extractor to respect this (by just returning record.timestamp() if the timestamp type is set to LogAppendTime.) This gets us the semantics we want for the changelog

Build failed in Jenkins: kafka-0.11.0-jdk7 #216

2017-07-07 Thread Apache Jenkins Server
See -- [...truncated 4.43 KB...] at sun.reflect.GeneratedMethodAccessor834.invoke(Unknown Source) at

Build failed in Jenkins: kafka-0.11.0-jdk7 #215

2017-07-07 Thread Apache Jenkins Server
See -- [...truncated 4.43 KB...] at sun.reflect.GeneratedMethodAccessor834.invoke(Unknown Source) at

[GitHub] kafka-site pull request #65: MINOR: add Interactive Queries docs

2017-07-07 Thread dguy
Github user dguy closed the pull request at: https://github.com/apache/kafka-site/pull/65 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka-site issue #65: MINOR: add Interactive Queries docs

2017-07-07 Thread dguy
Github user dguy commented on the issue: https://github.com/apache/kafka-site/pull/65 @guozhangwang , yep had the discussion with @ijuma today. Managed to break everything in the process due to changes that weren't in `kafka` that were in `kafka-site` and changes in `kafka` that were

[GitHub] kafka pull request #3496: KAFKA-5464: Follow up. Increase poll timeout

2017-07-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3496 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-07-07 Thread Matthias J. Sax
I would not block this KIP with regard to DSL refactoring. IMHO, we can just finish this one and the DSL refactoring will help later on to reduce the number of overloads. -Matthias On 7/7/17 5:28 AM, Jeyhun Karimov wrote: > I am following the related thread in the mailing list and looking

Hello, Help!

2017-07-07 Thread Marcelo Vinicius
Hello, my name is Marcelo, and I am from Brazil. I'm doing a search on Kafka. I would like to know if this phrase: "Somehow I struggled against sensations that contained pure abstraction and no gesture directed at the present world", is it really kafka? If so, where do I find his phrase? In what

[GitHub] kafka pull request #3504: KAFKA-5566: fixed race condition between flush and...

2017-07-07 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/3504 KAFKA-5566: fixed race condition between flush and commit You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka

Re: Possible deadlock during shutdown in setState in kafka streams 10.2

2017-07-07 Thread Greg Fodor
Sure thing: https://issues.apache.org/jira/browse/KAFKA-5571 On Fri, Jul 7, 2017 at 2:59 AM, Damian Guy wrote: > Hi Greg, > > Would you mind creating a JIRA for this with the thread dump ( i don't see > it attached to your message). > > Thanks, > Damian > > On Fri, 7 Jul

[jira] [Created] (KAFKA-5571) Possible deadlock during shutdown in setState in kafka streams 10.2

2017-07-07 Thread Greg Fodor (JIRA)
Greg Fodor created KAFKA-5571: - Summary: Possible deadlock during shutdown in setState in kafka streams 10.2 Key: KAFKA-5571 URL: https://issues.apache.org/jira/browse/KAFKA-5571 Project: Kafka

Re: Mirroring multiple clusters into one

2017-07-07 Thread Vahid S Hashemian
Thanks a lot for your input James. Regards, --Vahid From: James Cheng To: dev@kafka.apache.org Cc: us...@kafka.apache.org Date: 07/06/2017 10:26 PM Subject:Re: Mirroring multiple clusters into one Answers inline below. -James Sent from my iPhone

[GitHub] kafka-site pull request #64: MINOR: Add release dates to downloads page

2017-07-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka-site/pull/64 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Release date for 0.11.0.1

2017-07-07 Thread Nishkam Ravi
Hi All, Do we have an expected release date for 0.11.0.1 ? Thanks, Nishkam

[GitHub] kafka pull request #3505: MINOR: Reduce logging level

2017-07-07 Thread enothereska
GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/3505 MINOR: Reduce logging level You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka minor-less-logs Alternatively you can review

RE: Hello, Help!

2017-07-07 Thread Tauzell, Dave
As others mentioned this is not a forum to discuss the works of Franz Kafka. Here are some places to get you started: 1. The works of Franz Kafka: https://www.vanderbilt.edu/olli/class-materials/Franz_Kafka.pdf 2. Literature stack exchange: https://literature.stackexchange.com/ -Dave

[jira] [Reopened] (KAFKA-5566) Instable test QueryableStateIntegrationTest.shouldAllowToQueryAfterThreadDied

2017-07-07 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska reopened KAFKA-5566: - > Instable test QueryableStateIntegrationTest.shouldAllowToQueryAfterThreadDied >

Re: [ANNOUNCE] New Kafka PMC member Ismael Juma

2017-07-07 Thread Konstantine Karantasis
Congratulations Ismael! On Fri, Jul 7, 2017 at 8:26 AM Eno Thereska wrote: > Congrats! > > Eno > > On 7 Jul 2017, at 16:13, Kamal C wrote: > > > > Congratulations Ismael ! > > > > On 06-Jul-2017 14:11, "Ismael Juma"

Re: Release date for 0.11.0.1

2017-07-07 Thread Nishkam Ravi
Hi Ismael, We are interested in the fix for https://issues.apache.org/jira/browse/KAFKA-5167. Thanks, Nishkam On Fri, Jul 7, 2017 at 10:56 AM, Ismael Juma wrote: > Hi Nishkam, > > Not yet. Is there a particular fix that you are interested in? > > Ismael > > On Fri, Jul

Aggressive log compaction ratio appears to have no negative effect on log-compacted topics

2017-07-07 Thread Jeff Chao
Hi, I filed a jira a few weeks ago around some log compaction ratio behavior we were seeing. Now that the 0.11 vote done and release is out, I wanted to follow up on it. Jira is here: https://issues.apache.org/jira/projects/KAFKA/issues/KAFKA-5452. Details are in the jira, but long story short,

[GitHub] kafka pull request #3505: MINOR: Reduce logging level

2017-07-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3505 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Jenkins build is back to normal : kafka-0.11.0-jdk7 #217

2017-07-07 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-0.10.2-jdk7 #181

2017-07-07 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-5464: Follow up. Increase poll timeout -- [...truncated 259.23 KB...] kafka.api.PlaintextConsumerTest > testFetchInvalidOffset STARTED

Re: [DISCUSS] Streams DSL/StateStore Refactoring

2017-07-07 Thread Matthias J. Sax
It's too issues we want to tackle - too many overload (for some method we have already more than 10( - improve custom store API -Matthias On 7/7/17 3:42 PM, Jan Filipiak wrote: > It makes me want to cry. > > why on earth is the DSL going to expose all its implementation details now? >

[GitHub] kafka pull request #3507: KAFKA-5550

2017-07-07 Thread jcustenborder
GitHub user jcustenborder opened a pull request: https://github.com/apache/kafka/pull/3507 KAFKA-5550 Changed call to use the overload of ConnectSchema.validate method with the field name passed in. Ensure that field in put call is not null. You can merge this pull request into a

[GitHub] kafka pull request #3498: Kafka-4763 (Used for triggering test only)

2017-07-07 Thread lindong28
Github user lindong28 closed the pull request at: https://github.com/apache/kafka/pull/3498 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #3506: KAFKA-5565. Add a broker metric specifying the num...

2017-07-07 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/3506 KAFKA-5565. Add a broker metric specifying the number of consumer gro… …up rebalances in progress You can merge this pull request into a Git repository by running: $ git pull

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-07-07 Thread Damian Guy
Hi Jeyhun, About overrides, what other alternatives do we have? For > backwards-compatibility we have to add extra methods to the existing ones. > > It wasn't clear to me in the KIP if these are new methods or replacing existing ones. Also, we are currently discussing options for replacing the

Jenkins build is back to normal : kafka-trunk-jdk7 #2499

2017-07-07 Thread Apache Jenkins Server
See

Re: Possible deadlock during shutdown in setState in kafka streams 10.2

2017-07-07 Thread Damian Guy
Hi Greg, Would you mind creating a JIRA for this with the thread dump ( i don't see it attached to your message). Thanks, Damian On Fri, 7 Jul 2017 at 10:36 Greg Fodor wrote: > I'm running a 10.2 job across 5 nodes with 32 stream threads on each node > and find that when

Possible deadlock during shutdown in setState in kafka streams 10.2

2017-07-07 Thread Greg Fodor
I'm running a 10.2 job across 5 nodes with 32 stream threads on each node and find that when gracefully shutdown all of them at once via an ansible scripts, some of the nodes end up freezing -- at a glance the attached thread dump implies a deadlock between stream threads trying to update their

[GitHub] kafka pull request #3498: Kafka-4763 (Used for triggering test only)

2017-07-07 Thread lindong28
Github user lindong28 closed the pull request at: https://github.com/apache/kafka/pull/3498 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #3498: Kafka-4763 (Used for triggering test only)

2017-07-07 Thread lindong28
GitHub user lindong28 reopened a pull request: https://github.com/apache/kafka/pull/3498 Kafka-4763 (Used for triggering test only) This patch is used only for triggering test. No need for review. You can merge this pull request into a Git repository by running: $ git pull

Re: [DISCUSS] Streams DSL/StateStore Refactoring

2017-07-07 Thread Guozhang Wang
Hi Damian / Kyle, I think I agree with you guys about the pros / cons of using the builder pattern v.s. using some "secondary classes". And I'm thinking if we can take a "mid" manner between these two. I spent some time with a slight different approach from Damian's current proposal:

[GitHub] kafka pull request #3497: HOTFIX: disable flaky system tests

2017-07-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3497 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #3500: KAFKA-5566: Atomic compare and set

2017-07-07 Thread enothereska
GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/3500 KAFKA-5566: Atomic compare and set You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka hotfix-queryable-state Alternatively

[GitHub] kafka-site issue #65: MINOR: add Interactive Queries docs

2017-07-07 Thread dguy
Github user dguy commented on the issue: https://github.com/apache/kafka-site/pull/65 Can't i just merge this PR? The process there seems more about creating a new version for a release, i.e, i don't want to update everything --- If your project is set up for it, you can reply to

[GitHub] kafka pull request #3501: MINOR: Improve versioning in docs when a full vers...

2017-07-07 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3501 MINOR: Improve versioning in docs when a full version is required Also fix quickstart. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka

Build failed in Jenkins: kafka-trunk-jdk7 #2501

2017-07-07 Thread Apache Jenkins Server
See Changes: [damian.guy] KAFKA-5566; fix unit test shouldAllowToQueryAfterThreadDied -- [...truncated 2.45 MB...]

[jira] [Created] (KAFKA-5570) Join request's timeout should be slightly higher than the rebalance timeout

2017-07-07 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-5570: -- Summary: Join request's timeout should be slightly higher than the rebalance timeout Key: KAFKA-5570 URL: https://issues.apache.org/jira/browse/KAFKA-5570 Project: Kafka

[GitHub] kafka pull request #3503: KAFKA-5570: Join request's timeout should be sligh...

2017-07-07 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3503 KAFKA-5570: Join request's timeout should be slightly higher than the rebalance timeout - Introduce per request timeouts in NetworkClient - Use rebalanceTimeout + 5s for join request timeout

Build failed in Jenkins: kafka-0.11.0-jdk7 #213

2017-07-07 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Improve versioning in docs when a full version is required -- [...truncated 2.42 MB...]

Jenkins build is back to normal : kafka-trunk-jdk7 #2502

2017-07-07 Thread Apache Jenkins Server
See

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-07-07 Thread Jeyhun Karimov
I am following the related thread in the mailing list and looking forward for one-shot solution for overloads issue. Cheers, Jeyhun On Fri, Jul 7, 2017 at 10:32 AM Damian Guy wrote: > Hi Jeyhun, > > About overrides, what other alternatives do we have? For > >

[jira] [Resolved] (KAFKA-5566) Instable test QueryableStateIntegrationTest.shouldAllowToQueryAfterThreadDied

2017-07-07 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5566. --- Resolution: Fixed Fix Version/s: 0.11.0.1 0.11.1.0 Issue resolved by pull

[GitHub] kafka pull request #3500: KAFKA-5566: fix unit test shouldAllowToQueryAfterT...

2017-07-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3500 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (KAFKA-5569) Document any changes from this task

2017-07-07 Thread Eno Thereska (JIRA)
Eno Thereska created KAFKA-5569: --- Summary: Document any changes from this task Key: KAFKA-5569 URL: https://issues.apache.org/jira/browse/KAFKA-5569 Project: Kafka Issue Type: Sub-task

[GitHub] kafka pull request #2828: KAFKA-5011: down convert the message on replicatio...

2017-07-07 Thread becketqin
Github user becketqin closed the pull request at: https://github.com/apache/kafka/pull/2828 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #3502: HOTFIX: fix paths in streams index

2017-07-07 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/3502 HOTFIX: fix paths in streams index You can merge this pull request into a Git repository by running: $ git pull https://github.com/dguy/kafka doc-fixes Alternatively you can review and apply

[GitHub] kafka pull request #3501: MINOR: Improve versioning in docs when a full vers...

2017-07-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3501 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #3502: HOTFIX: fix paths in streams index

2017-07-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3502 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [VOTE]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-07-07 Thread Eno Thereska
+1 (non-binding) Thanks. Eno > On 6 Jul 2017, at 21:49, Gwen Shapira wrote: > > +1 > > On Wed, Jul 5, 2017 at 9:25 AM Matthias J. Sax > wrote: > >> +1 >> >> On 6/27/17 1:41 PM, Jeyhun Karimov wrote: >>> Dear all, >>> >>> I would like to start the

Re: [ANNOUNCE] New Kafka PMC member Ismael Juma

2017-07-07 Thread Kamal C
Congratulations Ismael ! On 06-Jul-2017 14:11, "Ismael Juma" wrote: > Thanks everyone! > > Ismael > > On Wed, Jul 5, 2017 at 9:55 PM, Jun Rao wrote: > > > Hi, Everyone, > > > > Ismael Juma has been active in the Kafka community since he became > > a Kafka

Re: [DISCUSS] Streams DSL/StateStore Refactoring

2017-07-07 Thread Guozhang Wang
I messed the indentation on github code repos; this would be easier to read: https://codeshare.io/GLWW8K Guozhang On Fri, Jul 7, 2017 at 1:30 AM, Guozhang Wang wrote: > Hi Damian / Kyle, > > I think I agree with you guys about the pros / cons of using the builder >

[GitHub] kafka-site issue #65: MINOR: add Interactive Queries docs

2017-07-07 Thread guozhangwang
Github user guozhangwang commented on the issue: https://github.com/apache/kafka-site/pull/65 Generally speaking separate commits on `kafka` and `kafka-site` may have the risk of diverge on these two repos if people forget to make the corresponding changes to `kafka-site` while

Re: [ANNOUNCE] New Kafka PMC member Ismael Juma

2017-07-07 Thread Eno Thereska
Congrats! Eno > On 7 Jul 2017, at 16:13, Kamal C wrote: > > Congratulations Ismael ! > > On 06-Jul-2017 14:11, "Ismael Juma" wrote: > >> Thanks everyone! >> >> Ismael >> >> On Wed, Jul 5, 2017 at 9:55 PM, Jun Rao wrote: