[GitHub] storm pull request #1679: STORM-2087: storm-kafka-client - tuples not always...

2016-11-07 Thread hmcl
Github user hmcl commented on a diff in the pull request: https://github.com/apache/storm/pull/1679#discussion_r86894060 --- Diff: external/storm-kafka-client/src/test/java/org/apache/storm/kafka/spout/builders/SingleTopicKafkaSpoutConfiguration.java --- @@ -0,0 +1,85 @@ +/*

[GitHub] storm pull request #1679: STORM-2087: storm-kafka-client - tuples not always...

2016-11-07 Thread hmcl
Github user hmcl commented on a diff in the pull request: https://github.com/apache/storm/pull/1679#discussion_r86846400 --- Diff: external/storm-kafka-client/src/test/java/org/apache/storm/kafka/spout/builders/SingleTopicKafkaSpoutConfiguration.java --- @@ -0,0 +1,85 @@ +/*

[GitHub] storm pull request #1679: STORM-2087: storm-kafka-client - tuples not always...

2016-11-07 Thread hmcl
Github user hmcl commented on a diff in the pull request: https://github.com/apache/storm/pull/1679#discussion_r86893341 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpout.java --- @@ -266,19 +266,22 @@ private void

[GitHub] storm pull request #1679: STORM-2087: storm-kafka-client - tuples not always...

2016-11-07 Thread hmcl
Github user hmcl commented on a diff in the pull request: https://github.com/apache/storm/pull/1679#discussion_r86895288 --- Diff: external/storm-kafka-client/src/test/java/org/apache/storm/kafka/spout/SingleTopicKafkaSpoutTest.java --- @@ -0,0 +1,250 @@ +/* + * Licensed

[GitHub] storm pull request #1679: STORM-2087: storm-kafka-client - tuples not always...

2016-11-07 Thread hmcl
Github user hmcl commented on a diff in the pull request: https://github.com/apache/storm/pull/1679#discussion_r86846452 --- Diff: external/storm-kafka-client/src/test/java/org/apache/storm/kafka/spout/builders/SingleTopicKafkaSpoutConfiguration.java --- @@ -0,0 +1,85 @@ +/*

[GitHub] storm pull request #1679: STORM-2087: storm-kafka-client - tuples not always...

2016-11-07 Thread hmcl
Github user hmcl commented on a diff in the pull request: https://github.com/apache/storm/pull/1679#discussion_r86892802 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpout.java --- @@ -479,16 +487,17 @@ public OffsetAndMetadata

[GitHub] storm pull request #1679: STORM-2087: storm-kafka-client - tuples not always...

2016-11-07 Thread hmcl
Github user hmcl commented on a diff in the pull request: https://github.com/apache/storm/pull/1679#discussion_r79797993 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpout.java --- @@ -266,26 +266,32 @@ private void

[GitHub] storm pull request #1679: STORM-2087: storm-kafka-client - tuples not always...

2016-11-07 Thread hmcl
Github user hmcl commented on a diff in the pull request: https://github.com/apache/storm/pull/1679#discussion_r86892941 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpout.java --- @@ -266,26 +266,32 @@ private void

[GitHub] storm pull request #1679: STORM-2087: storm-kafka-client - tuples not always...

2016-11-07 Thread hmcl
Github user hmcl commented on a diff in the pull request: https://github.com/apache/storm/pull/1679#discussion_r79800258 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaSpout.java --- @@ -479,16 +482,17 @@ public OffsetAndMetadata

[GitHub] storm pull request #1765: STORM-2190: reduce contention between submission a...

2016-11-07 Thread revans2
GitHub user revans2 opened a pull request: https://github.com/apache/storm/pull/1765 STORM-2190: reduce contention between submission and scheduling You can merge this pull request into a Git repository by running: $ git pull https://github.com/revans2/incubator-storm

[GitHub] storm pull request #1764: STORM-2190: reduce contention between submission a...

2016-11-07 Thread revans2
GitHub user revans2 opened a pull request: https://github.com/apache/storm/pull/1764 STORM-2190: reduce contention between submission and scheduling You can merge this pull request into a Git repository by running: $ git pull https://github.com/revans2/incubator-storm

[GitHub] storm issue #1757: Apache master storm 2182 top storm 1694

2016-11-07 Thread hmcl
Github user hmcl commented on the issue: https://github.com/apache/storm/pull/1757 @harshach @HeartSaVioR I am fine either way. @HeartSaVioR, of all the alternatives that we discussed, can you please let me know which one you prefer ? It should be an easy fix, and I can either

[GitHub] storm issue #1757: Apache master storm 2182 top storm 1694

2016-11-07 Thread harshach
Github user harshach commented on the issue: https://github.com/apache/storm/pull/1757 @hmcl already +1ed on other PR. @HeartSaVioR @hmcl we can handle cleaning up examples in another PR. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] storm issue #1679: STORM-2087: storm-kafka-client - tuples not always being ...

2016-11-07 Thread hmcl
Github user hmcl commented on the issue: https://github.com/apache/storm/pull/1679 @revans2 reviewing this at this moment. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] storm issue #1759: STORM-2185: Storm Supervisor doesn't delete directories p...

2016-11-07 Thread knusbaum
Github user knusbaum commented on the issue: https://github.com/apache/storm/pull/1759 @HeartSaVioR Are you using harshach's script to merge these? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

Re: [DISCUSS] breaking changes in 2.x

2016-11-07 Thread Kyle Nusbaum
I worry that making it a priority to have rolling upgrades between major versions significantly restricts the kinds of changes that we can make, including some kinds of changes that a major version increment is supposed to mark. I'm not really in support of trying to do that. If we can't make

Re: [DISCUSS] breaking changes in 2.x

2016-11-07 Thread Bobby Evans
Let's distinguish between wire compatibility changes and API compatibility changes, along with impact to workers vs impact to clients. For 3) splitting the classpath up for each daemon wire compatibility is not impacted, but we are potentially removing a bunch of APIs from the worker and client

Re: [DISCUSS] breaking changes in 2.x

2016-11-07 Thread P. Taylor Goetz
Can you provide a hypothetical example for how #3 might break something for users? It seems like most of the cases of backward incompatibility are not typical/average use cases, and that rolling upgrades would only be affected in certain edge cases. If that’s the case then I’m fine with the

Re: Fw: Re: [DISCUSS] breaking changes in 2.x

2016-11-07 Thread Bobby Evans
For all of these we should be able to support a rolling upgrade from 1.x with some caveats. 1) There are a few possibilities on how to make this happen, but none of them are ideal.  If you feel strongly about a rolling upgrade I might skip this. 2) would work for all workers that do not access

Re: Fw: Re: [DISCUSS] breaking changes in 2.x

2016-11-07 Thread Harsha Chintalapani
My only concern here is the rolling upgrade of storm cluster. We supported the rolling upgrade going to 0.10 and broke it because of storm 1.x release. Users are not inclined to upgrade to a new release if it's not rolling upgradable. In this case, it looks like we are going to break this. Correct

Fw: Re: [DISCUSS] breaking changes in 2.x

2016-11-07 Thread Bobby Evans
Made a mistake and put something on private that never should have been there.   Here is the discussion in full so far. In response to Jungtake removing the nocamel option will change set_bar/get_bar in the generated thrift code to setBar/getBar.  So any thrift object that clients interact with

[GitHub] storm pull request #1761: STORM-2184: Don't wakeup KafkaConsumer on shutdown...

2016-11-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/1761 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] storm issue #1759: STORM-2185: Storm Supervisor doesn't delete directories p...

2016-11-07 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/1759 @knusbaum I merged 1.x and 1.0.x branch. Could you close this PR? Auto-closing PR doesn't work with PR which is not against master branch. --- If your project is set up for it, you can reply to

[GitHub] storm pull request #1758: STORM-2185: Storm Supervisor doesn't delete direct...

2016-11-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/1758 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] storm issue #1751: [STORM-2172][SQL] Support Avro as input / output format

2016-11-07 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1751 @sachingsachin Addressed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] storm pull request #1762: STORM-2188:Interrupt all executor threads before j...

2016-11-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/1762 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] storm issue #1761: STORM-2184: Don't wakeup KafkaConsumer on shutdown, spout...

2016-11-07 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/1761 +1 KafkaConsumer seems to be initialized for each task (so used from only one thread), and so as ConsumerNetworkClient in KafkaConsumer. --- If your project is set up for it, you can reply to

[GitHub] storm issue #1759: STORM-2185: Storm Supervisor doesn't delete directories p...

2016-11-07 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/1759 +1 Commit message should be modified but can be handled while merging. (Same as PR for master) --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] storm issue #1758: STORM-2185: Storm Supervisor doesn't delete directories p...

2016-11-07 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/1758 +1. Commit message should be modified but can be handled while merging. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] storm issue #1762: STORM-2188:Interrupt all executor threads before joining ...

2016-11-07 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/1762 I think we need to do this. +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm issue #1763: [STORM-2189] RAS_Node::freeCPU outputs incorrect info

2016-11-07 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/1763 Great finding. +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] storm pull request #1751: [STORM-2172][SQL] Support Avro as input / output f...

2016-11-07 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1751#discussion_r86734548 --- Diff: external/sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/serde/avro/CachedSchemas.java --- @@ -0,0 +1,37 @@ +/* + * Licensed to

[GitHub] storm pull request #1751: [STORM-2172][SQL] Support Avro as input / output f...

2016-11-07 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1751#discussion_r86734617 --- Diff: external/sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/utils/SerdeUtils.java --- @@ -0,0 +1,115 @@ +/* + * Licensed to the