[jira] [Comment Edited] (STORM-592) Update stats.clj rolling-window-set function, exchange the real argument num-buckets and s of rolling-window function

2014-12-15 Thread zhangjinlong (JIRA)
[ https://issues.apache.org/jira/browse/STORM-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14246416#comment-14246416 ] zhangjinlong edited comment on STORM-592 at 12/15/14 8:33 AM: --

[jira] [Comment Edited] (STORM-592) Update stats.clj rolling-window-set function, exchange the real argument num-buckets and s of rolling-window function

2014-12-15 Thread zhangjinlong (JIRA)
[ https://issues.apache.org/jira/browse/STORM-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14246413#comment-14246413 ] zhangjinlong edited comment on STORM-592 at 12/15/14 8:33 AM: --

[GitHub] storm pull request: Update stats.clj rolling-window-set function...

2014-12-15 Thread BuDongDong
GitHub user BuDongDong opened a pull request: https://github.com/apache/storm/pull/348 Update stats.clj rolling-window-set function, exchange the real argume... ...nt num-buckets and s of rolling-window function (defn rolling-window-set [updater merger extractor num-buckets

[GitHub] storm pull request: Update stats.clj rolling-window-set function...

2014-12-15 Thread BuDongDong
Github user BuDongDong commented on the pull request: https://github.com/apache/storm/pull/348#issuecomment-66964691 (defrecord RollingWindow [updater merger extractor bucket-size-secs num-buckets buckets]) I think that the bucket-size-secs of RollingWindow is 20, and the

[jira] [Comment Edited] (STORM-592) Update stats.clj rolling-window-set function, exchange the real argument num-buckets and s of rolling-window function

2014-12-15 Thread zhangjinlong (JIRA)
[ https://issues.apache.org/jira/browse/STORM-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14246413#comment-14246413 ] zhangjinlong edited comment on STORM-592 at 12/15/14 9:05 AM: --

[jira] [Updated] (STORM-329) Add Option to Config Message handling strategy when connection timeout

2014-12-15 Thread xiajun (JIRA)
[ https://issues.apache.org/jira/browse/STORM-329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiajun updated STORM-329: - Fix Version/s: (was: 0.9.3-rc2) Add Option to Config Message handling strategy when connection timeout

[GitHub] storm pull request: STORM-593: remove endpoint-socket-lock for wor...

2014-12-15 Thread tedxia
GitHub user tedxia opened a pull request: https://github.com/apache/storm/pull/349 STORM-593: remove endpoint-socket-lock for worker-data PR for [STORM-593](https://issues.apache.org/jira/browse/STORM-593) cached-node+port-socket in worker-data is atom, there on need for

[jira] [Commented] (STORM-593) No need of rwlock for clojure atom

2014-12-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14246512#comment-14246512 ] ASF GitHub Bot commented on STORM-593: -- GitHub user tedxia opened a pull request:

[GitHub] storm pull request: STORM-512 KafkaBolt doesn't handle ticks prope...

2014-12-15 Thread nielsbasjes
Github user nielsbasjes commented on the pull request: https://github.com/apache/storm/pull/275#issuecomment-66971975 @nathanmarz Thanks I understand your view now. I refactored my patch to meet this requirement and I've tried to make it as small a difference as possible.

[jira] [Commented] (STORM-512) KafkaBolt doesn't handle ticks properly

2014-12-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14246513#comment-14246513 ] ASF GitHub Bot commented on STORM-512: -- Github user nielsbasjes commented on the pull

[GitHub] storm pull request: STORM-593: remove endpoint-socket-lock for wor...

2014-12-15 Thread nathanmarz
Github user nathanmarz commented on the pull request: https://github.com/apache/storm/pull/349#issuecomment-66975846 -1. That r/w lock ensures that send is never called on a closed connection. --- If your project is set up for it, you can reply to this email and have your reply

[jira] [Commented] (STORM-593) No need of rwlock for clojure atom

2014-12-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14246533#comment-14246533 ] ASF GitHub Bot commented on STORM-593: -- Github user nathanmarz commented on the pull

[GitHub] storm pull request: STORM-593: remove endpoint-socket-lock for wor...

2014-12-15 Thread tedxia
Github user tedxia commented on the pull request: https://github.com/apache/storm/pull/349#issuecomment-66996013 The write lock only protect cached-task-node+port, and not protect cached-node+port-socket. @nathanmarz If we want to ensure send never called on a closed connection,

[GitHub] storm pull request: Update stats.clj rolling-window-set function...

2014-12-15 Thread BuDongDong
Github user BuDongDong commented on the pull request: https://github.com/apache/storm/pull/348#issuecomment-67004693 @nathanmarz Could you check this bug, thank you very much --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] storm pull request: Added support for serialization to SequenceFil...

2014-12-15 Thread harshach
Github user harshach commented on the pull request: https://github.com/apache/storm/pull/347#issuecomment-67024196 @mikert Could you please open a JIRA for this. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[jira] [Created] (STORM-594) Auto-Scaling Resources in a Topology

2014-12-15 Thread HARSHA BALASUBRAMANIAN (JIRA)
HARSHA BALASUBRAMANIAN created STORM-594: Summary: Auto-Scaling Resources in a Topology Key: STORM-594 URL: https://issues.apache.org/jira/browse/STORM-594 Project: Apache Storm

[jira] [Updated] (STORM-594) Auto-Scaling Resources in a Topology

2014-12-15 Thread HARSHA BALASUBRAMANIAN (JIRA)
[ https://issues.apache.org/jira/browse/STORM-594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HARSHA BALASUBRAMANIAN updated STORM-594: - Attachment: Project Plan and Scope.pdf Algorithm for

[GitHub] storm pull request: Added support for serialization to SequenceFil...

2014-12-15 Thread Parth-Brahmbhatt
Github user Parth-Brahmbhatt commented on a diff in the pull request: https://github.com/apache/storm/pull/347#discussion_r21839632 --- Diff: external/storm-hdfs/src/main/java/org/apache/storm/hdfs/bolt/SequenceFileBolt.java --- @@ -108,7 +109,11 @@ public void execute(Tuple

Re: Fwd: Auto-Scaling

2014-12-15 Thread Harsha Balasubramanian
Hi Bobby, Hope this email finds you well. I.m about to start designing the auto-scaling system. Created a JIRA for it, https://issues.apache.org/jira/browse/STORM-594 Please take a look and let me know if there are any concerns. I have 2 questions for you; 1. In one of your earlier emails,

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-12-15 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-67047625 @nathanmarz , I'd like to explain why I need to change worker.clj. This was also motivated by a legacy TODO in in zmq.clj.

[jira] [Commented] (STORM-329) Add Option to Config Message handling strategy when connection timeout

2014-12-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247065#comment-14247065 ] ASF GitHub Bot commented on STORM-329: -- Github user clockfly commented on the pull

[jira] [Updated] (STORM-594) Auto-Scaling Resources in a Topology

2014-12-15 Thread HARSHA BALASUBRAMANIAN (JIRA)
[ https://issues.apache.org/jira/browse/STORM-594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HARSHA BALASUBRAMANIAN updated STORM-594: - Description: A useful feature missing in Storm topologies is the ability to

[GitHub] storm pull request: Storm-539. Storm hive bolt and trident state.

2014-12-15 Thread harshach
GitHub user harshach opened a pull request: https://github.com/apache/storm/pull/350 Storm-539. Storm hive bolt and trident state. You can merge this pull request into a Git repository by running: $ git pull https://github.com/harshach/incubator-storm STORM-539-V2

[GitHub] storm pull request: Added support for serialization to SequenceFil...

2014-12-15 Thread mikert
Github user mikert commented on the pull request: https://github.com/apache/storm/pull/347#issuecomment-67100672 @harshach Sure thing. Can you provide feedback about Parth-Brahmbhatt's comment? I did it that way to ensure that code written for 0.9.3 wouldn't be immediately broken in

[jira] [Created] (STORM-595) storm-hdfs can only work with sequence files that use Writables

2014-12-15 Thread Mike Thomsen (JIRA)
Mike Thomsen created STORM-595: -- Summary: storm-hdfs can only work with sequence files that use Writables Key: STORM-595 URL: https://issues.apache.org/jira/browse/STORM-595 Project: Apache Storm

[GitHub] storm pull request: STORM-586: TridentKafkaEmitter should catch up...

2014-12-15 Thread harshach
Github user harshach commented on a diff in the pull request: https://github.com/apache/storm/pull/339#discussion_r21874150 --- Diff: external/storm-kafka/src/jvm/storm/kafka/KafkaUtils.java --- @@ -155,7 +155,7 @@ public void refreshPartitions(SetPartition partitions) {

[jira] [Commented] (STORM-586) Trident kafka spout fails instead of updating offset when kafka offset is out of range.

2014-12-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247618#comment-14247618 ] ASF GitHub Bot commented on STORM-586: -- Github user harshach commented on a diff in

[GitHub] storm pull request: update PartitionManager.java

2014-12-15 Thread harshach
Github user harshach commented on the pull request: https://github.com/apache/storm/pull/331#issuecomment-67103228 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] storm pull request: [STORM-557] Created docs directory and added i...

2014-12-15 Thread harshach
Github user harshach commented on the pull request: https://github.com/apache/storm/pull/314#issuecomment-67103354 @revans2 can you please upmerge your patch. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[jira] [Commented] (STORM-557) High Quality Images for presentations, etc.

2014-12-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247631#comment-14247631 ] ASF GitHub Bot commented on STORM-557: -- Github user harshach commented on the pull

[GitHub] storm pull request: typo

2014-12-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/333 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] storm pull request: STORM-548:Receive Thread Shutdown hook should ...

2014-12-15 Thread harshach
Github user harshach commented on the pull request: https://github.com/apache/storm/pull/307#issuecomment-67105369 @caofangkun I am trying to merge this into master but looks like your PR contains additional file loader.clj~ . can you please remove and update the PR. Thanks. ---

[GitHub] storm pull request: STORM-548:Receive Thread Shutdown hook should ...

2014-12-15 Thread harshach
Github user harshach commented on the pull request: https://github.com/apache/storm/pull/307#issuecomment-67111034 @caofangkun Thanks for the quick fix. I merged the PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[jira] [Commented] (STORM-548) Receive Thread Shutdown hook should connect to local hostname but not localhost

2014-12-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14247725#comment-14247725 ] ASF GitHub Bot commented on STORM-548: -- Github user asfgit closed the pull request at:

[jira] [Assigned] (STORM-548) Receive Thread Shutdown hook should connect to local hostname but not localhost

2014-12-15 Thread caofangkun (JIRA)
[ https://issues.apache.org/jira/browse/STORM-548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caofangkun reassigned STORM-548: Assignee: caofangkun Receive Thread Shutdown hook should connect to local hostname but not

[GitHub] storm pull request: Update stats.clj rolling-window-set function...

2014-12-15 Thread BuDongDong
Github user BuDongDong closed the pull request at: https://github.com/apache/storm/pull/348 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is