[GitHub] storm pull request #1642: STORM-2018: Supervisor V2.

2016-09-01 Thread revans2
Github user revans2 commented on a diff in the pull request: https://github.com/apache/storm/pull/1642#discussion_r77253867 --- Diff: storm-core/src/jvm/org/apache/storm/daemon/supervisor/BasicContainer.java --- @@ -0,0 +1,629 @@ +/** + * Licensed to the Apache Software

[GitHub] storm pull request #1642: STORM-2018: Supervisor V2.

2016-09-01 Thread revans2
Github user revans2 commented on a diff in the pull request: https://github.com/apache/storm/pull/1642#discussion_r77260851 --- Diff: storm-core/src/jvm/org/apache/storm/daemon/supervisor/BasicContainer.java --- @@ -0,0 +1,644 @@ +/** + * Licensed to the Apache Software

[GitHub] storm issue #1642: STORM-2018: Supervisor V2.

2016-09-01 Thread revans2
Github user revans2 commented on the issue: https://github.com/apache/storm/pull/1642 I think I have addressed most of the issues so far. I have been running some manual tests and have run a cluster with run as user and cgroup enforcement enabled. I plan on doing some more tests,

[jira] [Created] (STORM-2076) Supervisor sync-processes and sync-supervisor race when downloading new topology code.

2016-09-01 Thread JIRA
Stig Rohde Døssing created STORM-2076: - Summary: Supervisor sync-processes and sync-supervisor race when downloading new topology code. Key: STORM-2076 URL: https://issues.apache.org/jira/browse/STORM-2076

[GitHub] storm issue #1667: STORM-2076: Add new atom to prevent sync-processes from d...

2016-09-01 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/1667 Hi @srdo, Great catch and thanks for the contribution. Btw, as we're continuously suffering race conditions in supervisor, @revans2 proposed new supervisor design and submitted pull

[jira] [Resolved] (STORM-2070) Sigar native binary download link went 404

2016-09-01 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/STORM-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved STORM-2070. - Resolution: Fixed Fix Version/s: 1.0.3 1.1.0 2.0.0

[jira] [Closed] (STORM-2046) Errors when using TOPOLOGY_TESTING_ALWAYS_TRY_SERIALIZE in local mode.

2016-09-01 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/STORM-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim closed STORM-2046. --- Resolution: Duplicate Duplicated via STORM-2040 > Errors when using

[GitHub] storm pull request #1660: STORM-2070 Fix sigar native binary download link

2016-09-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/1660 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] storm pull request #1667: STORM-2076: Add new atom to prevent sync-processes...

2016-09-01 Thread srdo
GitHub user srdo opened a pull request: https://github.com/apache/storm/pull/1667 STORM-2076: Add new atom to prevent sync-processes from deleting new … …topology code @HeartSaVioR Could you take a look at this? I'll make a similar change on master if you think this is

[GitHub] storm pull request #1668: STORM-2040 Fix bug on assert-can-serialize

2016-09-01 Thread HeartSaVioR
GitHub user HeartSaVioR opened a pull request: https://github.com/apache/storm/pull/1668 STORM-2040 Fix bug on assert-can-serialize * type of element of tuple-batch is changed to AddressedTuple but not reflected to assert-can-serialize * it only raises issue when

[GitHub] storm pull request #1670: [STORM-2079] - Unneccessary readStormConfig operat...

2016-09-01 Thread jerrypeng
GitHub user jerrypeng opened a pull request: https://github.com/apache/storm/pull/1670 [STORM-2079] - Unneccessary readStormConfig operation You can merge this pull request into a Git repository by running: $ git pull https://github.com/jerrypeng/storm STORM-2079

[GitHub] storm issue #1670: [STORM-2079] - Unneccessary readStormConfig operation

2016-09-01 Thread knusbaum
Github user knusbaum commented on the issue: https://github.com/apache/storm/pull/1670 +1 pending SD --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] storm pull request #1642: STORM-2018: Supervisor V2.

2016-09-01 Thread revans2
Github user revans2 commented on a diff in the pull request: https://github.com/apache/storm/pull/1642#discussion_r77245653 --- Diff: storm-core/src/jvm/org/apache/storm/daemon/supervisor/AdvancedFSOps.java --- @@ -0,0 +1,314 @@ +/** + * Licensed to the Apache Software

[GitHub] storm pull request #1665: STORM-2074: fix storm-kafka-monitor NPE bug

2016-09-01 Thread priyank5485
Github user priyank5485 commented on a diff in the pull request: https://github.com/apache/storm/pull/1665#discussion_r77237088 --- Diff: external/storm-kafka-monitor/src/main/java/org/apache/storm/kafka/monitor/KafkaOffsetLagUtil.java --- @@ -89,6 +89,10 @@ public static void

[GitHub] storm pull request #1642: STORM-2018: Supervisor V2.

2016-09-01 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1642#discussion_r77141710 --- Diff: storm-core/src/jvm/org/apache/storm/container/ResourceIsolationInterface.java --- @@ -56,4 +64,13 @@ */ List

[GitHub] storm pull request #1642: STORM-2018: Supervisor V2.

2016-09-01 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1642#discussion_r77154990 --- Diff: storm-core/src/jvm/org/apache/storm/daemon/supervisor/Container.java --- @@ -0,0 +1,493 @@ +/** + * Licensed to the Apache Software Foundation

[GitHub] storm pull request #1642: STORM-2018: Supervisor V2.

2016-09-01 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1642#discussion_r77154288 --- Diff: storm-core/src/jvm/org/apache/storm/daemon/supervisor/Container.java --- @@ -0,0 +1,493 @@ +/** + * Licensed to the Apache Software Foundation

[GitHub] storm pull request #1642: STORM-2018: Supervisor V2.

2016-09-01 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1642#discussion_r77143604 --- Diff: storm-core/src/jvm/org/apache/storm/daemon/supervisor/AdvancedFSOps.java --- @@ -0,0 +1,314 @@ +/** + * Licensed to the Apache Software

[GitHub] storm pull request #1642: STORM-2018: Supervisor V2.

2016-09-01 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1642#discussion_r77144436 --- Diff: storm-core/src/jvm/org/apache/storm/daemon/supervisor/AdvancedFSOps.java --- @@ -0,0 +1,314 @@ +/** + * Licensed to the Apache Software

[GitHub] storm pull request #1642: STORM-2018: Supervisor V2.

2016-09-01 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/1642#discussion_r77144475 --- Diff: storm-core/src/jvm/org/apache/storm/daemon/supervisor/LocalContainer.java --- @@ -0,0 +1,85 @@ +/** + * Licensed to the Apache Software

[GitHub] storm pull request #1642: STORM-2018: Supervisor V2.

2016-09-01 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1642#discussion_r77150344 --- Diff: storm-core/src/jvm/org/apache/storm/daemon/supervisor/BasicContainer.java --- @@ -0,0 +1,644 @@ +/** + * Licensed to the Apache Software

[GitHub] storm issue #1667: STORM-2076: Add new atom to prevent sync-processes from d...

2016-09-01 Thread srdo
Github user srdo commented on the issue: https://github.com/apache/storm/pull/1667 @HeartSaVioR Sure, the new design looks much nicer. I agree that backporting the new design if it works well makes more sense than to keep patching these race conditions. --- If your project is set

[jira] [Created] (STORM-2077) KafkaSpout doesn't retry failed tuples

2016-09-01 Thread Tobias Maier (JIRA)
Tobias Maier created STORM-2077: --- Summary: KafkaSpout doesn't retry failed tuples Key: STORM-2077 URL: https://issues.apache.org/jira/browse/STORM-2077 Project: Apache Storm Issue Type: Bug

[GitHub] storm pull request #1642: STORM-2018: Supervisor V2.

2016-09-01 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/1642#discussion_r77151542 --- Diff: storm-core/src/jvm/org/apache/storm/daemon/supervisor/BasicContainer.java --- @@ -0,0 +1,644 @@ +/** + * Licensed to the Apache Software

[GitHub] storm pull request #1666: STORM-1459: allow not specifying producer properti...

2016-09-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/1666 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (STORM-1459) Allow not specifying producer properties in read-only Kafka table in StormSQL

2016-09-01 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved STORM-1459. - Resolution: Fixed Fix Version/s: 1.1.0 2.0.0 Great work [~mauzhang], I

[GitHub] storm issue #1662: [STORM-1344] Remove sql command from storm-jdbc build.

2016-09-01 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/1662 still +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] storm pull request #1662: [STORM-1344] Remove sql command from storm-jdbc bu...

2016-09-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/1662 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] storm issue #1671: STORM-2080: storm-submit-tools license check failure

2016-09-01 Thread manuzhang
Github user manuzhang commented on the issue: https://github.com/apache/storm/pull/1671 Oh, I missed that. I will comment there and, FYI, some license headers are not in the right form --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] storm pull request #1671: STORM-2080: storm-submit-tools license check failu...

2016-09-01 Thread manuzhang
Github user manuzhang closed the pull request at: https://github.com/apache/storm/pull/1671 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] storm pull request #1671: STORM-2080: storm-submit-tools license check failu...

2016-09-01 Thread manuzhang
GitHub user manuzhang opened a pull request: https://github.com/apache/storm/pull/1671 STORM-2080: storm-submit-tools license check failure You can merge this pull request into a Git repository by running: $ git pull https://github.com/manuzhang/storm STORM-2080

[jira] [Closed] (STORM-2080) storm-submit-tools license check failure

2016-09-01 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/STORM-2080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim closed STORM-2080. --- Resolution: Duplicate > storm-submit-tools license check failure >

[jira] [Resolved] (STORM-1344) storm-jdbc build error "object name already exists: USER_DETAILS in statement"

2016-09-01 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved STORM-1344. - Resolution: Fixed Assignee: Paul Poulosky Fix Version/s: 1.0.3

[GitHub] storm pull request #1648: STORM-2054 DependencyResolver should be aware of r...

2016-09-01 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/1648#discussion_r77280313 --- Diff: external/storm-submit-tools/src/main/java/org/apache/storm/submit/dependency/Booter.java --- @@ -37,16 +37,19 @@ public static

[GitHub] storm issue #1648: STORM-2054 DependencyResolver should be aware of relative...

2016-09-01 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/1648 Also fixed license form as @manuzhang found. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[jira] [Created] (STORM-2080) storm-submit-tools license check failure

2016-09-01 Thread Manu Zhang (JIRA)
Manu Zhang created STORM-2080: - Summary: storm-submit-tools license check failure Key: STORM-2080 URL: https://issues.apache.org/jira/browse/STORM-2080 Project: Apache Storm Issue Type: Bug

[GitHub] storm issue #1670: [STORM-2079] - Unneccessary readStormConfig operation

2016-09-01 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/1670 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] storm issue #1671: STORM-2080: storm-submit-tools license check failure

2016-09-01 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/1671 Duplicated #1648 (STORM-2054) Actually there's also a bug which doesn't handle relative path vs absolute path. --- If your project is set up for it, you can reply to this email and have

[GitHub] storm pull request #1648: STORM-2054 DependencyResolver should be aware of r...

2016-09-01 Thread manuzhang
Github user manuzhang commented on a diff in the pull request: https://github.com/apache/storm/pull/1648#discussion_r77279412 --- Diff: external/storm-submit-tools/src/main/java/org/apache/storm/submit/dependency/Booter.java --- @@ -37,16 +37,19 @@ public static

[GitHub] storm pull request #1648: STORM-2054 DependencyResolver should be aware of r...

2016-09-01 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/1648#discussion_r77279840 --- Diff: external/storm-submit-tools/src/main/java/org/apache/storm/submit/dependency/Booter.java --- @@ -37,16 +37,19 @@ public static

Storm SQL Phase 3 created

2016-09-01 Thread Jungtaek Lim
Hi devs, I just created epic issue for Storm SQL phase 3 which tracks efforts for adding available data sources for Storm SQL. https://issues.apache.org/jira/browse/STORM-2075 Currently Storm SQL only supports Apache Kafka as producer (input table) and consumer (output table) which is not

[GitHub] storm issue #1661: [STORM-2071] Add in retry after rebalance in unit test

2016-09-01 Thread revans2
Github user revans2 commented on the issue: https://github.com/apache/storm/pull/1661 I would be happy to pull that fix back into a separate patch. @ppoulosk this patch looks fine to me, my only concern would be documenting it a little more explaining that the state change might not

[GitHub] storm pull request #1565: STORM-1970: external project examples refator

2016-09-01 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1565#discussion_r77186650 --- Diff: examples/storm-mqtt-examples/pom.xml --- @@ -24,18 +24,24 @@ storm-mqtt-examples - -org.apache.storm -

[GitHub] storm issue #1565: STORM-1970: external project examples refator

2016-09-01 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1565 hi @HeartSaVioR Of course, we should make sure that all examples are 'runnable'. >profile trick to change scope of 'storm-core' : other modules use 'intellij' profile Actually, I

[GitHub] storm issue #1662: [STORM-1344] Remove sql command from storm-jdbc build.

2016-09-01 Thread ppoulosk
Github user ppoulosk commented on the issue: https://github.com/apache/storm/pull/1662 @abellina Yes. I've now pushed the change without the plugin. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] storm issue #1662: [STORM-1344] Remove sql command from storm-jdbc build.

2016-09-01 Thread abellina
Github user abellina commented on the issue: https://github.com/apache/storm/pull/1662 +1 Thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (STORM-2056) Bugs in logviewer

2016-09-01 Thread Boyang Jerry Peng (JIRA)
[ https://issues.apache.org/jira/browse/STORM-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455843#comment-15455843 ] Boyang Jerry Peng commented on STORM-2056: -- [~kabhwan], Thanks for merging in the fix! What

[jira] [Issue Comment Deleted] (STORM-2056) Bugs in logviewer

2016-09-01 Thread Boyang Jerry Peng (JIRA)
[ https://issues.apache.org/jira/browse/STORM-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Jerry Peng updated STORM-2056: - Comment: was deleted (was: [~kabhwan], Thanks for merging in the fix! What about 2.x

[GitHub] storm pull request #1642: STORM-2018: Supervisor V2.

2016-09-01 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/1642#discussion_r77294478 --- Diff: storm-core/src/jvm/org/apache/storm/utils/ConfigUtils.java --- @@ -512,6 +463,10 @@ public static String workerTmpRoot(Map conf, String id) {

[GitHub] storm pull request #1642: STORM-2018: Supervisor V2.

2016-09-01 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/1642#discussion_r77294585 --- Diff: storm-core/src/jvm/org/apache/storm/utils/ConfigUtils.java --- @@ -353,25 +350,21 @@ public LocalState nimbusTopoHistoryStateImpl(Map conf)

[GitHub] storm pull request #1642: STORM-2018: Supervisor V2.

2016-09-01 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/1642#discussion_r77296684 --- Diff: storm-core/test/jvm/org/apache/storm/daemon/supervisor/BasicContainerTest.java --- @@ -0,0 +1,459 @@ +package

[GitHub] storm issue #1565: STORM-1970: external project examples refator

2016-09-01 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/1565 @vesense You can refer pom.xml of storm-starter to see the trick. It determines whether we apply 'provided' or 'compile' via property and profile.

[jira] [Created] (STORM-2078) Enable paging in worker data tables

2016-09-01 Thread Alessandro Bellina (JIRA)
Alessandro Bellina created STORM-2078: - Summary: Enable paging in worker data tables Key: STORM-2078 URL: https://issues.apache.org/jira/browse/STORM-2078 Project: Apache Storm Issue

[GitHub] storm pull request #1669: STORM-2078: enable paging in worker datatable

2016-09-01 Thread abellina
GitHub user abellina opened a pull request: https://github.com/apache/storm/pull/1669 STORM-2078: enable paging in worker datatable You can merge this pull request into a Git repository by running: $ git pull https://github.com/abellina/storm

[GitHub] storm issue #1669: STORM-2078: enable paging in worker datatable

2016-09-01 Thread revans2
Github user revans2 commented on the issue: https://github.com/apache/storm/pull/1669 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] storm issue #1662: [STORM-1344] Remove sql command from storm-jdbc build.

2016-09-01 Thread abellina
Github user abellina commented on the issue: https://github.com/apache/storm/pull/1662 @ppoulosk were you able to test without the plugin all together? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[jira] [Updated] (STORM-2075) Storm SQL Phase III

2016-09-01 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/STORM-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated STORM-2075: Description: This epic tracks the effort of the phase III development of StormSQL. For now Storm

please help: maven complie error

2016-09-01 Thread 양석우
1. git clone https://github.com/apache/storm.git storm-master 2. in storm-master -> mvn clean install -DskipTests=true -e this command rise errors like bellow [INFO] Building storm-hdfs 2.0.0-SNAPSHOT [INFO] [INFO] [INFO]

Re: please help: maven complie error

2016-09-01 Thread Jungtaek Lim
Hi, At first you would want to check if that machine can reach http://repo1.maven.org/maven2/. If it's not you need to make sure or setup mirror for maven repo. And that fail occasionally happens (I mean intermittently) so you might want to retry the build. Hope this helps. Please let me know if

[GitHub] storm issue #1662: [STORM-1344] Remove sql command from storm-jdbc build.

2016-09-01 Thread ppoulosk
Github user ppoulosk commented on the issue: https://github.com/apache/storm/pull/1662 @HeartSaVioR Thanks for the review!! I've squashed commits and added JIRA to commit comment. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub