[jira] [Updated] (APEXMALHAR-2120) Fix bugs on KafkaInputOperatorTest and AbstractKafkaInputOperator

2016-06-22 Thread bright chen (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bright chen updated APEXMALHAR-2120: Description: problems in Unit Test class: KafkaInputOperatorTest - 'k' not initialized

Re: APEXCORE-408 : Ability to schedule Sub-DAG from running application

2016-06-22 Thread Chinmay Kolhatkar
I think its a good idea to have a scheduling operator when you need to start a part of the DAG when some trigger happens (for eg. FileSplitter identifying new files in FS) and otherwise bring it down to save resources. On Wed, Jun 22, 2016 at 9:54 AM, Timothy Farkas <

[jira] [Commented] (APEXCORE-473) Default Unifier without serialization

2016-06-22 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345190#comment-15345190 ] Thomas Weise commented on APEXCORE-473: --- BTW when you have a shuffle (MxN) then the unifier will

[jira] [Commented] (APEXCORE-473) Default Unifier without serialization

2016-06-22 Thread Sandesh (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345223#comment-15345223 ] Sandesh commented on APEXCORE-473: -- Yes, that's what limits the benefits of this approach. > Default

[GitHub] apex-malhar pull request #279: APEXMALHAR-2045: Adding bandwidth control fea...

2016-06-22 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/279#discussion_r68148125 --- Diff: library/src/main/java/com/datatorrent/lib/bandwidth/BandwidthPartitioner.java --- @@ -0,0 +1,78 @@ +/** + * Licensed to the Apache

[GitHub] apex-malhar pull request #298: [APEXMALHAR-2086] Kafka output: 0.9.1 first c...

2016-06-22 Thread siyuanh
Github user siyuanh commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/298#discussion_r68178863 --- Diff: kafka/src/main/java/org/apache/apex/malhar/kafka/KafkaSinglePortExactlyOnceOutputOperator.java --- @@ -0,0 +1,369 @@ +/** + *

[jira] [Commented] (APEXMALHAR-1957) Improve HBasePOJOInputOperator with support for threaded read

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345773#comment-15345773 ] ASF GitHub Bot commented on APEXMALHAR-1957: Github user bhupeshchawda commented on a

[GitHub] apex-malhar pull request #292: APEXMALHAR-1957: Updated HBase Input Operator

2016-06-22 Thread bhupeshchawda
Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/292#discussion_r68177487 --- Diff: contrib/src/main/java/com/datatorrent/contrib/hbase/HBasePOJOInputOperator.java --- @@ -37,20 +37,21 @@ import

[jira] [Commented] (APEXMALHAR-1957) Improve HBasePOJOInputOperator with support for threaded read

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345767#comment-15345767 ] ASF GitHub Bot commented on APEXMALHAR-1957: Github user bhupeshchawda commented on a

[GitHub] apex-malhar pull request #292: APEXMALHAR-1957: Updated HBase Input Operator

2016-06-22 Thread bhupeshchawda
Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/292#discussion_r68177086 --- Diff: contrib/src/main/java/com/datatorrent/contrib/hbase/HBaseScanOperator.java --- @@ -79,4 +170,79 @@ public void emitTuples() */

[jira] [Commented] (APEXMALHAR-1957) Improve HBasePOJOInputOperator with support for threaded read

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345770#comment-15345770 ] ASF GitHub Bot commented on APEXMALHAR-1957: Github user bhupeshchawda commented on a

[jira] [Commented] (APEXMALHAR-2086) Kafka Output Operator with Kafka 0.9 API

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345819#comment-15345819 ] ASF GitHub Bot commented on APEXMALHAR-2086: Github user siyuanh commented on a diff in

[GitHub] apex-malhar pull request #298: [APEXMALHAR-2086] Kafka output: 0.9.1 first c...

2016-06-22 Thread siyuanh
Github user siyuanh commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/298#discussion_r68179198 --- Diff: kafka/src/main/java/org/apache/apex/malhar/kafka/KafkaSinglePortExactlyOnceOutputOperator.java --- @@ -0,0 +1,369 @@ +/** + *

[GitHub] apex-malhar pull request #298: [APEXMALHAR-2086] Kafka output: 0.9.1 first c...

2016-06-22 Thread siyuanh
Github user siyuanh commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/298#discussion_r68179058 --- Diff: kafka/src/main/java/org/apache/apex/malhar/kafka/KafkaSinglePortExactlyOnceOutputOperator.java --- @@ -0,0 +1,369 @@ +/** + *

[jira] [Commented] (APEXMALHAR-2086) Kafka Output Operator with Kafka 0.9 API

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345817#comment-15345817 ] ASF GitHub Bot commented on APEXMALHAR-2086: Github user siyuanh commented on a diff in

[jira] [Created] (APEXMALHAR-2124) DTFileTest.seekDTFile failed in Travis

2016-06-22 Thread bright chen (JIRA)
bright chen created APEXMALHAR-2124: --- Summary: DTFileTest.seekDTFile failed in Travis Key: APEXMALHAR-2124 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2124 Project: Apache Apex Malhar

[GitHub] apex-malhar pull request #321: APEXMALHAR-2120 #resolve #comment solve probl...

2016-06-22 Thread brightchen
GitHub user brightchen reopened a pull request: https://github.com/apache/apex-malhar/pull/321 APEXMALHAR-2120 #resolve #comment solve problems of KafkaInputOperato… …rTest and AbstractKafkaInputOperator You can merge this pull request into a Git repository by running: $

[GitHub] apex-malhar pull request #279: APEXMALHAR-2045: Adding bandwidth control fea...

2016-06-22 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/279#discussion_r68147701 --- Diff: library/src/main/java/com/datatorrent/lib/bandwidth/BandwidthManager.java --- @@ -0,0 +1,137 @@ +/** + * Licensed to the Apache

[jira] [Commented] (APEXMALHAR-2045) Add bandwidth control feature to Apex

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345292#comment-15345292 ] ASF GitHub Bot commented on APEXMALHAR-2045: Github user vrozov commented on a diff in

[GitHub] apex-malhar pull request #279: APEXMALHAR-2045: Adding bandwidth control fea...

2016-06-22 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/279#discussion_r68150902 --- Diff: library/src/main/java/com/datatorrent/lib/bandwidth/BandwidthManager.java --- @@ -0,0 +1,139 @@ +/** + * Licensed to the Apache

[GitHub] apex-malhar pull request #279: APEXMALHAR-2045: Adding bandwidth control fea...

2016-06-22 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/279#discussion_r68151025 --- Diff: library/src/main/java/com/datatorrent/lib/bandwidth/BandwidthManager.java --- @@ -0,0 +1,139 @@ +/** + * Licensed to the Apache

[jira] [Commented] (APEXMALHAR-2045) Add bandwidth control feature to Apex

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345341#comment-15345341 ] ASF GitHub Bot commented on APEXMALHAR-2045: Github user vrozov commented on a diff in

[jira] [Commented] (APEXMALHAR-2045) Add bandwidth control feature to Apex

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345307#comment-15345307 ] ASF GitHub Bot commented on APEXMALHAR-2045: Github user vrozov commented on a diff in

[jira] [Commented] (APEXCORE-473) Default Unifier without serialization

2016-06-22 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345174#comment-15345174 ] Thomas Weise commented on APEXCORE-473: --- Since the implementation of that unifier is part of the

[jira] [Commented] (APEXMALHAR-2045) Add bandwidth control feature to Apex

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345304#comment-15345304 ] ASF GitHub Bot commented on APEXMALHAR-2045: Github user vrozov commented on a diff in

[GitHub] apex-malhar pull request #279: APEXMALHAR-2045: Adding bandwidth control fea...

2016-06-22 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/279#discussion_r68144992 --- Diff: library/src/main/java/com/datatorrent/lib/bandwidth/BandwidthLimitingOperator.java --- @@ -0,0 +1,29 @@ +/** + * Licensed to the

[jira] [Commented] (APEXMALHAR-2045) Add bandwidth control feature to Apex

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345268#comment-15345268 ] ASF GitHub Bot commented on APEXMALHAR-2045: Github user vrozov commented on a diff in

[jira] [Commented] (APEXMALHAR-2048) Create concrete implementation of ArrayListMultiMap using managed state.

2016-06-22 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345458#comment-15345458 ] Thomas Weise commented on APEXMALHAR-2048: -- APEXMALHAR-2085 should use this for window state

[GitHub] apex-core pull request #350: APEXCORE-222 Purging the stale data present in ...

2016-06-22 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/apex-core/pull/350#discussion_r68163971 --- Diff: engine/src/main/java/com/datatorrent/stram/engine/StreamingContainer.java --- @@ -769,7 +769,11 @@ public void

[jira] [Commented] (APEXCORE-222) Delegate Buffer Server purge to StreamingContainer

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1534#comment-1534 ] ASF GitHub Bot commented on APEXCORE-222: - Github user vrozov commented on a diff in the pull

[jira] [Commented] (APEXCORE-222) Delegate Buffer Server purge to StreamingContainer

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345573#comment-15345573 ] ASF GitHub Bot commented on APEXCORE-222: - Github user vrozov commented on a diff in the pull

[jira] [Commented] (APEXMALHAR-2045) Add bandwidth control feature to Apex

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345545#comment-15345545 ] ASF GitHub Bot commented on APEXMALHAR-2045: Github user vrozov commented on a diff in

[jira] [Commented] (APEXMALHAR-1957) Improve HBasePOJOInputOperator with support for threaded read

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345684#comment-15345684 ] ASF GitHub Bot commented on APEXMALHAR-1957: Github user bhupeshchawda commented on a

[GitHub] apex-malhar pull request #292: APEXMALHAR-1957: Updated HBase Input Operator

2016-06-22 Thread bhupeshchawda
Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/292#discussion_r68172645 --- Diff: contrib/src/main/java/com/datatorrent/contrib/hbase/HBasePOJOInputOperator.java --- @@ -69,116 +70,105 @@ public Object convertValue(

[jira] [Commented] (APEXCORE-222) Delegate Buffer Server purge to StreamingContainer

2016-06-22 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345565#comment-15345565 ] Thomas Weise commented on APEXCORE-222: --- You need to analyze the exact sequence of events during

[GitHub] apex-core pull request #350: APEXCORE-222 Purging the stale data present in ...

2016-06-22 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/apex-core/pull/350#discussion_r68164956 --- Diff: bufferserver/src/main/java/com/datatorrent/bufferserver/internal/DataList.java --- @@ -178,19 +178,23 @@ public void reset() public

[jira] [Commented] (APEXMALHAR-2045) Add bandwidth control feature to Apex

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345519#comment-15345519 ] ASF GitHub Bot commented on APEXMALHAR-2045: Github user vrozov commented on a diff in

[jira] [Commented] (APEXCORE-222) Delegate Buffer Server purge to StreamingContainer

2016-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345591#comment-15345591 ] ASF GitHub Bot commented on APEXCORE-222: - Github user vrozov commented on a diff in the pull

[GitHub] apex-core pull request #350: APEXCORE-222 Purging the stale data present in ...

2016-06-22 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/apex-core/pull/350#discussion_r68166717 --- Diff: engine/src/main/java/com/datatorrent/stram/engine/StreamingContainer.java --- @@ -769,7 +769,11 @@ public void