[jira] [Commented] (APEXMALHAR-2121) KafkaInputOperator emitTuple method should be able to emit more than just message

[ https://issues.apache.org/jira/browse/APEXMALHAR-2121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343712#comment-15343712 ] ASF GitHub Bot commented on APEXMALHAR-2121: Github user tweise commented on a diff in

[GitHub] apex-malhar pull request #323: APEXMALHAR-2121: Updating KafkaInputOperator ...

Github user tweise commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/323#discussion_r67994905 --- Diff: contrib/src/main/java/com/datatorrent/contrib/kafka/AbstractKafkaInputOperator.java --- @@ -203,6 +204,14 @@ public

Re: APEXCORE-408 : Ability to schedule Sub-DAG from running application

Hi, IMO scheduling a job can be independent of any operator while StatsListeners are not. I understand that in a lot of cases input/output operators will decide when the job ends but there can be cases when scheduling can be independent of it. Thanks, Chandni On Jun 21, 2016 12:12 PM, "Thomas

[jira] [Closed] (APEXMALHAR-2119) Make DirectoryScanner in AbstractFileInputOperator inheritance friendly.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Munagala V. Ramanath closed APEXMALHAR-2119. Resolution: Fixed Fix Version/s: 3.5.0 > Make DirectoryScanner

[jira] [Commented] (APEXMALHAR-2116) File Record reader module

[ https://issues.apache.org/jira/browse/APEXMALHAR-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343027#comment-15343027 ] ASF GitHub Bot commented on APEXMALHAR-2116: Github user amberarrow commented on a diff

[jira] [Commented] (APEXMALHAR-2116) File Record reader module

[ https://issues.apache.org/jira/browse/APEXMALHAR-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343016#comment-15343016 ] ASF GitHub Bot commented on APEXMALHAR-2116: Github user amberarrow commented on a diff

[GitHub] apex-malhar pull request #326: APEXMALHAR-2116 Added FS record reader operat...

Github user amberarrow commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/326#discussion_r67969125 --- Diff: library/src/main/java/org/apache/apex/malhar/lib/fs/FSRecordReader.java --- @@ -0,0 +1,175 @@ +/** + * Licensed to the Apache

[jira] [Commented] (APEXMALHAR-2116) File Record reader module

[ https://issues.apache.org/jira/browse/APEXMALHAR-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342995#comment-15342995 ] ASF GitHub Bot commented on APEXMALHAR-2116: Github user amberarrow commented on a diff

[jira] [Commented] (APEXMALHAR-2116) File Record reader module

[ https://issues.apache.org/jira/browse/APEXMALHAR-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342992#comment-15342992 ] ASF GitHub Bot commented on APEXMALHAR-2116: Github user amberarrow commented on a diff

[jira] [Commented] (APEXMALHAR-2119) Make DirectoryScanner in AbstractFileInputOperator inheritance friendly.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342899#comment-15342899 ] ASF GitHub Bot commented on APEXMALHAR-2119: Github user asfgit closed the pull request

[GitHub] apex-malhar pull request #318: APEXMALHAR-2119 add setters for partition cou...

Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/318 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (APEXMALHAR-2121) KafkaInputOperator emitTuple method should be able to emit more than just message

[ https://issues.apache.org/jira/browse/APEXMALHAR-2121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342652#comment-15342652 ] ASF GitHub Bot commented on APEXMALHAR-2121: Github user siyuanh commented on a diff in

[GitHub] apex-malhar pull request #323: APEXMALHAR-2121: Updating KafkaInputOperator ...

Github user siyuanh commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/323#discussion_r67949068 --- Diff: contrib/src/main/java/com/datatorrent/contrib/kafka/AbstractKafkaInputOperator.java --- @@ -203,6 +204,14 @@ public

[jira] [Commented] (APEXMALHAR-2094) Quantiles sketch operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342485#comment-15342485 ] ASF GitHub Bot commented on APEXMALHAR-2094: Github user tweise commented on a diff in

[jira] [Commented] (APEXMALHAR-2094) Quantiles sketch operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342484#comment-15342484 ] ASF GitHub Bot commented on APEXMALHAR-2094: Github user tweise commented on a diff in

[GitHub] apex-malhar pull request #301: [APEXMALHAR-2094] Quantiles operator

Github user tweise commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/301#discussion_r67933939 --- Diff: sketches/src/test/java/org/apache/apex/malhar/sketches/QuantilesEstimatorTest.java --- @@ -0,0 +1,172 @@ +/** + * Licensed to the

Re: APEXCORE-408 : Ability to schedule Sub-DAG from running application

This looks like something that coordination wise belongs into the master and can be done with a shared stats listener. The operator request/response protocol could be used the relay the data for the scheduling decisions. Thomas On Tue, Jun 21, 2016 at 11:38 AM, Singh, Chandni <

Re: APEXCORE-408 : Ability to schedule Sub-DAG from running application

For the usecase 1, is it possible to avoid changing the Context? Can we have something along the lines of "StramToNodeRequest" ? On Tue, Jun 21, 2016 at 11:09 AM Tushar Gosavi wrote: > Hi All, > > We have seen few use cases in field which require Apex application >

[jira] [Commented] (APEXMALHAR-2094) Quantiles sketch operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342403#comment-15342403 ] ASF GitHub Bot commented on APEXMALHAR-2094: Github user sandeep-n commented on a diff in

[GitHub] apex-malhar pull request #301: [APEXMALHAR-2094] Quantiles operator

Github user sandeep-n commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/301#discussion_r67925991 --- Diff: sketches/src/test/java/org/apache/apex/malhar/sketches/QuantilesEstimatorTest.java --- @@ -0,0 +1,204 @@ +/** + * Licensed to the

[GitHub] apex-malhar pull request #301: [APEXMALHAR-2094] Quantiles operator

Github user sandeep-n commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/301#discussion_r67925558 --- Diff: pom.xml --- @@ -212,6 +212,7 @@ library contrib demos +sketches --- End diff -- Thanks for

APEXCORE-408 : Ability to schedule Sub-DAG from running application

Hi All, We have seen few use cases in field which require Apex application scheduling based on some condition. This has also came up as part of Batch Support in Apex previously

[jira] [Commented] (APEXMALHAR-2116) File Record reader module

[ https://issues.apache.org/jira/browse/APEXMALHAR-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341888#comment-15341888 ] ASF GitHub Bot commented on APEXMALHAR-2116: GitHub user yogidevendra opened a pull

[GitHub] apex-malhar pull request #326: APEXMALHAR-2116 Added FS record reader operat...

GitHub user yogidevendra opened a pull request: https://github.com/apache/apex-malhar/pull/326 APEXMALHAR-2116 Added FS record reader operator, module, test You can merge this pull request into a Git repository by running: $ git pull

[GitHub] apex-malhar pull request #301: [APEXMALHAR-2094] Quantiles operator

Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/301#discussion_r67852697 --- Diff: sketches/src/test/java/org/apache/apex/malhar/sketches/QuantilesEstimatorTest.java --- @@ -0,0 +1,204 @@ +/** + * Licensed to

[jira] [Commented] (APEXMALHAR-2094) Quantiles sketch operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341617#comment-15341617 ] ASF GitHub Bot commented on APEXMALHAR-2094: Github user bhupeshchawda commented on a

[GitHub] apex-malhar pull request #301: [APEXMALHAR-2094] Quantiles operator

Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/301#discussion_r67852390 --- Diff: sketches/src/test/java/org/apache/apex/malhar/sketches/QuantilesEstimatorTest.java --- @@ -0,0 +1,204 @@ +/** + * Licensed to

[jira] [Commented] (APEXMALHAR-2094) Quantiles sketch operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341612#comment-15341612 ] ASF GitHub Bot commented on APEXMALHAR-2094: Github user bhupeshchawda commented on a

[GitHub] apex-malhar pull request #301: [APEXMALHAR-2094] Quantiles operator

Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/301#discussion_r67852225 --- Diff: sketches/src/test/java/org/apache/apex/malhar/sketches/QuantilesEstimatorTest.java --- @@ -0,0 +1,204 @@ +/** + * Licensed to

[GitHub] apex-malhar pull request #301: [APEXMALHAR-2094] Quantiles operator

Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/301#discussion_r67852192 --- Diff: sketches/src/test/java/org/apache/apex/malhar/sketches/QuantilesEstimatorTest.java --- @@ -0,0 +1,204 @@ +/** + * Licensed to

[jira] [Commented] (APEXMALHAR-2106) Support merging multiple streams with StreamMerger

[ https://issues.apache.org/jira/browse/APEXMALHAR-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341509#comment-15341509 ] ASF GitHub Bot commented on APEXMALHAR-2106: Github user bhupeshchawda commented on a

[GitHub] apex-malhar pull request #309: [APEXMALHAR-2106] Support multiple streams in...

Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/309#discussion_r67842738 --- Diff: library/src/test/java/com/datatorrent/lib/stream/MultipleStreamMergerTest.java --- @@ -0,0 +1,200 @@ +/** + * Licensed to the

[jira] [Commented] (APEXMALHAR-2106) Support merging multiple streams with StreamMerger

[ https://issues.apache.org/jira/browse/APEXMALHAR-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341487#comment-15341487 ] ASF GitHub Bot commented on APEXMALHAR-2106: Github user bhupeshchawda commented on a

[jira] [Commented] (APEXMALHAR-2106) Support merging multiple streams with StreamMerger

[ https://issues.apache.org/jira/browse/APEXMALHAR-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341485#comment-15341485 ] ASF GitHub Bot commented on APEXMALHAR-2106: Github user bhupeshchawda commented on a

[jira] [Commented] (APEXMALHAR-2122) Upgrading elasticsearch java api from 1.1.2 to 2.3.3.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341286#comment-15341286 ] ASF GitHub Bot commented on APEXMALHAR-2122: GitHub user akshay-harale opened a pull

[GitHub] apex-malhar pull request #325: APEXMALHAR-2122 Upgrading elasticsearch java ...

GitHub user akshay-harale opened a pull request: https://github.com/apache/apex-malhar/pull/325 APEXMALHAR-2122 Upgrading elasticsearch java api from 1.1.2 to 2.3.3. Upgrading elasticsearch java api from 1.1.2 to 2.3.3. Made necessary changes in operator. Fixed build issues

[GitHub] apex-malhar pull request #324: Spillable Datastructures PR for review only

GitHub user ilooner opened a pull request: https://github.com/apache/apex-malhar/pull/324 Spillable Datastructures PR for review only You can merge this pull request into a Git repository by running: $ git pull https://github.com/ilooner/incubator-apex-malhar

[jira] [Commented] (APEXMALHAR-2119) Make DirectoryScanner in AbstractFileInputOperator inheritance friendly.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341202#comment-15341202 ] ASF GitHub Bot commented on APEXMALHAR-2119: Github user tushargosavi commented on a diff

[GitHub] apex-malhar pull request #318: APEXMALHAR-2119 add setters for partition cou...

Github user tushargosavi commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/318#discussion_r67813977 --- Diff: library/src/main/java/com/datatorrent/lib/io/fs/AbstractFileInputOperator.java --- @@ -1110,6 +1116,16 @@ public String toString()