[jira] [Commented] (APEXMALHAR-2366) Apply BloomFilter to Bucket

2017-02-23 Thread Bhupesh Chawda (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882040#comment-15882040 ] Bhupesh Chawda commented on APEXMALHAR-2366: Hi [~brightchen] Sorry for commenting so

[jira] [Commented] (APEXMALHAR-2422) WindowDataManager not recovering as expected on HDFS

2017-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881774#comment-15881774 ] ASF GitHub Bot commented on APEXMALHAR-2422: Github user sandeshh closed the pull request

[jira] [Commented] (APEXMALHAR-2422) WindowDataManager not recovering as expected on HDFS

2017-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881778#comment-15881778 ] ASF GitHub Bot commented on APEXMALHAR-2422: Github user sandeshh closed the pull request

[jira] [Commented] (APEXMALHAR-2422) WindowDataManager not recovering as expected on HDFS

2017-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881776#comment-15881776 ] ASF GitHub Bot commented on APEXMALHAR-2422: GitHub user sandeshh reopened a pull

[jira] [Commented] (APEXMALHAR-2422) WindowDataManager not recovering as expected on HDFS

2017-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881781#comment-15881781 ] ASF GitHub Bot commented on APEXMALHAR-2422: GitHub user sandeshh reopened a pull

[GitHub] apex-malhar pull request #560: APEXMALHAR-2422 Flushing the data to HDFS nee...

2017-02-23 Thread sandeshh
Github user sandeshh closed the pull request at: https://github.com/apache/apex-malhar/pull/560 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] apex-malhar pull request #560: APEXMALHAR-2422 Flushing the data to HDFS nee...

2017-02-23 Thread sandeshh
Github user sandeshh closed the pull request at: https://github.com/apache/apex-malhar/pull/560 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] apex-malhar pull request #560: APEXMALHAR-2422 Flushing the data to HDFS nee...

2017-02-23 Thread sandeshh
GitHub user sandeshh reopened a pull request: https://github.com/apache/apex-malhar/pull/560 APEXMALHAR-2422 Flushing the data to HDFS needs a separate flag for i… …t to work. @otterc , @tushargosavi please review. You can merge this pull request into a Git repository

[GitHub] apex-malhar pull request #560: APEXMALHAR-2422 Flushing the data to HDFS nee...

2017-02-23 Thread sandeshh
GitHub user sandeshh reopened a pull request: https://github.com/apache/apex-malhar/pull/560 APEXMALHAR-2422 Flushing the data to HDFS needs a separate flag for i… …t to work. @otterc , @tushargosavi please review. You can merge this pull request into a Git repository

[jira] [Commented] (APEXCORE-642) Catch all exceptions in StreamingAppMasterService.serviceInit() and create a StramEvent

2017-02-23 Thread Sanjay M Pujare (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881653#comment-15881653 ] Sanjay M Pujare commented on APEXCORE-642: -- Instead of closing this I'll look into passing the

[jira] [Updated] (APEXMALHAR-2419) KafkaSinglePortExactlyOnceOutputOperator fails on recovery

2017-02-23 Thread Sandesh (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandesh updated APEXMALHAR-2419: Description: The KafkaSinglePortExactlyOnceOutputOperator fails on recovery with the message:

[jira] [Resolved] (APEXCORE-648) Unnecessary byte array copy in DefaultStatefulStreamCodec.toDataStatePair()

2017-02-23 Thread Sandesh (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandesh resolved APEXCORE-648. -- Resolution: Fixed Fix Version/s: 3.6.0 > Unnecessary byte array copy in

[jira] [Commented] (APEXCORE-648) Unnecessary byte array copy in DefaultStatefulStreamCodec.toDataStatePair()

2017-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881294#comment-15881294 ] ASF GitHub Bot commented on APEXCORE-648: - Github user asfgit closed the pull request at:

[GitHub] apex-core pull request #477: APEXCORE-648 Unnecessary byte array copy in Def...

2017-02-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/apex-core/pull/477 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (APEXCORE-635) Proposal: Manage memory to avoid memory copy and garbage collection

2017-02-23 Thread bright chen (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881293#comment-15881293 ] bright chen commented on APEXCORE-635: -- {quote} Yes, an array is an object in java that may hold

[GitHub] apex-malhar pull request #560: APEXMALHAR-2422 Flushing the data to HDFS nee...

2017-02-23 Thread sandeshh
GitHub user sandeshh opened a pull request: https://github.com/apache/apex-malhar/pull/560 APEXMALHAR-2422 Flushing the data to HDFS needs a separate flag for i… …t to work. @otterc , @tushargosavi please review. You can merge this pull request into a Git repository by

[jira] [Commented] (APEXMALHAR-2422) WindowDataManager not recovering as expected on HDFS

2017-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881254#comment-15881254 ] ASF GitHub Bot commented on APEXMALHAR-2422: GitHub user sandeshh opened a pull request:

Re: example applications in malhar

2017-02-23 Thread Amol Kekre
Yes, should merge samples into examples. Ideally the names of the examples should be more descriptive in terms of "how to" as opposed to a title. PI demo for example has lots of ways to do compute. So it could be named as "pi - distributed compute" in examples. Similarly if others can be named to

Re: example applications in malhar

2017-02-23 Thread Sanjay Pujare
+ for renaming to examples. While we are at it, how about merging "samples" also in the new "examples" ? On Thu, Feb 23, 2017 at 9:47 AM, Munagala Ramanath wrote: > +1 for renaming to "examples" > > Ram > > On Thu, Feb 23, 2017 at 9:12 AM, Lakshmi Velineni

Re: example applications in malhar

2017-02-23 Thread Amol Kekre
+1 on renaming it to examples. Additionally we should ensure that the word "demo" is not used at all. The word "demos" is very sales oriented and should not be used. "Examples" are what folks learn from. Thks Amol E:a...@datatorrent.com | M: 510-449-2606 | Twitter: @*amolhkekre*

Re: example applications in malhar

2017-02-23 Thread Munagala Ramanath
+1 for renaming to "examples" Ram On Thu, Feb 23, 2017 at 9:12 AM, Lakshmi Velineni wrote: > I am ready to bring the examples over into the demos folder. I was > wondering if anybody has any input on Thomas's suggestion to rename the > demos folder to examples. I would

Re: example applications in malhar

2017-02-23 Thread Lakshmi Velineni
I am ready to bring the examples over into the demos folder. I was wondering if anybody has any input on Thomas's suggestion to rename the demos folder to examples. I would rather do that first and then bring the examples over instead of doing it the other way around as that would lead to

[jira] [Resolved] (APEXMALHAR-2394) AbstractFileOutputOperator.rotate(...) does not check if file has already been rotated before computing next rotation

2017-02-23 Thread Pramod Immaneni (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pramod Immaneni resolved APEXMALHAR-2394. - Resolution: Fixed > AbstractFileOutputOperator.rotate(...) does not check if

[GitHub] apex-core pull request #478: APEXCORE-634 Changes to unifier attribute test ...

2017-02-23 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-core/pull/478 APEXCORE-634 Changes to unifier attribute test case for module. Incorporated comments from Vlad on (https://github.com/apache/apex-core/pull/466) [APEXCORE-634] Apex Platform unable

[jira] [Commented] (APEXCORE-634) Apex Platform unable to set unifier attributes for modules in DAG

2017-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15880106#comment-15880106 ] ASF GitHub Bot commented on APEXCORE-634: - GitHub user deepak-narkhede opened a pull request:

Re: [DISCUSS] Proposal for adapting Malhar operators for batch use cases

2017-02-23 Thread Bhupesh Chawda
Hi Thomas, My response inline: On Wed, Feb 22, 2017 at 10:17 PM, Thomas Weise wrote: > Hi Bhupesh, > > This looks great. You use the watermark as measure of completeness and the > window to isolate the state, which is how it should work. > > Questions/comments: > > Why does