Re: [DISCUSS] Proposal for adapting Malhar operators for batch use cases

2017-02-17 Thread Amol Kekre
Thomas, The watermarks we have in Apex (start-window and end-window) are working good. It is fine to take a look at event time, but basic file I/O does not need anything more than start and end. Lets say they are start-something, end-something. The main difference here is that the tuples are user

[jira] [Resolved] (APEXCORE-570) Prevent upstream operators from getting too far ahead when downstream operators are slow

2017-02-17 Thread Vlad Rozov (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vlad Rozov resolved APEXCORE-570. - Resolution: Implemented Fix Version/s: 3.6.0 > Prevent upstream operators from getting

[jira] [Commented] (APEXCORE-570) Prevent upstream operators from getting too far ahead when downstream operators are slow

2017-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15873007#comment-15873007 ] ASF GitHub Bot commented on APEXCORE-570: - Github user asfgit closed the pull request at:

[GitHub] apex-core pull request #445: APEXCORE-570 Back pressure support in buffer se...

2017-02-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/apex-core/pull/445 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (APEXMALHAR-2412) Provide emitTuple overriding functionality for user in kinesis Input operator

2017-02-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15871731#comment-15871731 ] ASF GitHub Bot commented on APEXMALHAR-2412: GitHub user deepak-narkhede opened a pull

[GitHub] apex-malhar pull request #556: APEXMALHAR-2412 Provide emitTuple overriding ...

2017-02-17 Thread deepak-narkhede
GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-malhar/pull/556 APEXMALHAR-2412 Provide emitTuple overriding functionality for user in kinesis Input operator Provide emitTuple overriding functionality for user in kinesis Input operator.

[jira] [Assigned] (APEXMALHAR-2414) Improve performance of PojoInnerJoin accum by using PojoUtils

2017-02-17 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXMALHAR-2414: - Assignee: Chinmay Kolhatkar > Improve performance of PojoInnerJoin

[jira] [Resolved] (APEXMALHAR-2409) Improve PojoInnerJoin accumulation to emit a POJO instead of Map

2017-02-17 Thread Tushar Gosavi (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tushar Gosavi resolved APEXMALHAR-2409. --- Resolution: Fixed Fix Version/s: 3.7.0 > Improve PojoInnerJoin

[GitHub] apex-malhar pull request #554: APEXMALHAR-2409 PojoInnerJoin accumulation to...

2017-02-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/554 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature