[Proposal] DAG listener

Hi All, As we add more features to support batch use cases, there will be a need to access more information about the DAG from an operator. One example is the need to access the operator name while using Batched StatsListener. The idea here is to implement DAG Listener ( similar to StatsListener

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414749#comment-15414749 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user DT-Priyanka commented on a diff

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414745#comment-15414745 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user DT-Priyanka commented on a diff

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user DT-Priyanka commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/358#discussion_r74188002 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcPollInputOperator.java --- @@ -438,119 +261,110 @@ public void endWindow()

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414743#comment-15414743 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user DT-Priyanka commented on a diff

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user DT-Priyanka commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/358#discussion_r74187951 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcPollInputOperator.java --- @@ -438,119 +261,110 @@ public void endWindow()

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user DT-Priyanka commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/358#discussion_r74187810 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcPollInputOperator.java --- @@ -286,149 +141,117 @@ public

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414739#comment-15414739 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user DT-Priyanka commented on a diff

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414736#comment-15414736 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user DT-Priyanka commented on a diff

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user DT-Priyanka commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/358#discussion_r74187676 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcPollInputOperator.java --- @@ -80,201 +93,48 @@ * @tags database,

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/358#discussion_r74187632 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/JdbcPOJOPollInputOperator.java --- @@ -0,0 +1,321 @@ +/** + * Licensed to the

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414732#comment-15414732 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user DT-Priyanka commented on a diff

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user DT-Priyanka commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/358#discussion_r74187567 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcPollInputOperator.java --- @@ -80,201 +93,48 @@ * @tags database,

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414731#comment-15414731 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user bhupeshchawda commented on a

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414730#comment-15414730 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user bhupeshchawda commented on a

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/358#discussion_r74187569 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcPollInputOperator.java --- @@ -638,24 +504,191 @@ public void

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414719#comment-15414719 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user bhupeshchawda commented on a

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414717#comment-15414717 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user bhupeshchawda commented on a

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/358#discussion_r74187324 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcPollInputOperator.java --- @@ -286,271 +141,238 @@ public

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/358#discussion_r74187296 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcPollInputOperator.java --- @@ -286,271 +141,238 @@ public

[jira] [Created] (APEXCORE-503) support KillException

Sandesh created APEXCORE-503: Summary: support KillException Key: APEXCORE-503 URL: https://issues.apache.org/jira/browse/APEXCORE-503 Project: Apache Apex Core Issue Type: Improvement

[GitHub] apex-malhar pull request #362: JMS Input operator changes to support SQS and...

Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/362 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

Re: Apex website update proposal

Hi Kartavya, How about "Initiatives" for 2. Also, let us know if you need any help with the mechanics of making contributions to the website. Thanks On Tue, Aug 9, 2016 at 4:31 PM, Kartavya Jain wrote: > Yes, CTA is call to action. > > On Tue, Aug 9, 2016 at 4:00 PM,

Re: Apex website update proposal

Yes, CTA is call to action. On Tue, Aug 9, 2016 at 4:00 PM, Ashwin Chandra Putta < ashwinchand...@gmail.com> wrote: > Kartavya, > > Good initiative. > > 1. +1 for putting "powered by" on nav bar. > 2. Not sure about putting roadmap on the navbar, but I do agree that > roadmap should have a

Re: Apex website update proposal

-users@ Cross posting is generally not preferred, and this seems to belong on the dev@ list only. On Tue, Aug 9, 2016 at 3:43 PM, Kartavya Jain wrote: > Hi, > > I would like to propose the following edits to the Apache Apex web page. > > 1. Add "Powered By" on the

Re: A proposal for Malhar

There are a bunch of operators that don't have proper state management and also don't support generic windowing (event time etc.). I would suggest to move those out or deprecate them. The new windowing and state management support along with the appropriate aggregators is going to make them

[GitHub] apex-site pull request #44: Added malhar contribution guidelines

Github user tweise commented on a diff in the pull request: https://github.com/apache/apex-site/pull/44#discussion_r74113071 --- Diff: src/md/malhar-contributing.md --- @@ -0,0 +1,41 @@ +# Malhar Contribution Guidelines + +Malhar library predominantly contains different

[GitHub] apex-site pull request #44: Added malhar contribution guidelines

Github user tweise commented on a diff in the pull request: https://github.com/apache/apex-site/pull/44#discussion_r74111044 --- Diff: src/md/malhar-contributing.md --- @@ -0,0 +1,41 @@ +# Malhar Contribution Guidelines + +Malhar library predominantly contains different

Re: A proposal for Malhar

Hi, Friendly Reminder : I created a shared google sheet and tracked the various details of operators. The sheet contains information about operators under lib/algo, lib/math & lib/streamquery. Link is https://docs.google.com/a/ datatorrent.com/spreadsheets/d/15IjMa-vYK6Wru4kZnUGIgg6sQAptDJ_

[GitHub] apex-malhar pull request #347: APEXMALHAR-2156 changes

Github user sanjaypujare closed the pull request at: https://github.com/apache/apex-malhar/pull/347 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (APEXMALHAR-2156) JMS Input operator enhancements

[ https://issues.apache.org/jira/browse/APEXMALHAR-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413894#comment-15413894 ] ASF GitHub Bot commented on APEXMALHAR-2156: Github user sanjaypujare closed the pull

Re: A proposal for Malhar

Added comments, also recommend having the misc folder for the remaining operators in contrib according to proposed guidelines https://github.com/apache/apex-site/pull/44 On Mon, Aug 1, 2016 at 12:22 AM, Lakshmi Velineni wrote: > Hi > > I also added recommendation for

[jira] [Assigned] (APEXMALHAR-2129) ManagedState: Add a disable purging option

[ https://issues.apache.org/jira/browse/APEXMALHAR-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh reassigned APEXMALHAR-2129: - Assignee: Chandni Singh > ManagedState: Add a disable purging option >

[GitHub] apex-core pull request #361: APEXCORE-496 make operator name available to St...

Github user sandeshh commented on a diff in the pull request: https://github.com/apache/apex-core/pull/361#discussion_r74098254 --- Diff: api/src/main/java/com/datatorrent/api/StatsListener.java --- @@ -115,6 +115,28 @@ List getOperatorResponse(); } + /**

[jira] [Created] (APEXMALHAR-2180) KafkaInput Operator partitions has to be unchanged in case of dynamic scaling of ONE_TO_MANY strategy.

Chaitanya created APEXMALHAR-2180: - Summary: KafkaInput Operator partitions has to be unchanged in case of dynamic scaling of ONE_TO_MANY strategy. Key: APEXMALHAR-2180 URL:

[jira] [Commented] (APEXMALHAR-2179) Add documentation for JDBCPollInputOperator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413414#comment-15413414 ] ASF GitHub Bot commented on APEXMALHAR-2179: GitHub user DT-Priyanka opened a pull

[GitHub] apex-malhar pull request #363: APEXMALHAR-2179: Add documentation for JDBC P...

GitHub user DT-Priyanka opened a pull request: https://github.com/apache/apex-malhar/pull/363 APEXMALHAR-2179: Add documentation for JDBC Poll Input Operator @bhupeshchawda @devtagare and @chandnisingh please review. You can merge this pull request into a Git repository by

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413392#comment-15413392 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user DT-Priyanka closed the pull

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413393#comment-15413393 ] ASF GitHub Bot commented on APEXMALHAR-2172: GitHub user DT-Priyanka reopened a pull

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

GitHub user DT-Priyanka reopened a pull request: https://github.com/apache/apex-malhar/pull/358 APEXMALHAR-2172: Updates to JDBC Poll Input Operator Changes include: 1. Using jooq query to construct sql queries 2. Update logic to query based on row numbers instead of primary

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user DT-Priyanka closed the pull request at: https://github.com/apache/apex-malhar/pull/358 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Created] (APEXMALHAR-2179) Add documentation for JDBCPollInputOperator

Priyanka Gugale created APEXMALHAR-2179: --- Summary: Add documentation for JDBCPollInputOperator Key: APEXMALHAR-2179 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2179 Project: Apache

[jira] [Updated] (APEXMALHAR-2161) Add tests for AbstractThroughputFileInputOperator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yogi Devendra updated APEXMALHAR-2161: -- Fix Version/s: 3.5.0 > Add tests for AbstractThroughputFileInputOperator >

[jira] [Resolved] (APEXMALHAR-2161) Add tests for AbstractThroughputFileInputOperator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yogi Devendra resolved APEXMALHAR-2161. --- Resolution: Fixed > Add tests for AbstractThroughputFileInputOperator >

[jira] [Commented] (APEXMALHAR-2161) Add tests for AbstractThroughputFileInputOperator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413219#comment-15413219 ] ASF GitHub Bot commented on APEXMALHAR-2161: Github user asfgit closed the pull request

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413202#comment-15413202 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user DT-Priyanka commented on a diff

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user DT-Priyanka commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/358#discussion_r74018839 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/JdbcPOJOPollInputOperator.java --- @@ -0,0 +1,321 @@ +/** + * Licensed to the

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413169#comment-15413169 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user bhupeshchawda commented on a

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/358#discussion_r74015429 --- Diff: library/src/test/java/com/datatorrent/lib/db/jdbc/JdbcPojoPollableOpeartorTest.java --- @@ -0,0 +1,251 @@ +/** + * Licensed to

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/358#discussion_r74012725 --- Diff: library/src/test/java/com/datatorrent/lib/db/jdbc/JdbcPojoPollableOpeartorTest.java --- @@ -0,0 +1,251 @@ +/** + * Licensed to

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413126#comment-15413126 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user bhupeshchawda commented on a

[jira] [Commented] (APEXMALHAR-2161) Add tests for AbstractThroughputFileInputOperator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413071#comment-15413071 ] ASF GitHub Bot commented on APEXMALHAR-2161: Github user DT-Priyanka closed the pull

[GitHub] apex-malhar pull request #359: APEXMALHAR-2161: Add tests for AbstractThroug...

GitHub user DT-Priyanka reopened a pull request: https://github.com/apache/apex-malhar/pull/359 APEXMALHAR-2161: Add tests for AbstractThroughputFileInputOperator Added unit tests for AbstractThroughputFileInputOperator class You can merge this pull request into a Git repository by

[GitHub] apex-malhar pull request #359: APEXMALHAR-2161: Add tests for AbstractThroug...

Github user DT-Priyanka closed the pull request at: https://github.com/apache/apex-malhar/pull/359 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413056#comment-15413056 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user bhupeshchawda commented on a

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413057#comment-15413057 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user bhupeshchawda commented on a

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413051#comment-15413051 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user bhupeshchawda commented on a

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413042#comment-15413042 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user bhupeshchawda commented on a

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/358#discussion_r74005037 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcPollInputOperator.java --- @@ -286,271 +146,233 @@ public

[jira] [Commented] (APEXMALHAR-2172) Update JDBC poll input operator to fix issues

[ https://issues.apache.org/jira/browse/APEXMALHAR-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413026#comment-15413026 ] ASF GitHub Bot commented on APEXMALHAR-2172: Github user bhupeshchawda commented on a

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/358#discussion_r74004337 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcPollInputOperator.java --- @@ -286,271 +146,233 @@ public

[GitHub] apex-malhar pull request #358: APEXMALHAR-2172: Updates to JDBC Poll Input O...

Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/358#discussion_r74004081 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcPollInputOperator.java --- @@ -438,119 +261,110 @@ public void

[jira] [Updated] (APEXMALHAR-2174) S3 File Reader reading more data than expected

[ https://issues.apache.org/jira/browse/APEXMALHAR-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yogi Devendra updated APEXMALHAR-2174: -- Fix Version/s: 3.5.0 > S3 File Reader reading more data than expected >

[GitHub] apex-malhar pull request #360: APEXMALHAR-2174-S3-ReaderIssue Fixed the S3 r...

Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/360 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature