Re: A proposal for Malhar

+1. This is a really good starting point to cleanup malhar. On Wed, Jul 13, 2016 at 3:06 AM, David Yan wrote: > Hi Lakshmi, > > Thanks for volunteering. > > I think Pramod's suggestion of putting the operators into 3 buckets and > Siyuan's suggestion of starting a shared

Re: auto-generated emails

Strongly +1 for this. For 1, can the mail be sent to someone who is mentioned in the PR? So for e.g., if I mention @PramodSSImmaneni , then Pramod will be part of PR email notification all further back and forth communication for that PR. @Pramod, just using your name as an example.. :) -

[jira] [Created] (APEXCORE-491) AppMaster memory based on the DAG

Sandesh created APEXCORE-491: Summary: AppMaster memory based on the DAG Key: APEXCORE-491 URL: https://issues.apache.org/jira/browse/APEXCORE-491 Project: Apache Apex Core Issue Type:

[GitHub] apex-site pull request #43: Adding Powered by Apex page

GitHub user sashadt opened a pull request: https://github.com/apache/apex-site/pull/43 Adding Powered by Apex page You can merge this pull request into a Git repository by running: $ git pull https://github.com/sashadt/incubator-apex-site APEXMALHAR-2137 Alternatively you

[jira] [Commented] (APEXCORE-488) Issues in SSL communication with StrAM

[ https://issues.apache.org/jira/browse/APEXCORE-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374152#comment-15374152 ] ASF GitHub Bot commented on APEXCORE-488: - Github user PramodSSImmaneni commented on a diff in

[GitHub] apex-core pull request #357: APEXCORE-488: Issues in SSL communication with ...

Github user PramodSSImmaneni commented on a diff in the pull request: https://github.com/apache/apex-core/pull/357#discussion_r70553112 --- Diff: engine/src/main/java/com/datatorrent/stram/StreamingAppMasterService.java --- @@ -607,14 +608,15 @@ protected void serviceStart()

[jira] [Created] (APEXMALHAR-2146) Benchmark operators that support Beam window concepts

Vlad Rozov created APEXMALHAR-2146: -- Summary: Benchmark operators that support Beam window concepts Key: APEXMALHAR-2146 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2146 Project: Apache

[jira] [Created] (APEXMALHAR-2145) Revisit Accumulation interface

Vlad Rozov created APEXMALHAR-2145: -- Summary: Revisit Accumulation interface Key: APEXMALHAR-2145 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2145 Project: Apache Apex Malhar

[jira] [Resolved] (APEXMALHAR-2085) Implement Windowed Operators

[ https://issues.apache.org/jira/browse/APEXMALHAR-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Yan resolved APEXMALHAR-2085. --- Resolution: Fixed Fix Version/s: 3.5.0 > Implement Windowed Operators >

[GitHub] apex-malhar pull request #319: APEXMALHAR-2085: Operator supporting the Beam...

Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/319 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (APEXMALHAR-2085) Implement Windowed Operators

[ https://issues.apache.org/jira/browse/APEXMALHAR-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373859#comment-15373859 ] ASF GitHub Bot commented on APEXMALHAR-2085: Github user asfgit closed the pull request

[jira] [Resolved] (APEXMALHAR-2140) Move ActiveFieldInfo class to com.datatorrent.lib.util

[ https://issues.apache.org/jira/browse/APEXMALHAR-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Munagala V. Ramanath resolved APEXMALHAR-2140. -- Resolution: Fixed Fix Version/s: 3.5.0 Merged > Move

[GitHub] apex-malhar pull request #340: APEXMALHAR-2140 ActiveFieldInfo moved to Abst...

Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/340 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Updated] (APEXMALHAR-2143) Evaluate and retire lib/math, lib/algo, and lib/streamquery operators

[ https://issues.apache.org/jira/browse/APEXMALHAR-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Yan updated APEXMALHAR-2143: -- Assignee: Velineni Lakshmi Prasanna > Evaluate and retire lib/math, lib/algo, and

[jira] [Updated] (APEXMALHAR-2143) Evaluate and retire lib/math, lib/algo, and lib/streamquery operators

[ https://issues.apache.org/jira/browse/APEXMALHAR-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Yan updated APEXMALHAR-2143: -- Assignee: (was: David Yan) > Evaluate and retire lib/math, lib/algo, and

[jira] [Commented] (APEXMALHAR-2142) High-level API window support

[ https://issues.apache.org/jira/browse/APEXMALHAR-2142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373783#comment-15373783 ] Siyuan Hua commented on APEXMALHAR-2142: https://github.com/apache/apex-malhar/pull/339 >

[jira] [Created] (APEXMALHAR-2143) Evaluate and retire lib/math, lib/algo, and lib/streamquery operators

David Yan created APEXMALHAR-2143: - Summary: Evaluate and retire lib/math, lib/algo, and lib/streamquery operators Key: APEXMALHAR-2143 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2143

Re: auto-generated emails

+1 Ram On Tue, Jul 12, 2016 at 2:35 PM, Pramod Immaneni wrote: > Hi, > > I was wondering how everyone felt about the volume of auto-generated emails > on this list. Looks like multiple emails are generated and sent to everyone > on the list even for relatively smaller

[jira] [Commented] (APEXMALHAR-2142) High-level API window support

[ https://issues.apache.org/jira/browse/APEXMALHAR-2142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373760#comment-15373760 ] Siyuan Hua commented on APEXMALHAR-2142: Basically use windowed operator to do windowed

[jira] [Created] (APEXMALHAR-2142) High-level API window support

Siyuan Hua created APEXMALHAR-2142: -- Summary: High-level API window support Key: APEXMALHAR-2142 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2142 Project: Apache Apex Malhar Issue

Re: auto-generated emails

I'm strong +1 for Pramod's suggestion. David On Tue, Jul 12, 2016 at 2:35 PM, Pramod Immaneni wrote: > Hi, > > I was wondering how everyone felt about the volume of auto-generated emails > on this list. Looks like multiple emails are generated and sent to everyone > on

Re: A proposal for Malhar

Hi Lakshmi, Thanks for volunteering. I think Pramod's suggestion of putting the operators into 3 buckets and Siyuan's suggestion of starting a shared Google Sheet that tracks individual operators are both good, with the exception that lib/streamquery is one unit and we probably do not need to

auto-generated emails

Hi, I was wondering how everyone felt about the volume of auto-generated emails on this list. Looks like multiple emails are generated and sent to everyone on the list even for relatively smaller actions such as commenting on a pull request, one from git, another from JIRA etc. Understanding

[jira] [Commented] (APEXCORE-488) Issues in SSL communication with StrAM

[ https://issues.apache.org/jira/browse/APEXCORE-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373743#comment-15373743 ] ASF GitHub Bot commented on APEXCORE-488: - Github user vrozov commented on a diff in the pull

Re: A proposal for Malhar

I am interested to work on this. Regards, Lakshmi prasanna On Tue, Jul 12, 2016 at 1:55 PM, hsy...@gmail.com wrote: > Why not have a shared google sheet with a list of operators and options > that we want to do with it. > I think it's case by case. > But retire unused or

[jira] [Commented] (APEXMALHAR-2141) An efficient Accumulation interface for primitive type

[ https://issues.apache.org/jira/browse/APEXMALHAR-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373694#comment-15373694 ] Siyuan Hua commented on APEXMALHAR-2141: A stateless accumulation vs stateful accumulation.

[GitHub] apex-site pull request #42: Added updating documentation to release process

Github user sashadt commented on a diff in the pull request: https://github.com/apache/apex-site/pull/42#discussion_r70522203 --- Diff: src/md/release.md --- @@ -150,6 +150,47 @@ mkdir svn-dist && cp *-source-* svn-dist/ svn import svn-dist

[jira] [Created] (APEXMALHAR-2141) An efficient Accumulation interface for primitive type

Siyuan Hua created APEXMALHAR-2141: -- Summary: An efficient Accumulation interface for primitive type Key: APEXMALHAR-2141 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2141 Project: Apache

[GitHub] apex-malhar pull request #340: APEXMALHAR-2140 ActiveFieldInfo moved to Abst...

GitHub user devtagare opened a pull request: https://github.com/apache/apex-malhar/pull/340 APEXMALHAR-2140 ActiveFieldInfo moved to AbstractJdbcPOJOOutputOperator @amberarrow could you please review the changes. You can merge this pull request into a Git repository by

[jira] [Commented] (APEXMALHAR-2140) Move ActiveFieldInfo class to com.datatorrent.lib.util

[ https://issues.apache.org/jira/browse/APEXMALHAR-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373669#comment-15373669 ] ASF GitHub Bot commented on APEXMALHAR-2140: GitHub user devtagare opened a pull request:

Re: A proposal for Malhar

Why not have a shared google sheet with a list of operators and options that we want to do with it. I think it's case by case. But retire unused or obsolete operators is important and we should do it sooner rather than later. Regards, Siyuan On Tue, Jul 12, 2016 at 1:09 PM, Amol Kekre

Re: A proposal for Malhar

I would suggest we go through the operators in those packages on an individual basis and grade them into 3 buckets, those that meet the level we expect from the operators (could be few of them), those that are potentially useful but need additional work and those that we don't think would be

[jira] [Commented] (APEXCORE-488) Issues in SSL communication with StrAM

[ https://issues.apache.org/jira/browse/APEXCORE-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373640#comment-15373640 ] ASF GitHub Bot commented on APEXCORE-488: - Github user pradeepdalvi commented on a diff in the

[GitHub] apex-core pull request #357: APEXCORE-488: Issues in SSL communication with ...

Github user pradeepdalvi commented on a diff in the pull request: https://github.com/apache/apex-core/pull/357#discussion_r70516680 --- Diff: engine/src/main/java/com/datatorrent/stram/StreamingAppMasterService.java --- @@ -608,13 +609,16 @@ protected void serviceStart() throws

Re: Partitionable,Idempotent & Pollable JDBCInput

Finally we have a robust jdbc polling input operator. Since it is @evolving, we can make improvements over time as folks start using this operator. +1 for merging the PR. Regards, Ashwin. On Tue, Jul 12, 2016 at 11:17 AM, Devendra Tagare wrote: > All, > > We have

[GitHub] apex-malhar pull request #298: [APEXMALHAR-2086] Kafka output operator: 0.9....

Github user sandeshh closed the pull request at: https://github.com/apache/apex-malhar/pull/298 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

Re: A proposal for Malhar

My vote is to do 2&3 Thks Amol On Tue, Jul 12, 2016 at 12:14 PM, Kottapalli, Venkatesh < vkottapa...@directv.com> wrote: > +1 for deprecating the packages listed below. > > -Original Message- > From: hsy...@gmail.com [mailto:hsy...@gmail.com] > Sent: Tuesday, July 12, 2016 12:01 PM > >

Re: A proposal for Malhar

+1 for options 2 and 3 On Tue, Jul 12, 2016 at 12:14 PM, Kottapalli, Venkatesh < vkottapa...@directv.com> wrote: > +1 for deprecating the packages listed below. > > -Original Message- > From: hsy...@gmail.com [mailto:hsy...@gmail.com] > Sent: Tuesday, July 12, 2016 12:01 PM > > +1 > > On

[jira] [Commented] (APEXMALHAR-2086) Kafka Output Operator with Kafka 0.9 API

[ https://issues.apache.org/jira/browse/APEXMALHAR-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373603#comment-15373603 ] ASF GitHub Bot commented on APEXMALHAR-2086: GitHub user sandeshh reopened a pull

[jira] [Commented] (APEXMALHAR-2086) Kafka Output Operator with Kafka 0.9 API

[ https://issues.apache.org/jira/browse/APEXMALHAR-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373602#comment-15373602 ] ASF GitHub Bot commented on APEXMALHAR-2086: Github user sandeshh closed the pull request

[GitHub] apex-malhar pull request #298: [APEXMALHAR-2086] Kafka output operator: 0.9....

GitHub user sandeshh reopened a pull request: https://github.com/apache/apex-malhar/pull/298 [APEXMALHAR-2086] Kafka output operator: 0.9.0 Kafka output exactly once operator and the regular output operator. You can merge this pull request into a Git repository by running:

[GitHub] apex-site pull request #42: Added updating documentation to release process

Github user PramodSSImmaneni commented on a diff in the pull request: https://github.com/apache/apex-site/pull/42#discussion_r70510870 --- Diff: src/md/release.md --- @@ -150,6 +150,47 @@ mkdir svn-dist && cp *-source-* svn-dist/ svn import svn-dist

[GitHub] apex-site pull request #42: Added updating documentation to release process

Github user PramodSSImmaneni commented on a diff in the pull request: https://github.com/apache/apex-site/pull/42#discussion_r70510813 --- Diff: src/md/release.md --- @@ -150,6 +150,47 @@ mkdir svn-dist && cp *-source-* svn-dist/ svn import svn-dist

[GitHub] apex-site pull request #42: Added updating documentation to release process

Github user tweise commented on a diff in the pull request: https://github.com/apache/apex-site/pull/42#discussion_r70504749 --- Diff: src/md/release.md --- @@ -150,6 +150,47 @@ mkdir svn-dist && cp *-source-* svn-dist/ svn import svn-dist

[GitHub] apex-site pull request #42: Added updating documentation to release process

Github user tweise commented on a diff in the pull request: https://github.com/apache/apex-site/pull/42#discussion_r70504409 --- Diff: src/md/release.md --- @@ -150,6 +150,47 @@ mkdir svn-dist && cp *-source-* svn-dist/ svn import svn-dist

[GitHub] apex-site pull request #42: Added updating documentation to release process

Github user tweise commented on a diff in the pull request: https://github.com/apache/apex-site/pull/42#discussion_r70504287 --- Diff: src/md/release.md --- @@ -150,6 +150,47 @@ mkdir svn-dist && cp *-source-* svn-dist/ svn import svn-dist

RE: A proposal for Malhar

+1 for deprecating the packages listed below. -Original Message- From: hsy...@gmail.com [mailto:hsy...@gmail.com] Sent: Tuesday, July 12, 2016 12:01 PM +1 On Tue, Jul 12, 2016 at 11:53 AM, David Yan wrote: > Hi all, > > I would like to renew the discussion of

Re: A proposal for Malhar

+1 On Tue, Jul 12, 2016 at 11:53 AM, David Yan wrote: > Hi all, > > I would like to renew the discussion of retiring operators in Malhar. > > As stated before, the reason why we would like to retire operators in > Malhar is because some of them were written a long time

[GitHub] apex-malhar pull request #327: Review-Only WindowedStream API

Github user siyuanh closed the pull request at: https://github.com/apache/apex-malhar/pull/327 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Assigned] (APEXMALHAR-2137) Create an Integrated With page

[ https://issues.apache.org/jira/browse/APEXMALHAR-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sasha Parfenov reassigned APEXMALHAR-2137: -- Assignee: Sasha Parfenov > Create an Integrated With page >

ApacheCon Europe Call For Papers Open

As you are no doubt already aware, we will be holding ApacheCon in Seville, Spain, the week of November 14th, 2016. The call for papers (CFP) for this event is now open, and will remain open until September 9th. The event is divided into two parts, each with its own CFP. The first part of the

Partitionable,Idempotent & Pollable JDBCInput

All, We have created a JDBCPollInputOperator with the below features, 1. poll from external jdbc store asynchronously in the input operator. 2. polling frequency and batch size are configurable. 3.User can specify the polling query 4.User can specify the columns to fetch as a part of the result

[jira] [Commented] (APEXMALHAR-2066) Add jdbc poller input operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373332#comment-15373332 ] ASF GitHub Bot commented on APEXMALHAR-2066: Github user devtagare commented on a diff in

[GitHub] apex-malhar pull request #282: APEXMALHAR-2066 JdbcPolling,idempotent,partit...

Github user devtagare commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/282#discussion_r70488149 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcPollInputOperator.java --- @@ -0,0 +1,652 @@ +/** + * Licensed to the

[GitHub] apex-malhar pull request #282: APEXMALHAR-2066 JdbcPolling,idempotent,partit...

Github user devtagare commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/282#discussion_r70483447 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/JdbcMetaDataUtility.java --- @@ -0,0 +1,344 @@ +/** + * Licensed to the Apache

[jira] [Commented] (APEXMALHAR-2066) Add jdbc poller input operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373298#comment-15373298 ] ASF GitHub Bot commented on APEXMALHAR-2066: Github user devtagare commented on a diff in

[jira] [Commented] (APEXMALHAR-2066) Add jdbc poller input operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373297#comment-15373297 ] ASF GitHub Bot commented on APEXMALHAR-2066: Github user devtagare commented on a diff in

[GitHub] apex-malhar pull request #282: APEXMALHAR-2066 JdbcPolling,idempotent,partit...

Github user devtagare commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/282#discussion_r70483210 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/JdbcMetaDataUtility.java --- @@ -0,0 +1,344 @@ +/** + * Licensed to the Apache

[GitHub] apex-malhar pull request #282: APEXMALHAR-2066 JdbcPolling,idempotent,partit...

Github user devtagare commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/282#discussion_r70483252 --- Diff: library/src/main/java/com/datatorrent/lib/db/jdbc/JdbcMetaDataUtility.java --- @@ -0,0 +1,344 @@ +/** + * Licensed to the Apache

[jira] [Updated] (APEXMALHAR-2140) Move ActiveFieldInfo class to com.datatorrent.lib.util

[ https://issues.apache.org/jira/browse/APEXMALHAR-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yunhan Wang updated APEXMALHAR-2140: Assignee: devendra tagare > Move ActiveFieldInfo class to com.datatorrent.lib.util >

[jira] [Created] (APEXCORE-490) Apex CLI tab completion based on the context

Sandesh created APEXCORE-490: Summary: Apex CLI tab completion based on the context Key: APEXCORE-490 URL: https://issues.apache.org/jira/browse/APEXCORE-490 Project: Apache Apex Core Issue

[jira] [Updated] (APEXCORE-482) Default Unifiers should be ThreadLocal with downstream operators

[ https://issues.apache.org/jira/browse/APEXCORE-482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandesh updated APEXCORE-482: - Description: Default Unifiers are currently deployed ( except in Mx1 ) as CONTAINER_LOCAL with the

[jira] [Updated] (APEXCORE-482) Default Unifiers should be ThreadLocal with downstream operators

[ https://issues.apache.org/jira/browse/APEXCORE-482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandesh updated APEXCORE-482: - Description: Default Unifiers are currently deployed ( except in Mx1 ) as CONTAINER_LOCAL with the

[jira] [Updated] (APEXCORE-482) Default Unifiers should be ThreadLocal with downstream operators

[ https://issues.apache.org/jira/browse/APEXCORE-482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandesh updated APEXCORE-482: - Description: Default Unifiers are currently deployed ( except in Mx1 ) as CONTAINER_LOCAL with the

[jira] [Assigned] (APEXCORE-482) Default Unifiers should be ThreadLocal with downstream operators

[ https://issues.apache.org/jira/browse/APEXCORE-482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandesh reassigned APEXCORE-482: Assignee: Sandesh > Default Unifiers should be ThreadLocal with downstream operators >

Re: Bleeding edge branch ?

-0 I read the thread twice, it is not clear to me what benefit Apex users derive from this exercise. A branch normally contains development work that is eventually brought back to the main line and into a release. Here, the suggestion seems to be an open ended effort to play with latest tech,

[jira] [Commented] (APEXMALHAR-2066) Add jdbc poller input operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372281#comment-15372281 ] ASF GitHub Bot commented on APEXMALHAR-2066: Github user bhupeshchawda commented on a

[GitHub] apex-malhar pull request #282: APEXMALHAR-2066 JdbcPolling,idempotent,partit...

Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/282#discussion_r70385310 --- Diff: library/src/test/java/com/datatorrent/lib/db/jdbc/JdbcPollerTest.java --- @@ -0,0 +1,246 @@ +/** + * Licensed to the Apache

Re: Bleeding edge branch ?

I'm -0 on this idea. Here is the reason: Unless we see a real case where users want to see everything on latest, this branch might quickly become low hanging fruit and eventually get obsolete because its anyway a "no gaurantee" branch. We have a bunch of dependencies which we'll have to take

Re: Getting partition null or empty error @Apache Apex-Kafka Integration

Hi Tushar I am able to telnet zookeeper service from every node in the cluster. On Tue, Jul 12, 2016 at 11:26 AM, Tushar Gosavi wrote: > Hi Anuj, > > I have observed similar problem in the past. most probably the > application master is unable to connect to kafka

Re: Bleeding edge branch ?

+1 for creating such branch. One of us will have to rebase it with master branch at intervals. I don't think everyone will cherry-pick their commits here. We can make it once in a month activity. Are we considering updating all dependency library version as well? -Priyanka On Tue, Jul 12, 2016