Re: Contribution and committer guidelines

2019-01-27 Thread Chinmay Kolhatkar
+1. On Sat, 26 Jan 2019, 11:56 pm amol kekre +1 for this proposal. The only caveat I have is > -> "acceptable performance and resolving logical flaws identified during > the review process" > > is subjective. Functionally working should cover any logical issues. > Performance should be

Re: Proposal for UI component in stram

2018-06-16 Thread Chinmay Kolhatkar
Chinmay Kolhatkar wrote: > Hi All, > > I've created following jiras encompassing the requirements (To be picked > up in order): > https://issues.apache.org/jira/browse/APEXMALHAR-2558 > https://issues.apache.org/jira/browse/APEXMALHAR-2559 > > I'll start adding subtask

[jira] [Created] (APEXMALHAR-2564) Extend the UI Console to show physical operator info

2018-06-16 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXMALHAR-2564: - Summary: Extend the UI Console to show physical operator info Key: APEXMALHAR-2564 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2564

[jira] [Created] (APEXMALHAR-2562) Update backend to serve console UI from stram

2018-06-16 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXMALHAR-2562: - Summary: Update backend to serve console UI from stram Key: APEXMALHAR-2562 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2562 Project

[jira] [Created] (APEXMALHAR-2563) Extend the UI Console to show logical operator info

2018-06-16 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXMALHAR-2563: - Summary: Extend the UI Console to show logical operator info Key: APEXMALHAR-2563 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2563 Project

[jira] [Created] (APEXMALHAR-2561) Update build steps for release build

2018-06-16 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXMALHAR-2561: - Summary: Update build steps for release build Key: APEXMALHAR-2561 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2561 Project: Apache Apex

[jira] [Created] (APEXMALHAR-2560) Create react project which shows application level information

2018-06-16 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXMALHAR-2560: - Summary: Create react project which shows application level information Key: APEXMALHAR-2560 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2560

Re: Proposal for UI component in stram

2018-06-16 Thread Chinmay Kolhatkar
branch shortly so that we can start working against it. -Chinmay. On Sat, Jun 16, 2018 at 7:07 PM Chinmay Kolhatkar wrote: > So here is how it'll be: > 1. ReactJS application can be compiled for production builds. The output > is set of html+css+compressed js files. It can also out

[jira] [Created] (APEXMALHAR-2559) Add operational elements to UI Console

2018-06-16 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXMALHAR-2559: - Summary: Add operational elements to UI Console Key: APEXMALHAR-2559 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2559 Project: Apache

[jira] [Assigned] (APEXMALHAR-2559) Add operational elements to UI Console

2018-06-16 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXMALHAR-2559: - Assignee: (was: Chinmay Kolhatkar) > Add operational eleme

[jira] [Assigned] (APEXMALHAR-2558) Create UI Console for showing realtime apex app information

2018-06-16 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXMALHAR-2558: - Assignee: Chinmay Kolhatkar > Create UI Console for show

[jira] [Created] (APEXMALHAR-2558) Create UI Console for showing realtime apex app information

2018-06-16 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXMALHAR-2558: - Summary: Create UI Console for showing realtime apex app information Key: APEXMALHAR-2558 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2558

Re: Proposal for UI component in stram

2018-06-16 Thread Chinmay Kolhatkar
ay > > information in a browser, where they will be hosted is irrelevant. They > > can be hosted by stram, but it should be possible to host them > > externally without making modificaitons. If this is the case, I don't > > have any objections to the proposal. > > >

Re: Proposal for UI component in stram

2018-06-13 Thread Chinmay Kolhatkar
ozov > wrote: > > > > > > > >> Clarification: I am -0 on making UI part of the stram. I am +1 on > > > >> providing reference webUI application outside of the stram. > > > >> > > > >> Thank you, > > > >> > > >

Proposal for UI component in stram

2018-06-06 Thread Chinmay Kolhatkar
Hi Community, I want to propose a feature in apex-core to have a UI component in stram. This is influenced by how basic runtime information is shown on UI by spark. This includes following features: 1. Webpage will be hosted by stram and will be available for user to view in one of the two ways

Re: [ANNOUNCE] New Apache Apex PMC Member: Chinmay Kolhatkar

2018-06-05 Thread Chinmay Kolhatkar
gt; >> > > > > > >> >> On Thu, May 24, 2018 at 10:34 AM, Hitesh Kapoor < > > > > > forhitesh...@gmail.com > > > > > >> > > > > > > >> >> wrote: > > > > > >> >> > > > > > >> >>> Congra

Re: [RESULT] [VOTE] Apache Apex Core Release 3.7.0 (RC1)

2018-05-13 Thread Chinmay Kolhatkar
ince we don't have the docker files in apex-core/release-3.7, my > suggestion to create the branch in your repo, as done till now. > > You can still pilot the build for the latest image from apex-core/master > > Thanks > > > On Wed, May 9, 2018 at 7:38 AM, Chinmay Kolhatkar < >

Re: [Feature Proposal] Add metrics dropwizards like gauges, meters, histogram etc to Apex Platform

2018-05-09 Thread Chinmay Kolhatkar
+1 for approach 1. As Thomas mentioned, I think there metrics layer should be abstracted out from its implementation. This way one can plugin different metrics systems in apex. Also keep in mind that there is a lot of code which uses AutoMetrics annotations. We should help a smooth transition

Re: [RESULT] [VOTE] Apache Apex Core Release 3.7.0 (RC1)

2018-05-09 Thread Chinmay Kolhatkar
Yes Thomas. I'm going to create a docker image. I was hoping that I can create the docker for 3.7.0 from new changes in master which pulls dist atrato instead of creating from my repo. This will act as a pilot for building docker from apex-core repo as well. Let me know if this is fine. Regards,

[jira] [Assigned] (APEXCORE-289) Encrypted Streams in Apex DAG

2018-05-07 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXCORE-289: -- Assignee: (was: Chinmay Kolhatkar) > Encrypted Streams in Apex

[jira] [Assigned] (APEXMALHAR-1979) Ability to generate compiled class from given json schema

2018-05-07 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-1979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXMALHAR-1979: - Assignee: (was: Chinmay Kolhatkar) > Ability to gener

[jira] [Assigned] (APEXMALHAR-2053) Add utility for making schema dynamically configuration to DAG via populateDAG

2018-05-07 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXMALHAR-2053: - Assignee: (was: Chinmay Kolhatkar) > Add utility for mak

[jira] [Assigned] (APEXCORE-623) Schema propagation support in Apex

2018-05-07 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXCORE-623: -- Assignee: (was: Chinmay Kolhatkar) > Schema propagation support in A

[jira] [Commented] (APEXCORE-813) Update docker build steps to use apex bin dist package

2018-05-07 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466285#comment-16466285 ] Chinmay Kolhatkar commented on APEXCORE-813: [~thw] and others (I wish, there was a way

[jira] [Assigned] (APEXCORE-812) Update Docker Hub build account with build src from apache repository

2018-05-07 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXCORE-812: -- Assignee: Chinmay Kolhatkar > Update Docker Hub build account with build

[jira] [Assigned] (APEXCORE-813) Update docker build steps to use apex bin dist package

2018-05-07 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXCORE-813: -- Assignee: Chinmay Kolhatkar > Update docker build steps to use apex bin d

[jira] [Created] (APEXCORE-814) Rename envvar DT_CLIENT_OPTS to APEX_CLIENT_OPTS

2018-05-06 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXCORE-814: -- Summary: Rename envvar DT_CLIENT_OPTS to APEX_CLIENT_OPTS Key: APEXCORE-814 URL: https://issues.apache.org/jira/browse/APEXCORE-814 Project: Apache Apex

[jira] [Created] (APEXCORE-813) Update docker build steps to generate apex deb from dist binary package from apex-core repo

2018-05-05 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXCORE-813: -- Summary: Update docker build steps to generate apex deb from dist binary package from apex-core repo Key: APEXCORE-813 URL: https://issues.apache.org/jira/browse

[jira] [Created] (APEXCORE-812) Update Docker Hub build account with build src from apache repository

2018-05-05 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXCORE-812: -- Summary: Update Docker Hub build account with build src from apache repository Key: APEXCORE-812 URL: https://issues.apache.org/jira/browse/APEXCORE-812

[jira] [Created] (APEXCORE-811) Move docker build sourcecode from private repository to apex-core repo

2018-05-05 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXCORE-811: -- Summary: Move docker build sourcecode from private repository to apex-core repo Key: APEXCORE-811 URL: https://issues.apache.org/jira/browse/APEXCORE-811

[jira] [Updated] (APEXCORE-729) Include an example in the apex core release binary

2018-05-03 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar updated APEXCORE-729: --- Summary: Include an example in the apex core release binary (was: Include

[jira] [Updated] (APEXCORE-729) Include an example in the release

2018-05-03 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar updated APEXCORE-729: --- Issue Type: Task (was: Sub-task) Parent: (was: APEXCORE-727) > Incl

[jira] [Commented] (APEXCORE-729) Include an example in the release

2018-05-03 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463263#comment-16463263 ] Chinmay Kolhatkar commented on APEXCORE-729: I suggest we make this as a top level task

[jira] [Assigned] (APEXCORE-728) Include licenses for dependencies

2018-05-03 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXCORE-728: -- Assignee: Chinmay Kolhatkar > Include licenses for dependenc

[jira] [Assigned] (APEXCORE-731) Modifications to the build to generate binary package

2018-05-03 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXCORE-731: -- Assignee: Chinmay Kolhatkar (was: Thomas Weise) > Modificati

[jira] [Assigned] (APEXCORE-729) Include an example in the release

2018-05-03 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXCORE-729: -- Assignee: Chinmay Kolhatkar > Include an example in the rele

[jira] [Assigned] (APEXCORE-727) Create and publish binary releases along with the source releases

2018-05-03 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXCORE-727: -- Assignee: Chinmay Kolhatkar (was: Pramod Immaneni) > Create and publ

Apex-core build/release steps improvements proposal

2018-05-03 Thread Chinmay Kolhatkar
Hello Community, I want to propose following improvements for apex-core build and related steps: 1. Most (probably all of the open source project) has the a binary release package of the software and not just the source release package. Currently we have only source package. Luckily there are

Re: Core release 3.7.0

2018-01-18 Thread Chinmay Kolhatkar
+1 for the release. - Chinmay. On 18 Jan 2018 8:58 pm, "Tushar Gosavi" wrote: > +1 for the release > > Regards, > - Tushar. > > > On Thu, Jan 18, 2018 at 3:28 AM, Amol Kekre wrote: > > > +1 > > > > Thks, > > Amol > > > > > > E:a...@datatorrent.com

Re: [ANNOUNCE] New Apache Apex PMC: Tushar Gosavi

2017-11-03 Thread Chinmay Kolhatkar
Congrats Tushar!! On Fri, Nov 3, 2017 at 10:21 PM, Chaitanya Chebolu < chaita...@datatorrent.com> wrote: > Congratulations Tushar!!! > > On Fri, Nov 3, 2017 at 10:06 PM, Venkatesh Kottapalli < > venkat...@datatorrent.com> wrote: > > > Congratulations Tushar! > > > > -Venky > > > > On Fri, Nov

Re: [ANNOUNCE] New Apache Apex Committer: Ananth Gundabattula

2017-11-03 Thread Chinmay Kolhatkar
Congrats Ananth!! On Fri, Nov 3, 2017 at 2:37 PM, Priyanka Gugale wrote: > Congrats Ananth!! > > -Priyanka > > On Fri, Nov 3, 2017 at 2:20 PM, Thomas Weise wrote: > > > The Project Management Committee (PMC) for Apache Apex is pleased to > > announce Ananth

Re: Malhar release 3.8.0

2017-10-25 Thread Chinmay Kolhatkar
+1. - Chinmay. On 25 Oct 2017 9:20 pm, "Chaitanya Chebolu" wrote: > +1 on new release. > > Thanks, > > On Wed, Oct 25, 2017 at 9:09 PM, Vlad Rozov wrote: > > > +1. > > > > Thank you, > > > > Vlad > > > > > > On 10/25/17 08:21, Amol Kekre wrote: >

Re: Package tarball as deliverable of apex-core

2017-08-07 Thread Chinmay Kolhatkar
; > -Priyanka > > On Tue, Aug 8, 2017 at 8:34 AM, Chinmay Kolhatkar <chin...@datatorrent.com > > > wrote: > > > Dear Community, > > > > Currently Apache Apex does not have a deliverable tarball which bundles > the > > dependent jars and apex cli which

Package tarball as deliverable of apex-core

2017-08-07 Thread Chinmay Kolhatkar
Dear Community, Currently Apache Apex does not have a deliverable tarball which bundles the dependent jars and apex cli which user can just download and get started with. Having this would be also be useful for current integration with Apache Bigtop as well. Currently in bigtop, the bigtop build

Re: Input needed for ApexCli.

2017-08-07 Thread Chinmay Kolhatkar
+1 for the best effort with warnings. On Sun, Aug 6, 2017 at 9:19 PM, Pradeep Kumbhar wrote: > +1 for the best effort with warnings as default behavior and an optional > flag for Validate & Fail (Ajay's suggestion) > > > On Sun, Aug 6, 2017 at 12:14 PM, Mohit Jotwani

[jira] [Commented] (APEXCORE-740) Setup plugins does not identify operator classes because they're loaded through different classloaders

2017-06-04 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036569#comment-16036569 ] Chinmay Kolhatkar commented on APEXCORE-740: RCA: StramAppLauncher.loadDependencies

[jira] [Created] (APEXCORE-740) Setup plugins does not identify operator classes because they're loaded through different plugin classloaders

2017-06-04 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXCORE-740: -- Summary: Setup plugins does not identify operator classes because they're loaded through different plugin classloaders Key: APEXCORE-740 URL: https

[jira] [Updated] (APEXCORE-740) Setup plugins does not identify operator classes because they're loaded through different classloaders

2017-06-04 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar updated APEXCORE-740: --- Summary: Setup plugins does not identify operator classes because they're loaded

Re: Maintenance of Bigtop Apex component

2017-06-04 Thread Chinmay Kolhatkar
Hi Thomas, Even I'm currently occupied and won't be able to work on this as of now. Also, you're already collaborator on docker-pool repository. -Chinmay. On Sat, Jun 3, 2017 at 3:08 PM, Aniruddha Thombare < anirud...@datatorrent.com> wrote: > Hi, > > I'm currently preoccupied, won't be able

Re: impersonation and application path

2017-05-18 Thread Chinmay Kolhatkar
+1 for pramod's proposal. On 19-May-2017 4:51 AM, "Sanjay Pujare" wrote: > +1 for Pramod's proposal for impersonation. > > I have an issue with Sandesh's suggestion about making the new behavior as > the default (or only) behavior. This will introduce incompatibility

[jira] [Commented] (APEXCORE-720) In DAGExecution plugin, Context.getDAG returns null

2017-05-12 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007939#comment-16007939 ] Chinmay Kolhatkar commented on APEXCORE-720: RCA: Plugin event of type

[jira] [Created] (APEXCORE-720) In DAGExecution plugin, Context.getDAG returns null

2017-05-12 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXCORE-720: -- Summary: In DAGExecution plugin, Context.getDAG returns null Key: APEXCORE-720 URL: https://issues.apache.org/jira/browse/APEXCORE-720 Project: Apache

Re: Proposal to upgrade Apex Core dependency in Malhar to 3.6

2017-05-12 Thread Chinmay Kolhatkar
+1 On Fri, May 12, 2017 at 1:41 PM, Mohit Jotwani wrote: > +1 > > Regards, > Mohit > > On Fri, May 12, 2017 at 10:49 AM, Bhupesh Chawda > wrote: > > > +1 > > > > ~ Bhupesh > > > > > > ___ > > >

[jira] [Assigned] (APEXMALHAR-2296) Apex SQL: Add support for SQL GROUP BY (Aggregate RelNode)

2017-04-07 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXMALHAR-2296: - Assignee: (was: Chinmay Kolhatkar) > Apex SQL: Add supp

[jira] [Assigned] (APEXMALHAR-2295) Apex SQL: Replace POJOInnerJoinOperator with WindowedJoinOperator

2017-04-07 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXMALHAR-2295: - Assignee: (was: Chinmay Kolhatkar) > Apex SQL: Repl

[jira] [Assigned] (APEXMALHAR-2294) Apex SQL: Make operator names user friendly for user to configure via properties.xml

2017-04-07 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXMALHAR-2294: - Assignee: (was: Chinmay Kolhatkar) > Apex SQL: Make opera

[jira] [Assigned] (APEXMALHAR-2293) Apex SQL: Add sql line cli to sql support of apex

2017-04-07 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXMALHAR-2293: - Assignee: (was: Chinmay Kolhatkar) > Apex SQL: Add sql line

[jira] [Assigned] (APEXMALHAR-2292) Apex SQL: Add generic endpoint to malhar-sql

2017-04-07 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXMALHAR-2292: - Assignee: (was: Chinmay Kolhatkar) > Apex SQL: Add gene

[jira] [Resolved] (APEXMALHAR-2453) Add sort Accumulation for Windowed operator

2017-03-29 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar resolved APEXMALHAR-2453. --- Resolution: Done Fix Version/s: 3.8.0 > Add sort Accumulat

[jira] [Updated] (APEXMALHAR-2453) Add sort Accumulation for Windowed operator

2017-03-29 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar updated APEXMALHAR-2453: -- Summary: Add sort Accumulation for Windowed operator (was: Sort

[jira] [Updated] (APEXMALHAR-2453) Sort Accumulation for Windowed operator

2017-03-29 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar updated APEXMALHAR-2453: -- Issue Type: New Feature (was: Task) > Sort Accumulation for Windo

[jira] [Resolved] (APEXMALHAR-2430) Optimize Join accumulation by changing the data structure in accumulation method

2017-03-10 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar resolved APEXMALHAR-2430. --- Resolution: Done Fix Version/s: 3.7.0 > Optimize J

[jira] [Resolved] (APEXMALHAR-2429) Ambiguity in passing "key" parameter to Join accumulation

2017-03-08 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar resolved APEXMALHAR-2429. --- Resolution: Done Fix Version/s: 3.7.0 > Ambiguity in passing &

[jira] [Closed] (APEXMALHAR-2437) Malhar build - ratcheck failing

2017-03-07 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar closed APEXMALHAR-2437. - Resolution: Invalid > Malhar build - ratcheck fail

[jira] [Created] (APEXMALHAR-2437) Malhar build - ratcheck failing

2017-03-07 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXMALHAR-2437: - Summary: Malhar build - ratcheck failing Key: APEXMALHAR-2437 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2437 Project: Apache Apex Malhar

Malhar build failing

2017-03-07 Thread Chinmay Kolhatkar
Hi, I'm finding malhar build to fail because of rat check failing in demos/ folder. Moreover, I cannot see demos/ folder in https://github.com/apache/apex-malhar I want to confirm whether its in apache repository itself OR its my environment issue. Please reply. Thanks, Chinmay.

[jira] [Resolved] (APEXMALHAR-2413) Improve PojoInnerJoin Accumulation

2017-03-01 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar resolved APEXMALHAR-2413. --- Resolution: Done Fix Version/s: 3.7.0 > Improve PojoInnerJ

Re: Proposal: CompositeAccumulation for Windowed Operator

2017-02-27 Thread Chinmay Kolhatkar
t; > > > * accumulations.getSubOutput(maxTag, outputValues)* > > > > *accumulations.getSubOutput(minTag, outputValues)* > > > > > > Thanks > > > > Bright > > > > On Sun, Feb 26, 2017 at 10:33 PM, Chinmay Kolhatkar < >

Re: Java packages: legacy -> org.apache.apex

2017-02-27 Thread Chinmay Kolhatkar
Thomas, I agree with you that we need this migration to be done but I have a different opinion on how to execute this. I think if we do this in phases as described above, users might end up in more confusion. For doing this migration, I think it should follow these steps: 1. Whether for operator

Re: [Community Opinion] Use of Lombok Library

2017-02-22 Thread Chinmay Kolhatkar
Certainly good and convenient for application/operator developers to use. But could someone include this dependency in apex application project and use it? If yes, then I would prefer to keep this outside of Apex in general and let the user use it for convenience. -Chinmay. On Wed, Feb 22,

[jira] [Assigned] (APEXMALHAR-2413) Improve PojoInnerJoin Accumulation

2017-02-21 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXMALHAR-2413: - Assignee: Hitesh Kapoor (was: Chinmay Kolhatkar) > Impr

[jira] [Assigned] (APEXMALHAR-2414) Improve performance of PojoInnerJoin accum by using PojoUtils

2017-02-21 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXMALHAR-2414: - Assignee: (was: Chinmay Kolhatkar) > Improve performa

[jira] [Assigned] (APEXMALHAR-2414) Improve performance of PojoInnerJoin accum by using PojoUtils

2017-02-17 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXMALHAR-2414: - Assignee: Chinmay Kolhatkar > Improve performance of PojoInnerJ

[jira] [Created] (APEXMALHAR-2414) Improve performance of PojoInnerJoin accum by using PojoUtils

2017-02-16 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXMALHAR-2414: - Summary: Improve performance of PojoInnerJoin accum by using PojoUtils Key: APEXMALHAR-2414 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2414

[jira] [Created] (APEXMALHAR-2415) Enable PojoInnerJoin accum to allow multiple keys for join purpose

2017-02-16 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXMALHAR-2415: - Summary: Enable PojoInnerJoin accum to allow multiple keys for join purpose Key: APEXMALHAR-2415 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2415

[jira] [Updated] (APEXMALHAR-2409) Improve PojoInnerJoin accumulation to emit a POJO instead of Map

2017-02-16 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar updated APEXMALHAR-2409: -- Issue Type: Sub-task (was: Improvement) Parent: APEXMALHAR-2413

[jira] [Created] (APEXMALHAR-2413) Improve PojoInnerJoin Accumulation

2017-02-16 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXMALHAR-2413: - Summary: Improve PojoInnerJoin Accumulation Key: APEXMALHAR-2413 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2413 Project: Apache Apex

Re: PojoInnerJoin Accumulation emitting Map

2017-02-16 Thread Chinmay Kolhatkar
APEXMALHAR-2409 Created. I'll create a PR soon. On Wed, Feb 15, 2017 at 10:31 PM, Chinmay Kolhatkar <chin...@datatorrent.com > wrote: > Thanks guys. I'll create a jira and create a PR for it soon. > > Ajay, btw this is not much related to Schema discovery design... This is

[jira] [Created] (APEXMALHAR-2409) Improve PojoInnerJoin accumulation to emit a POJO instead of Map

2017-02-16 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXMALHAR-2409: - Summary: Improve PojoInnerJoin accumulation to emit a POJO instead of Map Key: APEXMALHAR-2409 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2409

Re: APEXMALHAR-2400 In PojoInnerJoin accumulation same field names are emitted as single field

2017-02-15 Thread Chinmay Kolhatkar
I agree with the requirement. But I think the requirement here is superceed by requirement at https://lists.apache.org/thread.html/d1e282047399558a4f04aab186c0d986114d353dcaf6d6c76a2a3a35@%3Cdev.apex.apache.org%3E Having PojoInnerJoin to emit a POJO instead of map overrides this. I suggest to do

Re: PojoInnerJoin Accumulation emitting Map

2017-02-15 Thread Chinmay Kolhatkar
t 7:34 AM, AJAY GUPTA <ajaygit...@gmail.com> wrote: > > > Yes, it should be emitting a POJO. This POJO can then be further used to > > join with a third POJO stream, thus behaving like a DB join. > > > > It would be best if we can incorporate this into Schema Disc

PojoInnerJoin Accumulation emitting Map

2017-02-15 Thread Chinmay Kolhatkar
Dear Community, Currently PojoInnerJoin accumulation is accepting 2 POJOs but emitting a Map. I think it should be emitting POJO instead of Map. Please share your thoughts about this. Thanks, Chinmay.

[jira] [Resolved] (APEXMALHAR-2399) In PojoInnerJoin accumulation default constructor is directly throwing an exception which messes up in default serialization.

2017-02-15 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar resolved APEXMALHAR-2399. --- Resolution: Fixed Fix Version/s: 3.7.0 > In PojoInnerJ

Re: Schema Discovery Support in Apex Applications

2017-01-30 Thread Chinmay Kolhatkar
er properties of the > data that can be useful by the schema receiver to process the data (for > instance, a delimiter for CSV record stream). > > Thanks, > Sergey > > On 2017-01-25 01:47 (-0800), Chinmay Kolhatkar <chin...@datatorrent.com> > wrote: > > Thank you all f

Re: One Yarn with Multiple Apex Applications

2017-01-30 Thread Chinmay Kolhatkar
Hi Santhosh, It seems that your YARN does not have enough resources available for allocating memory for 2 application. When you kill the first application, the memory is regained by yarn and then allocated to the second application. You can try to give more memory to yarn if your system allows

[jira] [Commented] (APEXCORE-623) Schema propagation support in Apex

2017-01-25 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15838061#comment-15838061 ] Chinmay Kolhatkar commented on APEXCORE-623: Design doc: https://docs.google.com/document/d

[jira] [Commented] (APEXCORE-623) Schema propagation support in Apex

2017-01-25 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15838050#comment-15838050 ] Chinmay Kolhatkar commented on APEXCORE-623: Discussion on mailing list: https

Re: Schema Discovery Support in Apex Applications

2017-01-25 Thread Chinmay Kolhatkar
ache.org> wrote: > +1 to have this feature. > > -Priyanka > > On Tue, Jan 17, 2017 at 9:18 PM, Pramod Immaneni <pra...@datatorrent.com> > wrote: > > > +1 > > > > On Mon, Jan 16, 2017 at 1:23 AM, Chinmay Kolhatkar <chin...@apache.org> > > wro

[jira] [Created] (APEXCORE-623) Schema propagation support in Apex

2017-01-25 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXCORE-623: -- Summary: Schema propagation support in Apex Key: APEXCORE-623 URL: https://issues.apache.org/jira/browse/APEXCORE-623 Project: Apache Apex Core

Re: Upgrade Apache Bigtop to Apex Core 3.5.0

2017-01-24 Thread Chinmay Kolhatkar
; > > Thks > > Amol > > > > > > On Thu, Jan 19, 2017 at 8:55 PM, Priyanka Gugale < > priya...@datatorrent.com > > > > > wrote: > > > > > +1 > > > > > > On Fri, Jan 20, 2017 at 9:25 AM, Chinmay Kolhatkar < > >

Re: Upgrade Apache Bigtop to Apex Core 3.5.0

2017-01-19 Thread Chinmay Kolhatkar
org/ ? > > On 1/19/17, 8:12 AM, "Pramod Immaneni" <pra...@datatorrent.com> wrote: > > +1 > > On Thu, Jan 19, 2017 at 12:53 AM, Chinmay Kolhatkar < > chin...@datatorrent.com > > wrote: > > > Dear Community, > > >

Re: Upgrade Apache Bigtop to Apex Core 3.5.0

2017-01-19 Thread Chinmay Kolhatkar
_ > Sent with difficulty, I mean handheld ;) > > On 19 Jan 2017 2:28 pm, "Tushar Gosavi" <tus...@datatorrent.com> wrote: > > > +1 for including Apex 3.5 in Bigtop. > > > > - Tushar. > > > > > > On Thu, Jan 19, 2017 at 2:23 PM, Chi

Upgrade Apache Bigtop to Apex Core 3.5.0

2017-01-19 Thread Chinmay Kolhatkar
Dear Community, Now that Apex core 3.5.0 is released, is it good time to upgrade Apache Bigtop for Apex to 3.5.0? -Chinmay.

Re: Shutdown of an Apex app

2017-01-17 Thread Chinmay Kolhatkar
+1 for the feature in general. Though I have a question about it: Lets say 10th operator in the DAG initiates the shutdown.. And operator being in quite downstream as compared to Input Operator, it might be fairly behind in window it is processing. What happens to the data being already processed

Re: Contribution Process before PR

2017-01-16 Thread Chinmay Kolhatkar
I agree that the discussions are important. There are currently discussions being happening over mailing list but some topics might be get missed and we should improve there. The tasks should be brought to community before the design starts and then mature the design through community discussion.

Re: Schema Discovery Support in Apex Applications

2017-01-16 Thread Chinmay Kolhatkar
er/operator developer would access the tuple object in case he wishes to > do something with it? > > > Ajay > > On Mon, Jan 16, 2017 at 2:53 PM, Chinmay Kolhatkar <chin...@apache.org> > wrote: > > > Hi All, > > > > Currently a DAG that is generated b

Schema Discovery Support in Apex Applications

2017-01-16 Thread Chinmay Kolhatkar
Hi All, Currently a DAG that is generated by user, if contains any POJOfied operators, TUPLE_CLASS attribute needs to be set on each and every port which receives or sends a POJO. For e.g., if a DAG is like File -> Parser -> Transform -> Dedup -> Formatter -> Kafka, then TUPLE_CLASS attribute

Re: APEXMALHAR-2382 User needs to create dt_meta table while using JdbcPOJOInsertOutputOperator

2017-01-15 Thread Chinmay Kolhatkar
-1 for automatic schema creation... Moreover, I am wondering whether asking user to create a dt_meta table is right way. From an admins perspective, an ask for creation of meta table looks wrong to me. dt_meta table is created for the purpose of exactly once but it does not hold any user data..

[jira] [Resolved] (APEXMALHAR-2259) Create Fixed Length Parser Operator

2017-01-10 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar resolved APEXMALHAR-2259. --- Resolution: Done Fix Version/s: 3.7.0 > Create Fixed Len

Re: Apex internal documentation.

2016-11-28 Thread Chinmay Kolhatkar
+1... Good to have. On Tue, Nov 29, 2016 at 11:42 AM, Devendra Tagare wrote: > +1 > > ~Dev > > On Mon, Nov 28, 2016 at 10:10 PM, Priyanka Gugale > wrote: > > > +1 for documenting this. > > > > I had covered the basic cycle of launch in couple of

  1   2   3   >