Re: Proposal for apex/malhar extensions

Do we have any projects today that can benefit from this setup? Earlier in this mail thread, we discussed "contrib (low bar) & graduation" in Malhar, that is not sufficient? On Wed, Nov 16, 2016 at 11:19 AM Chinmay Kolhatkar wrote: > @sanjay, yes we can define the process

Re: Proposal for apex/malhar extensions

Yes, I think it could be useful for core as well. On Wed, Nov 16, 2016 at 11:19 AM, Chinmay Kolhatkar wrote: > @sanjay, yes we can define the process around this. > > @pramod, Well, I said apex-malhar because the extensions can be operators > and and other plugins to apex

[jira] [Commented] (APEXMALHAR-2343) Count Accumulation should only increase one for each tuple

[ https://issues.apache.org/jira/browse/APEXMALHAR-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671408#comment-15671408 ] ASF GitHub Bot commented on APEXMALHAR-2343: Github user brightchen closed the pull

[GitHub] apex-malhar pull request #499: APEXMALHAR-2343 #resolve #comment Count Accum...

GitHub user brightchen opened a pull request: https://github.com/apache/apex-malhar/pull/499 APEXMALHAR-2343 #resolve #comment Count Accumulation should only incr… …ease one for each tuple You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (APEXMALHAR-2343) Count Accumulation should only increase one for each tuple

[ https://issues.apache.org/jira/browse/APEXMALHAR-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671464#comment-15671464 ] ASF GitHub Bot commented on APEXMALHAR-2343: GitHub user brightchen opened a pull

[GitHub] apex-malhar pull request #500: APEXMALHAR-2343 #resolve #comment Count Accum...

GitHub user brightchen opened a pull request: https://github.com/apache/apex-malhar/pull/500 APEXMALHAR-2343 #resolve #comment Count Accumulation should only incr… …ease one for each tuple You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (APEXMALHAR-2343) Count Accumulation should only increase one for each tuple

[ https://issues.apache.org/jira/browse/APEXMALHAR-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671373#comment-15671373 ] ASF GitHub Bot commented on APEXMALHAR-2343: GitHub user brightchen opened a pull

Re: Proposal for apex/malhar extensions

@sanjay, yes we can define the process around this. @pramod, Well, I said apex-malhar because the extensions can be operators and and other plugins to apex engine. Do you see the use of this for apex-core as well? -Chinmay. On Wed, Nov 16, 2016 at 7:24 PM, Pramod Immaneni

[GitHub] apex-malhar pull request #499: APEXMALHAR-2343 #resolve #comment Count Accum...

Github user brightchen closed the pull request at: https://github.com/apache/apex-malhar/pull/499 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (APEXCORE-251) Journal output stream is null error message

[ https://issues.apache.org/jira/browse/APEXCORE-251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672899#comment-15672899 ] ASF GitHub Bot commented on APEXCORE-251: - Github user asfgit closed the pull request at:

[jira] [Resolved] (APEXCORE-251) Journal output stream is null error message

[ https://issues.apache.org/jira/browse/APEXCORE-251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tushar Gosavi resolved APEXCORE-251. Resolution: Fixed Fix Version/s: 3.5.0 > Journal output stream is null error

[GitHub] apex-core pull request #419: APEXCORE-251 - Suppress "Journal output stream ...

Github user asfgit closed the pull request at: https://github.com/apache/apex-core/pull/419 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] apex-malhar pull request #501: APEXMALHAR-2340 code changes to initialize th...

GitHub user Hitesh-Scorpio opened a pull request: https://github.com/apache/apex-malhar/pull/501 APEXMALHAR-2340 code changes to initialize the list of JdbcFieldInfo … …in JdbcPOJOInsertOutput from properties.xml @devtagare @bhupeshchawda please review the code changes You can

[jira] [Created] (APEXMALHAR-2344) Initialize the list of FieldInfo in JDBCPollInput operator from properties.xml

Hitesh Kapoor created APEXMALHAR-2344: - Summary: Initialize the list of FieldInfo in JDBCPollInput operator from properties.xml Key: APEXMALHAR-2344 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2344

Visitor API for DAG

Hi All, How about adding visitor like API for DAG in Apex, and an api to register visitor for the DAG. Possible use cases are - Validator visitor which could validate the dag - Visitor to inject properties/attribute in the operator/streams from some external sources. - Platform does not

Re: Proposal for apex/malhar extensions

+1 This is a good idea. Ajay On Wed, Nov 16, 2016 at 4:47 PM, Chinmay Kolhatkar wrote: > Dear Community, > > This is in relation to malhar cleanup work that is ongoing. > > In one of the talks during Apache BigData Europe, I got to know about > Spark-Packages

Re: (APEXMALHAR-2340) Initialize the list of JdbcFieldInfo in JdbcPOJOInsertOutput operator from properties.xml

Thank you for the inputs. I will go ahead with JSON based input for mapping. For e.g. the user will initialize the list of JdbcFieldInfos from properties.xml file as follows: dt.operator.JdbcOutput.fieldInfosItem[0] { "sqlType": 0, "coumnName":"customerName",

[GitHub] apex-malhar pull request #498: APEXMALHAR-2178 Removed unnecessary byte arra...

Github user ambarishpande closed the pull request at: https://github.com/apache/apex-malhar/pull/498 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (APEXMALHAR-2178) Unnecessary byte array copy in KryoSerializableStreamCodec

[ https://issues.apache.org/jira/browse/APEXMALHAR-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669910#comment-15669910 ] ASF GitHub Bot commented on APEXMALHAR-2178: Github user ambarishpande closed the pull

[GitHub] apex-malhar pull request #479: APEXMALHAR-2325 1) Set the file system defaul...

Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/479 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Resolved] (APEXMALHAR-2325) Same block id is emitting from FSInputModule

[ https://issues.apache.org/jira/browse/APEXMALHAR-2325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Priyanka Gugale resolved APEXMALHAR-2325. - Resolution: Fixed Fix Version/s: 3.6.0 > Same block id is emitting

[jira] [Commented] (APEXMALHAR-2325) Same block id is emitting from FSInputModule

[ https://issues.apache.org/jira/browse/APEXMALHAR-2325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15670055#comment-15670055 ] ASF GitHub Bot commented on APEXMALHAR-2325: Github user asfgit closed the pull request

Proposal for apex/malhar extensions

Dear Community, This is in relation to malhar cleanup work that is ongoing. In one of the talks during Apache BigData Europe, I got to know about Spark-Packages (https://spark-packages.org/) (I believe lot of you must be aware of it). Spark package is basically functionality over and above and

Re: Proposal for apex/malhar extensions

+1 Thks Amol On Wed, Nov 16, 2016 at 5:37 AM, AJAY GUPTA wrote: > +1 > This is a good idea. > > Ajay > > On Wed, Nov 16, 2016 at 4:47 PM, Chinmay Kolhatkar > wrote: > > > Dear Community, > > > > This is in relation to malhar cleanup work that is

[jira] [Commented] (APEXMALHAR-2076) AbstractExactlyOnceKafkaOutputOperator didn't handle the orderless of tuples in a window

[ https://issues.apache.org/jira/browse/APEXMALHAR-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671026#comment-15671026 ] ASF GitHub Bot commented on APEXMALHAR-2076: Github user brightchen closed the pull

[GitHub] apex-malhar pull request #488: APEXMALHAR-2331 #resolve #comment StateTracke...

Github user brightchen closed the pull request at: https://github.com/apache/apex-malhar/pull/488 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] apex-malhar pull request #294: APEXMALHAR-2076 #resolve #comment add Abstrac...

Github user brightchen closed the pull request at: https://github.com/apache/apex-malhar/pull/294 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (APEXMALHAR-2331) StateTracker#bucketAccessed should add bucket to bucketAccessTimes

[ https://issues.apache.org/jira/browse/APEXMALHAR-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671022#comment-15671022 ] ASF GitHub Bot commented on APEXMALHAR-2331: Github user brightchen closed the pull

Re: Proposal for apex/malhar extensions

+1 for the idea. Will be good to describe the registration mechanism to be used. On 11/16/16, 3:17 AM, "Chinmay Kolhatkar" wrote: Dear Community, This is in relation to malhar cleanup work that is ongoing. In one of the talks during Apache BigData

Re: Proposal for apex/malhar extensions

So it would be like a yellow pages for the apex ecosystem. Sounds like a good idea. Why limit it to malhar? On Wed, Nov 16, 2016 at 3:17 AM, Chinmay Kolhatkar wrote: > Dear Community, > > This is in relation to malhar cleanup work that is ongoing. > > In one of the talks