[jira] [Commented] (APEXMALHAR-2289) Managed State benchmark improvement

2016-10-28 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/APEXMALHAR-2289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15616946#comment-15616946
 ] 

ASF GitHub Bot commented on APEXMALHAR-2289:


GitHub user brightchen opened a pull request:

https://github.com/apache/apex-malhar/pull/473

APEXMALHAR-2289 #resolve #comment Add resource monitor



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/brightchen/apex-malhar APEXMALHAR-2289-PR

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/apex-malhar/pull/473.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #473


commit 861be1930cb0c282e14baf208ab5e9fbeb8878cf
Author: brightchen 
Date:   2016-10-28T23:19:15Z

APEXMALHAR-2289 #resolve #comment Add resource monitor




>  Managed State benchmark improvement
> 
>
> Key: APEXMALHAR-2289
> URL: https://issues.apache.org/jira/browse/APEXMALHAR-2289
> Project: Apache Apex Malhar
>  Issue Type: Improvement
>Reporter: bright chen
>Assignee: bright chen
>   Original Estimate: 72h
>  Remaining Estimate: 72h
>
> It seems the State Manager will slow down after run a while. Add following 
> feature to the Managed State benchmark for monitoring
> 1. monitor the system resource.
> 2. monitor the garbage collection 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] apex-malhar pull request #473: APEXMALHAR-2289 #resolve #comment Add resourc...

2016-10-28 Thread brightchen 
GitHub user brightchen opened a pull request:

https://github.com/apache/apex-malhar/pull/473

APEXMALHAR-2289 #resolve #comment Add resource monitor



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/brightchen/apex-malhar APEXMALHAR-2289-PR

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/apex-malhar/pull/473.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #473


commit 861be1930cb0c282e14baf208ab5e9fbeb8878cf
Author: brightchen 
Date:   2016-10-28T23:19:15Z

APEXMALHAR-2289 #resolve #comment Add resource monitor




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (APEXMALHAR-2229) Add support for peek on com.datatorrent.lib.fileaccess.FileAccess.FileReader

2016-10-28 Thread Thomas Weise (JIRA) 

 [ 
https://issues.apache.org/jira/browse/APEXMALHAR-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thomas Weise resolved APEXMALHAR-2229.
--
   Resolution: Fixed
Fix Version/s: 3.6.0

> Add support for peek on com.datatorrent.lib.fileaccess.FileAccess.FileReader
> 
>
> Key: APEXMALHAR-2229
> URL: https://issues.apache.org/jira/browse/APEXMALHAR-2229
> Project: Apache Apex Malhar
>  Issue Type: New Feature
>Reporter: David Yan
>Assignee: David Yan
> Fix For: 3.6.0
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (APEXMALHAR-2229) Add support for peek on com.datatorrent.lib.fileaccess.FileAccess.FileReader

2016-10-28 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/APEXMALHAR-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15616942#comment-15616942
 ] 

ASF GitHub Bot commented on APEXMALHAR-2229:


Github user asfgit closed the pull request at:

https://github.com/apache/apex-malhar/pull/403


> Add support for peek on com.datatorrent.lib.fileaccess.FileAccess.FileReader
> 
>
> Key: APEXMALHAR-2229
> URL: https://issues.apache.org/jira/browse/APEXMALHAR-2229
> Project: Apache Apex Malhar
>  Issue Type: New Feature
>Reporter: David Yan
>Assignee: David Yan
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] apex-malhar pull request #403: APEXMALHAR-2229 #resolve Added peek and hasNe...

2016-10-28 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/apex-malhar/pull/403


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (APEXMALHAR-2304) Apex SQL: Add examples for SQL in Apex in demos folder

2016-10-28 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/APEXMALHAR-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15615423#comment-15615423
 ] 

ASF GitHub Bot commented on APEXMALHAR-2304:


GitHub user chinmaykolhatkar opened a pull request:

https://github.com/apache/apex-malhar/pull/472

APEXMALHAR-2304 SQL Support Examples



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/chinmaykolhatkar/apex-malhar 
APEXMALHAR-2304_SQLExamples

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/apex-malhar/pull/472.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #472


commit 2b7a489ab419f59b9a41157e2817f35dc98cbf74
Author: Chinmay Kolhatkar 
Date:   2016-10-24T06:11:04Z

APEXMALHAR-2304 SQL Support Examples




> Apex SQL: Add examples for SQL in Apex in demos folder
> --
>
> Key: APEXMALHAR-2304
> URL: https://issues.apache.org/jira/browse/APEXMALHAR-2304
> Project: Apache Apex Malhar
>  Issue Type: New Feature
>  Components: sql
>Reporter: Chinmay Kolhatkar
>Assignee: Chinmay Kolhatkar
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] apex-malhar pull request #471: Added S3 Record Reader module

2016-10-28 Thread ajaygit158 
GitHub user ajaygit158 opened a pull request:

https://github.com/apache/apex-malhar/pull/471

Added S3 Record Reader module

@yogidevendra @chaithu14 Kindly Review

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ajaygit158/apex-malhar APEXMALHAR-2303

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/apex-malhar/pull/471.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #471


commit 850f08eed7ac58b7d9ac356e8db697edf5deada8
Author: Ajay 
Date:   2016-10-27T12:57:28Z

Added S3 Record Reader module




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Malhar release 3.6

2016-10-28 Thread Bhupesh Chawda 
+1

~ Bhupesh

On Fri, Oct 28, 2016 at 2:29 PM, Tushar Gosavi 
wrote:

> +1
>
> - Tushar.
>
>
> On Fri, Oct 28, 2016 at 12:52 PM, Aniruddha Thombare
>  wrote:
> > +1
> >
> > Thanks,
> >
> > A
> >
> > _
> > Sent with difficulty, I mean handheld ;)
> >
> > On 28 Oct 2016 12:30 pm, "Siyuan Hua"  wrote:
> >
> >> +1
> >>
> >> Thanks！
> >>
> >> Sent from my iPhone
> >>
> >> > On Oct 26, 2016, at 13:11, Thomas Weise  wrote:
> >> >
> >> > Hi,
> >> >
> >> > I'm proposing another release of Malhar in November. There are 49
> issues
> >> > marked for the release, including important bug fixes, new
> documentation,
> >> > SQL support and the work for windowed operator state management:
> >> >
> >> > https://issues.apache.org/jira/issues/?jql=fixVersion%
> >> 20%3D%203.6.0%20AND%20project%20%3D%20APEXMALHAR%20ORDER%
> >> 20BY%20status%20ASC
> >> >
> >> > Currently there is at least one blocker, the join operator is broken
> >> after
> >> > change in managed state. It also affects the SQL feature.
> >> >
> >> > Thanks,
> >> > Thomas
> >>
>

Re: Malhar release 3.6

2016-10-28 Thread Tushar Gosavi 
+1

- Tushar.


On Fri, Oct 28, 2016 at 12:52 PM, Aniruddha Thombare
 wrote:
> +1
>
> Thanks,
>
> A
>
> _
> Sent with difficulty, I mean handheld ;)
>
> On 28 Oct 2016 12:30 pm, "Siyuan Hua"  wrote:
>
>> +1
>>
>> Thanks！
>>
>> Sent from my iPhone
>>
>> > On Oct 26, 2016, at 13:11, Thomas Weise  wrote:
>> >
>> > Hi,
>> >
>> > I'm proposing another release of Malhar in November. There are 49 issues
>> > marked for the release, including important bug fixes, new documentation,
>> > SQL support and the work for windowed operator state management:
>> >
>> > https://issues.apache.org/jira/issues/?jql=fixVersion%
>> 20%3D%203.6.0%20AND%20project%20%3D%20APEXMALHAR%20ORDER%
>> 20BY%20status%20ASC
>> >
>> > Currently there is at least one blocker, the join operator is broken
>> after
>> > change in managed state. It also affects the SQL feature.
>> >
>> > Thanks,
>> > Thomas
>>

[jira] [Commented] (APEXMALHAR-2303) S3 Line By Line Module

2016-10-28 Thread Ajay Gupta (JIRA) 

[ 
https://issues.apache.org/jira/browse/APEXMALHAR-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614784#comment-15614784
 ] 

Ajay Gupta commented on APEXMALHAR-2303:


Raised PR for this code. Kindly review and let me know of any issues
https://github.com/apache/apex-malhar/pull/471/



> S3 Line By Line Module
> --
>
> Key: APEXMALHAR-2303
> URL: https://issues.apache.org/jira/browse/APEXMALHAR-2303
> Project: Apache Apex Malhar
>  Issue Type: Bug
>Reporter: Ajay Gupta
>Assignee: Ajay Gupta
>   Original Estimate: 336h
>  Remaining Estimate: 336h
>
> This is a new module which will consist of 2 operators
> 1) File Splitter -- Already existing in Malhar library
> 2) S3RecordReader -- Read a file from S3 and output the records (delimited or 
> fixed width) 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Malhar release 3.6

2016-10-28 Thread Aniruddha Thombare 
+1

Thanks,

A

_
Sent with difficulty, I mean handheld ;)

On 28 Oct 2016 12:30 pm, "Siyuan Hua"  wrote:

> +1
>
> Thanks！
>
> Sent from my iPhone
>
> > On Oct 26, 2016, at 13:11, Thomas Weise  wrote:
> >
> > Hi,
> >
> > I'm proposing another release of Malhar in November. There are 49 issues
> > marked for the release, including important bug fixes, new documentation,
> > SQL support and the work for windowed operator state management:
> >
> > https://issues.apache.org/jira/issues/?jql=fixVersion%
> 20%3D%203.6.0%20AND%20project%20%3D%20APEXMALHAR%20ORDER%
> 20BY%20status%20ASC
> >
> > Currently there is at least one blocker, the join operator is broken
> after
> > change in managed state. It also affects the SQL feature.
> >
> > Thanks,
> > Thomas
>

Re: Malhar release 3.6

2016-10-28 Thread Siyuan Hua 
+1

Thanks！

Sent from my iPhone

> On Oct 26, 2016, at 13:11, Thomas Weise  wrote:
> 
> Hi,
> 
> I'm proposing another release of Malhar in November. There are 49 issues
> marked for the release, including important bug fixes, new documentation,
> SQL support and the work for windowed operator state management:
> 
> https://issues.apache.org/jira/issues/?jql=fixVersion%20%3D%203.6.0%20AND%20project%20%3D%20APEXMALHAR%20ORDER%20BY%20status%20ASC
> 
> Currently there is at least one blocker, the join operator is broken after
> change in managed state. It also affects the SQL feature.
> 
> Thanks,
> Thomas