Re: Fixed Width Record Parser

2016-09-08 Thread Chinmay Kolhatkar
Few points/questions: 1. Agree with Yogi. Approach 2 does not look clean. 2. Do we need "recordwidthlength"? 3. "recordseperator" should be "\n" and not "/n". 4. In general, providing schema as a JSON is tedious from user perspective. I suggest we find a simpler format for specifying schema. For eg

Re: Fixed Width Record Parser

2016-09-08 Thread Yogi Devendra
If we specify order of the fields and length for each field then start, end can be computed. Why do we need end user to specify start position for each field? ~ Yogi On 8 September 2016 at 12:48, Chinmay Kolhatkar wrote: > Few points/questions: > 1. Agree with Yogi. Approach 2 does not look cle

[GitHub] apex-malhar pull request #361: APEXMALHAR-2176 expressionFunctions for Filte...

2016-09-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/361 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (APEXMALHAR-2176) expressionFunctions for FilterOperator throws IndexOutOfBounds

2016-09-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15473546#comment-15473546 ] ASF GitHub Bot commented on APEXMALHAR-2176: Github user asfgit closed th

[jira] [Resolved] (APEXMALHAR-2176) expressionFunctions for FilterOperator throws IndexOutOfBounds

2016-09-08 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar resolved APEXMALHAR-2176. --- Resolution: Fixed Fix Version/s: 3.6.0 > expressionFunctions for F

[jira] [Commented] (APEXMALHAR-2152) Enricher - Add fixed length file format support to FSLoader

2016-09-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15473687#comment-15473687 ] ASF GitHub Bot commented on APEXMALHAR-2152: Github user asfgit closed th

[GitHub] apex-malhar pull request #376: APEXMALHAR-2152 - FSLoader fixed length suppo...

2016-09-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/376 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (APEXMALHAR-2152) Enricher - Add fixed length file format support to FSLoader

2016-09-08 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar resolved APEXMALHAR-2152. --- Resolution: Done Fix Version/s: 3.6.0 > Enricher - Add fixed lengt

[jira] [Created] (APEXCORE-524) Add support for custom maven repository to ClassPathResolverTest.testManifestClassPathResolver

2016-09-08 Thread Vlad Rozov (JIRA)
Vlad Rozov created APEXCORE-524: --- Summary: Add support for custom maven repository to ClassPathResolverTest.testManifestClassPathResolver Key: APEXCORE-524 URL: https://issues.apache.org/jira/browse/APEXCORE-524

[GitHub] apex-core pull request #386: APEXCORE-524 - Add support for custom maven rep...

2016-09-08 Thread vrozov
GitHub user vrozov opened a pull request: https://github.com/apache/apex-core/pull/386 APEXCORE-524 - Add support for custom maven repository to ClassPathResolverTest.testManifestClassPathResolver @tweise Please review You can merge this pull request into a Git repository by runnin

[jira] [Commented] (APEXCORE-524) Add support for custom maven repository to ClassPathResolverTest.testManifestClassPathResolver

2016-09-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15474186#comment-15474186 ] ASF GitHub Bot commented on APEXCORE-524: - GitHub user vrozov opened a pull requ

[jira] [Commented] (APEXCORE-524) Add support for custom maven repository to ClassPathResolverTest.testManifestClassPathResolver

2016-09-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15474316#comment-15474316 ] ASF GitHub Bot commented on APEXCORE-524: - Github user asfgit closed the pull re

[GitHub] apex-core pull request #386: APEXCORE-524 - Add support for custom maven rep...

2016-09-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/apex-core/pull/386 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[jira] [Resolved] (APEXCORE-524) Add support for custom maven repository to ClassPathResolverTest.testManifestClassPathResolver

2016-09-08 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved APEXCORE-524. --- Resolution: Fixed Fix Version/s: 3.5.0 > Add support for custom maven repository to

[GitHub] apex-core pull request #385: APEXCORE-522 - Promote singleton usage pattern ...

2016-09-08 Thread vrozov
GitHub user vrozov reopened a pull request: https://github.com/apache/apex-core/pull/385 APEXCORE-522 - Promote singleton usage pattern for String2String, Long2String and other StringCodecs You can merge this pull request into a Git repository by running: $ git pull https://g

[GitHub] apex-core pull request #385: APEXCORE-522 - Promote singleton usage pattern ...

2016-09-08 Thread vrozov
Github user vrozov closed the pull request at: https://github.com/apache/apex-core/pull/385 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[jira] [Commented] (APEXCORE-522) Promote singleton usage pattern for String2String, Long2String and other StringCodecs

2016-09-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15474522#comment-15474522 ] ASF GitHub Bot commented on APEXCORE-522: - Github user vrozov closed the pull re

[jira] [Commented] (APEXCORE-522) Promote singleton usage pattern for String2String, Long2String and other StringCodecs

2016-09-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15474523#comment-15474523 ] ASF GitHub Bot commented on APEXCORE-522: - GitHub user vrozov reopened a pull re

[jira] [Resolved] (APEXMALHAR-2228) Implement SpillableByteLinkedListMultimap

2016-09-08 Thread David Yan (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Yan resolved APEXMALHAR-2228. --- Resolution: Invalid Not valid any more > Implement SpillableByteLinkedListMultimap > ---

[jira] [Created] (APEXMALHAR-2231) Implement a Spillable map that takes two keys

2016-09-08 Thread David Yan (JIRA)
David Yan created APEXMALHAR-2231: - Summary: Implement a Spillable map that takes two keys Key: APEXMALHAR-2231 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2231 Project: Apache Apex Malhar

[jira] [Assigned] (APEXMALHAR-2230) Intermittent test failure in Kafka module

2016-09-08 Thread Siyuan Hua (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua reassigned APEXMALHAR-2230: -- Assignee: Siyuan Hua > Intermittent test failure in Kafka module > ---

[jira] [Commented] (APEXMALHAR-2230) Intermittent test failure in Kafka module

2016-09-08 Thread Siyuan Hua (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15474990#comment-15474990 ] Siyuan Hua commented on APEXMALHAR-2230: Not necessarily related to Kafka. Th

[GitHub] apex-malhar pull request #405: APEXMALHAR-2130 #resolve Added a spillable ma...

2016-09-08 Thread davidyan74
GitHub user davidyan74 opened a pull request: https://github.com/apache/apex-malhar/pull/405 APEXMALHAR-2130 #resolve Added a spillable map that takes two keys with support of iterating through all entries with a given first key @siyuanh @tweise @ilooner Please review. This is mostl

[jira] [Commented] (APEXMALHAR-2130) implement scalable windowed storage

2016-09-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15475007#comment-15475007 ] ASF GitHub Bot commented on APEXMALHAR-2130: GitHub user davidyan74 opene

Megh operator library

2016-09-08 Thread Pramod Immaneni
Hi, DataTorrent, the initial contributor to Apex and the company I work for, has opened up a library of operators called Megh recently to the public and has made the repository available under the Apache License. The link to the repository is below. These operators, for the most part, contain func

Re: Megh operator library

2016-09-08 Thread Yogi Devendra
Hi, I would like to contribute for this effort for one operator. Please count me in for this effort. ~ Yogi On 9 September 2016 at 03:10, Pramod Immaneni wrote: > Hi, > > DataTorrent, the initial contributor to Apex and the company I work for, > has opened up a library of operators called Megh

Re: Megh operator library

2016-09-08 Thread Devendra Tagare
Hi, Count me in for one operator as well. Thanks, Dev On Fri, Sep 9, 2016 at 8:33 AM, Yogi Devendra wrote: > Hi, > > I would like to contribute for this effort for one operator. Please count > me in for this effort. > > ~ Yogi > > On 9 September 2016 at 03:10, Pramod Immaneni > wrote: > > > H

Re: Megh operator library

2016-09-08 Thread Dongming Liang
+1 for me. Thanks, - Dongming Dongming LIANG dongming.li...@gmail.com On Thu, Sep 8, 2016 at 9:02 PM, Devendra Tagare wrote: > Hi, > > Count me in for one operator as well. > > Thanks, > Dev > > On Fri, Sep 9, 2016 at 8:33 AM, Yogi Devendra < > devendra.vyavah...@gmail.com> > wrot

Re: Megh operator library

2016-09-08 Thread Lakshmi Velineni
i would like to help as well. thanks Lakshmi Prasanna On Thu, Sep 8, 2016 at 9:15 PM, Dongming Liang wrote: > +1 for me. > > Thanks, > - Dongming > > Dongming LIANG > > dongming.li...@gmail.com > > On Thu, Sep 8, 2016 at 9:02 PM, Devendra Tagare > > wrote: > > > Hi, > > > > Count

Re: Megh operator library

2016-09-08 Thread Shunxin Lu
I would love to help too. Thanks, Shunxin On Thu, Sep 8, 2016 at 9:34 PM, Lakshmi Velineni wrote: > i would like to help as well. > > thanks > Lakshmi Prasanna > > On Thu, Sep 8, 2016 at 9:15 PM, Dongming Liang > wrote: > > > +1 for me. > > > > Thanks, > > - Dongming > > > > Dongming LIANG > >

Re: Megh operator library

2016-09-08 Thread Yunhan Wang
I would love to help as well. Thanks, Yunhan On Thu, Sep 8, 2016 at 11:01 PM, Shunxin Lu wrote: > I would love to help too. > > Thanks, > Shunxin > > On Thu, Sep 8, 2016 at 9:34 PM, Lakshmi Velineni > wrote: > > > i would like to help as well. > > > > thanks > > Lakshmi Prasanna > > > > On Thu