Re: Proposing an operator for log parsing.

2016-11-17 Thread Tushar Gosavi
Check for pull request https://github.com/apache/apex-malhar/pull/396, This tries to use java regex with group syntax to populate fields of POJO. may be you can use some of the ideas from this pull request. On Fri, Nov 18, 2016 at 12:30 AM, Pradeep A. Dalvi wrote: > +1 for the

Re: Proposing an operator for log parsing.

2016-11-17 Thread Pradeep A. Dalvi
+1 for the feature On Thu, 17 Nov 2016 at 16:56 Shraddha Jog wrote: > Dear community, > > We would like to add operator in malhar for parsing different types of > logs. > Idea of this operator is to read log data records of known formats such as > Syslog, common log,

Re: Proposing an operator for log parsing.

2016-11-17 Thread Tushar Gosavi
+1 for the feature If possible may be you could include grok format for specifying log structure. https://www.elastic.co/guide/en/logstash/current/plugins-filters-grok.html - Tushar. On Thu, Nov 17, 2016 at 11:48 PM, Sanjay Pujare wrote: > +1, I like this feature. > >

Re: Proposing an operator for log parsing.

2016-11-17 Thread Sanjay Pujare
+1, I like this feature. On 11/17/16, 3:26 AM, "Shraddha Jog" wrote: Dear community, We would like to add operator in malhar for parsing different types of logs. Idea of this operator is to read log data records of known formats such as

Proposing an operator for log parsing.

2016-11-17 Thread Shraddha Jog
Dear community, We would like to add operator in malhar for parsing different types of logs. Idea of this operator is to read log data records of known formats such as Syslog, common log, combined log, extended log etc from the upstream in a DAG, parse/validate it based on the configured format