[ 
https://issues.apache.org/jira/browse/METRON-295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15623469#comment-15623469
 ] 

Karthik Narayanan commented on METRON-295:
------------------------------------------

I was looking at a couple of approaches for this .

option 1. Implement MessageParser class, that can parse the rawMessage using a 
script that user provides ( js/python/groovy ) . To do this we can use the 
javax script API. 
http://docs.oracle.com/javase/7/docs/api/javax/script/ScriptEngine.html. 

option 2 . simply pass the parser script to a a ScriptBolt (java class ) 
instance, which loads the user script using  storms native capability. 
https://github.com/apache/storm/blob/master/examples/storm-starter/multilang/resources/splitsentence...

I think option 1 may be a little more reusable as the same parser 
implementation can be used for streaming and batch data, while option may be 
very storm centric. 

This is something i can try and implement, if not yet implemented.




> Script parsing bolt 
> --------------------
>
>                 Key: METRON-295
>                 URL: https://issues.apache.org/jira/browse/METRON-295
>             Project: Metron
>          Issue Type: New Feature
>    Affects Versions: 0.2.1BETA
>            Reporter: James Sirota
>            Assignee: James Sirota
>            Priority: Minor
>              Labels: newbie, platform
>             Fix For: 0.2.1BETA
>
>
> In addition to having a Grok parsing bolt we need a bolt that can execute a 
> script in order to parse a telemetry.  This way you can still script the 
> parsing for telemetries for which Grok expressions are too complex, but still 
> don't have to define a java parser 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to