[ 
https://issues.apache.org/jira/browse/TINKERPOP-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274036#comment-15274036
 ] 

Marko A. Rodriguez commented on TINKERPOP-1295:
-----------------------------------------------

Fascinating. Yes. What a good find.

> Precompile ScriptInputFormat scripts once during initialization of 
> ScriptRecordReader
> -------------------------------------------------------------------------------------
>
>                 Key: TINKERPOP-1295
>                 URL: https://issues.apache.org/jira/browse/TINKERPOP-1295
>             Project: TinkerPop
>          Issue Type: Improvement
>          Components: hadoop, io
>    Affects Versions: 3.2.0-incubating, 3.1.2-incubating
>            Reporter: Ted Wilmes
>            Assignee: Ted Wilmes
>         Attachments: intern.svg
>
>
> The {{ScriptRecordReader}} evals scripts on every {{nextKeyValue()}}.  I 
> think we can cut down on script execution evaluation time by precompiling the 
> input script once.  This should speedup bulk loads.  I've attached some 
> profiling info showing a large chunk of time being spent on this eval during 
> a recent test run.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to