[ 
https://issues.apache.org/jira/browse/HADOOP-11506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288525#comment-14288525
 ] 

Dmitriy V. Ryaboy commented on HADOOP-11506:
--------------------------------------------

[~andrew.wang] no perf, but I did turn on -Xprof and in our case (which 
involves scalding, chill, and cascading all passing configs around like they 
are playing hot potato) the pre-patch version had this regex eating up about 
16% of the SpillThread. 

> Configuration.get() is unnecessarily slow
> -----------------------------------------
>
>                 Key: HADOOP-11506
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11506
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Dmitriy V. Ryaboy
>
> Profiling several large Hadoop jobs, we discovered that a surprising amount 
> of time was spent inside Configuration.get, more specifically, in regex 
> matching caused by the substituteVars call.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to