[
https://issues.apache.org/jira/browse/SPARK-6142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14348452#comment-14348452
]
Sean Owen commented on SPARK-6142:
----------------------------------
Yeah I'm curious how this change would affect performance. Is it possible that
{{cleanup()}} was not being called at all in a common case before, and now this
ensures it is? is it possible it causes {{cleanup()}} to happen at a different
time, which affects timing? that is I wonder if it's a good thing, or, just an
artifact of what was timed.
> 10-12% Performance regression with "finalize"
> ---------------------------------------------
>
> Key: SPARK-6142
> URL: https://issues.apache.org/jira/browse/SPARK-6142
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.3.0
> Reporter: Nishkam Ravi
>
> 10-12% performance regression in PageRank (and potentially other workloads)
> caused due to the use of finalize in ExternalAppendOnlyMap. Introduced by a
> commit on Feb 19th.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
