[
https://issues.apache.org/jira/browse/TEZ-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan updated TEZ-3720:
----------------------------------
Attachment: FS$Stats.incrementBytesWritten.png
> Optimize SimpleHistoryLoggingService: FileSystem$Stats updates are expensive
> than writes
> ----------------------------------------------------------------------------------------
>
> Key: TEZ-3720
> URL: https://issues.apache.org/jira/browse/TEZ-3720
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Rajesh Balamohan
> Attachments: FS$Stats.incrementBytesWritten.png
>
>
> In some cases, Time taken to update FS$Stats is more than outputstream.write.
> E.g In SimpleHistoryLoggingService, we can easily reduce the number of
> FS$Stats calls by half.
> I haven't checked with ATS15 (in yarn side) where JSONGenerator ends up using
> FSDataOutputStream and timeline entities are written.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
