[
https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16483545#comment-16483545
]
Xiao Chen commented on HDFS-13601:
----------------------------------
Thanks Andrew for the work here.
Looks pretty good to me overall. Some minors:
- {{DatanodeID}} constructor: it seems a {{DatanodeID(String datanodeUuid,
DatanodeID from)}} overload can still be used so no changes to
TestComputeInvalidateWork / DatanodeRegistration necessary
- Can we make the var name {{fixedBytestringCache}} {{bytestringCache}} to be
camel case (ByteString instead of Bytestring)? At one point I saw that as 'by
test ring' and get myself confused for a nanosecond. :)
- Do you think it's helpful to add some comments in DatanodeId to explain the
perf motivation of saving the ByteString's?
For the extra memory increase, since this only applies to a few fields which
should have a small set of values, it should be ok. (linux user/group names
have max length of 32 chars, bpid/kind/service are smaller).
> Optimize ByteString conversions in PBHelper
> -------------------------------------------
>
> Key: HDFS-13601
> URL: https://issues.apache.org/jira/browse/HDFS-13601
> Project: Hadoop HDFS
> Issue Type: Bug
> Affects Versions: 3.1.0, 2.9.1
> Reporter: Andrew Wang
> Assignee: Andrew Wang
> Priority: Major
> Attachments: HDFS-13601.001.patch, HDFS-13601.002.patch
>
>
> While doing some profiling of the NN with JMC, I saw a lot of time being
> spent on String->ByteString conversions. These are often the same strings
> being converted over and over again, meaning there's room for optimization.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
