[
https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375756#comment-15375756
]
Staffan Friberg commented on HDFS-10620:
To avoid all allocation.
{noformat}
diff --git
[
https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-10620:
---
Fix Version/s: (was: 3.0.0-alpha1)
> StringBuilder created and appended even if logging
[
https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-10620:
---
Attachment: HDFS-10620.001.patch
> StringBuilder created and appended even if logging is
[
https://issues.apache.org/jira/browse/HDFS-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-10620:
---
Fix Version/s: 3.0.0-alpha1
Status: Patch Available (was: Open)
> StringBuilder
Staffan Friberg created HDFS-10620:
--
Summary: StringBuilder created and appended even if logging is
disabled
Key: HDFS-10620
URL: https://issues.apache.org/jira/browse/HDFS-10620
Project: Hadoop
[
https://issues.apache.org/jira/browse/HDFS-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg resolved HDFS-10563.
Resolution: Invalid
> Block reports could be silently dropped by NN
>
[
https://issues.apache.org/jira/browse/HDFS-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346510#comment-15346510
]
Staffan Friberg commented on HDFS-10563:
Now I see it. Completely missed the !.
> Block reports
[
https://issues.apache.org/jira/browse/HDFS-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346498#comment-15346498
]
Staffan Friberg commented on HDFS-10563:
Unless I'm counting {} wrong it looks like the put is
Staffan Friberg created HDFS-10563:
--
Summary: Block reports could be silently dropped by NN
Key: HDFS-10563
URL: https://issues.apache.org/jira/browse/HDFS-10563
Project: Hadoop HDFS
Issue
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-9260.018.patch
> Improve performance and GC friendliness of startup and FBRs
>
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124362#comment-15124362
]
Staffan Friberg commented on HDFS-9260:
---
Patch17
Added timeout as a tuneable
Smaller read-lock
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-9260.017.patch
> Improve performance and GC friendliness of startup and FBRs
>
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15122433#comment-15122433
]
Staffan Friberg commented on HDFS-9260:
---
Thanks for the comments
Patch 15 (and 16) should address
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-9260.016.patch
> Improve performance and GC friendliness of startup and FBRs
>
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15122460#comment-15122460
]
Staffan Friberg commented on HDFS-9260:
---
Hi [~jingzhao],
Thank you for your comments! Updated with
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-9260.015.patch
> Improve performance and GC friendliness of startup and FBRs
>
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-9260.014.patch
> Improve performance and GC friendliness of startup and FBRs
>
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115356#comment-15115356
]
Staffan Friberg commented on HDFS-9260:
---
Fixed checkstyle on TreeSet.
Should I convert storages
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-9260.012.patch
> Improve performance and GC friendliness of startup and FBRs
>
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-9260.013.patch
> Improve performance and GC friendliness of startup and FBRs
>
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110816#comment-15110816
]
Staffan Friberg commented on HDFS-9260:
---
Thanks for the comments [~cmccabe]! Did all your suggested
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-9260.011.patch
> Improve performance and GC friendliness of startup and FBRs
>
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027676#comment-15027676
]
Staffan Friberg commented on HDFS-9260:
---
Added a new benchmark that does IBRs on a
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFSBenchmarks2.zip
> Improve performance and GC friendliness of startup and FBRs
>
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-9260.010.patch
Avoid LinkedList allocations
> Improve performance and GC
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990758#comment-14990758
]
Staffan Friberg commented on HDFS-9260:
---
Hi Daryn,
Thanks for the comments and the additional data
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFSBenchmarks.zip
Microbenchmarks
> Improve performance and GC friendliness of
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Description:
This patch changes the datastructures used for BlockInfos and Replicas to keep
[
https://issues.apache.org/jira/browse/HDFS-9350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985738#comment-14985738
]
Staffan Friberg commented on HDFS-9350:
---
It does, but the problem is that the call to Long.toString
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986062#comment-14986062
]
Staffan Friberg commented on HDFS-9260:
---
Hi Daryn,
Thanks for taking a look at the patch.
1. FBR
[
https://issues.apache.org/jira/browse/HDFS-9350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9350:
--
Status: Patch Available (was: Open)
> Avoid creating temprorary strings in Block.toString() and
[
https://issues.apache.org/jira/browse/HDFS-9350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9350:
--
Attachment: HDFS-9350.001.patch
> Avoid creating temprorary strings in Block.toString() and
[
https://issues.apache.org/jira/browse/HDFS-9350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg reassigned HDFS-9350:
-
Assignee: Staffan Friberg
> Avoid creating temprorary strings in Block.toString() and
Staffan Friberg created HDFS-9350:
-
Summary: Avoid creating temprorary strings in Block.toString() and
getBlockName()
Key: HDFS-9350
URL: https://issues.apache.org/jira/browse/HDFS-9350
Project:
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981442#comment-14981442
]
Staffan Friberg commented on HDFS-9260:
---
I have been running through the other failed tests without
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-9260.009.patch
Fix for timed out test
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-9260.008.patch
Using the right name of the bug on the patch...
Fixed white
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-7435.007.patch
Fixed comments, white spaces and most of the 80 width warnings
[
https://issues.apache.org/jira/browse/HDFS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9299:
--
Attachment: HDFS-9299.001.patch
> Give ReplicationMonitor a readable thread name
>
Staffan Friberg created HDFS-9299:
-
Summary: Give ReplicationMonitor a readable thread name
Key: HDFS-9299
URL: https://issues.apache.org/jira/browse/HDFS-9299
Project: Hadoop HDFS
Issue
[
https://issues.apache.org/jira/browse/HDFS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg reassigned HDFS-9299:
-
Assignee: Staffan Friberg
> Give ReplicationMonitor a readable thread name
>
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-7435.005.patch
Fix the last todos
Handles New NN and Old DN (unsorted
[
https://issues.apache.org/jira/browse/HDFS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9299:
--
Status: Patch Available (was: Open)
> Give ReplicationMonitor a readable thread name
>
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-7435.006.patch
Merged and diff:ed again due to conflict
> Improve performance
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Status: Patch Available (was: Open)
> Improve performance and GC friendliness of startup and
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971575#comment-14971575
]
Staffan Friberg commented on HDFS-9260:
---
Also handles negative non-striped (EC) entries as
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-7435.004.patch
All HDFS tests should now pass.
Fixes include
Correctly
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Description:
This patch changes the datastructures used for BlockInfos and Replicas to keep
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965242#comment-14965242
]
Staffan Friberg commented on HDFS-9260:
---
The TreeSet reduces the number of reference compared to the
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963610#comment-14963610
]
Staffan Friberg commented on HDFS-9260:
---
Hi Walter
1)
I think this is part could reduce the need to
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-7435.002.patch
Merged with latest head
> Improve performance and GC
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS Block and Replica Management 20151013.pdf
> Improve performance and GC
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS Block and Replica Management 20151013.pdf
> Improve performance and GC
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: (was: HDFS Block and Replica Management 20151013.pdf)
> Improve performance and
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Description:
This patch changes the datastructures used for BlockInfos and Replicas to keep
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-7435.003.patch
Add null check when creating iterator of storages
> Improve
Staffan Friberg created HDFS-9260:
-
Summary: Improve performance and GC friendliness of startup and
FBRs
Key: HDFS-9260
URL: https://issues.apache.org/jira/browse/HDFS-9260
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9260:
--
Attachment: HDFS-7435.001.patch
> Improve performance and GC friendliness of startup and FBRs
>
[
https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9221:
--
Status: Patch Available (was: Open)
> HdfsServerConstants#ReplicaState#getState should avoid
[
https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9221:
--
Attachment: (was: ReplicaState.patch)
> HdfsServerConstants#ReplicaState#getState should
[
https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9221:
--
Attachment: HADOOP-9221.001.patch
> HdfsServerConstants#ReplicaState#getState should avoid
[
https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951127#comment-14951127
]
Staffan Friberg commented on HDFS-9221:
---
Uploaded new version of the patch as the old one was
[
https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9221:
--
Status: Open (was: Patch Available)
> HdfsServerConstants#ReplicaState#getState should avoid
[
https://issues.apache.org/jira/browse/HDFS-9201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951153#comment-14951153
]
Staffan Friberg commented on HDFS-9201:
---
For Lists you need to make sure you have an ArrayList, other
Staffan Friberg created HDFS-9221:
-
Summary: Reduce allocation during block reports
Key: HDFS-9221
URL: https://issues.apache.org/jira/browse/HDFS-9221
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg reassigned HDFS-9221:
-
Assignee: Staffan Friberg
> Reduce allocation during block reports
>
[
https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9221:
--
Status: Patch Available (was: Open)
Small change so could hopefully go into 2.8.0
> Reduce
[
https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9221:
--
Target Version/s: 2.8.0
> Reduce allocation during block reports
>
[
https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9221:
--
Attachment: ReplicaState.patch
> Reduce allocation during block reports
>
[
https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9221:
--
Affects Version/s: 2.7.1
> Reduce allocation during block reports
>
[
https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Staffan Friberg updated HDFS-9221:
--
Status: Open (was: Patch Available)
> Reduce allocation during block reports
>
71 matches
Mail list logo