Yi Liu created HDFS-11039:
-
Summary: Expose more configuration properties to hdfs-default.xml
Key: HDFS-11039
URL: https://issues.apache.org/jira/browse/HDFS-11039
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-11020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-11020:
--
Assignee: Jennica Pounds (was: Yi Liu)
> Add more doc for HDFS transparent encryption
>
[
https://issues.apache.org/jira/browse/HDFS-11020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-11020:
--
Summary: Add more doc for HDFS transparent encryption (was: Enable HDFS
transparent encryption doc)
> Add
Yi Liu created HDFS-11020:
-
Summary: Enable HDFS transparent encryption doc
Key: HDFS-11020
URL: https://issues.apache.org/jira/browse/HDFS-11020
Project: Hadoop HDFS
Issue Type: Task
[
https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15261467#comment-15261467
]
Yi Liu commented on HDFS-9276:
--
Not only one people tell me they encounter this issue in real cluster, and ask
[
https://issues.apache.org/jira/browse/HDFS-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8786:
-
Assignee: Rakesh R (was: Yi Liu)
> Erasure coding: DataNode should transfer striped blocks before being
>
[
https://issues.apache.org/jira/browse/HDFS-9713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133453#comment-15133453
]
Yi Liu commented on HDFS-9713:
--
+1, good catch. Thanks Uma.
> DataXceiver#copyBlock should return if block is
[
https://issues.apache.org/jira/browse/HDFS-9582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15065602#comment-15065602
]
Yi Liu commented on HDFS-9582:
--
+1 pending Jenkins.
Thanks Uma.
> TestLeaseRecoveryStriped file missing
[
https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8562:
-
Comment: was deleted
(was: GitHub user hash-X opened a pull request:
https://github.com/apache/hadoop/pull/42
[
https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14993370#comment-14993370
]
Yi Liu commented on HDFS-9276:
--
In the test, you get the token1/token2 for current login user, suppose it's
[
https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991615#comment-14991615
]
Yi Liu commented on HDFS-4937:
--
This time, it's correct now. The logic of current patch is straight.
+1 for
[
https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991686#comment-14991686
]
Yi Liu commented on HDFS-9276:
--
Yes, even the security is not enabled, but if there is token in user's
[
https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986402#comment-14986402
]
Yi Liu commented on HDFS-9276:
--
Liangliang, thanks for the update. See following comments. (I forgot to add
[
https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986424#comment-14986424
]
Yi Liu commented on HDFS-9275:
--
Looks good now, +1.
> Wait previous ErasureCodingWork to finish before
[
https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-9275:
-
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.0.0
Status: Resolved (was: Patch
[
https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986431#comment-14986431
]
Yi Liu commented on HDFS-9275:
--
Will commit shortly.
> Wait previous ErasureCodingWork to finish before
[
https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986476#comment-14986476
]
Yi Liu commented on HDFS-9348:
--
Thanks Uma for ping me, and Rakesh for the work. I think it makes sense to
[
https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986476#comment-14986476
]
Yi Liu edited comment on HDFS-9348 at 11/3/15 1:41 AM:
---
Thanks Uma for ping me, and
[
https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983905#comment-14983905
]
Yi Liu edited comment on HDFS-4937 at 10/31/15 8:46 AM:
Revert from trunk,
[
https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu reopened HDFS-4937:
--
> ReplicationMonitor can infinite-loop in
> BlockPlacementPolicyDefault#chooseRandom()
>
[
https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983905#comment-14983905
]
Yi Liu commented on HDFS-4937:
--
Revert from trunk, branch-2, branch-2.7. Thanks Brahma.
I thought the tests
[
https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983906#comment-14983906
]
Yi Liu edited comment on HDFS-4937 at 10/31/15 8:45 AM:
I did consider the
[
https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983906#comment-14983906
]
Yi Liu commented on HDFS-4937:
--
I did consider the situation you mentioned, But I thought in real env the NN
[
https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981789#comment-14981789
]
Yi Liu commented on HDFS-4937:
--
+1, thanks Kihwal.
> ReplicationMonitor can infinite-loop in
>
[
https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981710#comment-14981710
]
Yi Liu commented on HDFS-9276:
--
*1.* The code format is not correct. The indent is 2 spaces. If some line
[
https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981734#comment-14981734
]
Yi Liu commented on HDFS-9275:
--
{code}
+ if (pendingNum > 0) {
+// Wait the previous recovery to
[
https://issues.apache.org/jira/browse/HDFS-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977821#comment-14977821
]
Yi Liu commented on HDFS-9302:
--
OK, thanks Jagadesh, Akira, will commit shortly.
> WebHDFS throws
[
https://issues.apache.org/jira/browse/HDFS-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-9302:
-
Target Version/s: 2.8.0 (was: 2.8.0, 2.7.2)
> WebHDFS throws NullPointerException if newLength is not provided
>
[
https://issues.apache.org/jira/browse/HDFS-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-9302:
-
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.8.0
Status: Resolved (was: Patch
[
https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976233#comment-14976233
]
Yi Liu commented on HDFS-9275:
--
Walter, sorry I forgot this JIRA :-)
For continuous block, if n replicas are
[
https://issues.apache.org/jira/browse/HDFS-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977483#comment-14977483
]
Yi Liu commented on HDFS-9302:
--
Looks good, Jagadesh.
Just a small nit, +1 after addressing
- please put the
[
https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976479#comment-14976479
]
Yi Liu commented on HDFS-9276:
--
Now looks good overall.
*1.*
{code}
+
+ /**
+ * Create a private token for
[
https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976479#comment-14976479
]
Yi Liu edited comment on HDFS-9276 at 10/27/15 2:31 PM:
Now looks good overall.
[
https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973802#comment-14973802
]
Yi Liu edited comment on HDFS-7984 at 10/26/15 6:27 AM:
{quote}
there is no way for
[
https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973802#comment-14973802
]
Yi Liu commented on HDFS-7984:
--
{quote}
there is no way for an end user to create a token file with multiple
[
https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974277#comment-14974277
]
Yi Liu commented on HDFS-9276:
--
So it's the problem of service name of token for HA, there are three entries
[
https://issues.apache.org/jira/browse/HDFS-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu reopened HDFS-9293:
--
> FSEditLog's 'OpInstanceCache' instance of threadLocal cache exists dirty
> 'rpcId',which may cause standby NN
[
https://issues.apache.org/jira/browse/HDFS-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu resolved HDFS-9293.
--
Resolution: Duplicate
> FSEditLog's 'OpInstanceCache' instance of threadLocal cache exists dirty
>
[
https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973758#comment-14973758
]
Yi Liu commented on HDFS-9276:
--
{quote}
To reproduce the bug, please set the following configuration to Name
[
https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973758#comment-14973758
]
Yi Liu edited comment on HDFS-9276 at 10/26/15 5:39 AM:
{quote}
To reproduce the
[
https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973758#comment-14973758
]
Yi Liu edited comment on HDFS-9276 at 10/26/15 5:41 AM:
{quote}
To reproduce the
[
https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973249#comment-14973249
]
Yi Liu commented on HDFS-9276:
--
[~marsishandsome], Agree with Steve you need to move this to Hadoop common if
[
https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973249#comment-14973249
]
Yi Liu edited comment on HDFS-9276 at 10/25/15 1:57 PM:
[~marsishandsome], Agree
[
https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973256#comment-14973256
]
Yi Liu commented on HDFS-7984:
--
{quote}
String fileLocation = System.getenv(HADOOP_TOKEN_FILE_LOCATION);
...
[
https://issues.apache.org/jira/browse/HDFS-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973001#comment-14973001
]
Yi Liu commented on HDFS-9302:
--
[~Karthik Palaniappan], thanks for reporting this, it's better to return a
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968754#comment-14968754
]
Yi Liu commented on HDFS-9053:
--
Thanks for the discussion, Nicholas.
{quote}
BTW, why do we need two arrays
[
https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968797#comment-14968797
]
Yi Liu commented on HDFS-9275:
--
Walter, please add some description in the JIRA description part about what
[
https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970062#comment-14970062
]
Yi Liu commented on HDFS-7087:
--
I think there is no problem, thanks Andrew, the cherry-pick shows no
[
https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970093#comment-14970093
]
Yi Liu commented on HDFS-9275:
--
Thanks Walter for the update, I will review it tomorrow since I'm OOO today if
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969206#comment-14969206
]
Yi Liu commented on HDFS-9053:
--
{quote}
The advantages of having one array are 1) smaller memory footprint and
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969202#comment-14969202
]
Yi Liu commented on HDFS-9053:
--
{quote}
Could you give some examples?
{quote}
https://github.com/google/btree
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968277#comment-14968277
]
Yi Liu commented on HDFS-9053:
--
Thanks [~jingzhao]!
{quote}
My concern is if the number of directories is
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968277#comment-14968277
]
Yi Liu edited comment on HDFS-9053 at 10/22/15 12:51 AM:
-
Thanks [~jingzhao]!
[
https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968396#comment-14968396
]
Yi Liu commented on HDFS-7087:
--
That's right. I will help to revert it from branch-2 and re-commit it shortly.
[
https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-7087:
-
Attachment: HDFS-7087.003.branch-2.patch
recommit to branch-2, and attach the patch of branch-2 for track.
>
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968445#comment-14968445
]
Yi Liu commented on HDFS-9053:
--
Got it now. Thanks a lot [~jingzhao]!
Let's recalculate again. For original
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968445#comment-14968445
]
Yi Liu edited comment on HDFS-9053 at 10/22/15 3:34 AM:
Got it now. Thanks a lot
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964775#comment-14964775
]
Yi Liu commented on HDFS-9053:
--
The test failures are not related.
I plan to support {{shrinkable}} in future
Yi Liu created HDFS-9274:
Summary: Default value of
dfs.datanode.directoryscan.throttle.limit.ms.per.sec should be consistent
Key: HDFS-9274
URL: https://issues.apache.org/jira/browse/HDFS-9274
Project:
[
https://issues.apache.org/jira/browse/HDFS-9274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-9274:
-
Attachment: HDFS-9274.001.patch
> Default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec should
>
[
https://issues.apache.org/jira/browse/HDFS-9274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-9274:
-
Status: Patch Available (was: Open)
> Default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-9053:
-
Attachment: HDFS-9053.007.patch
> Support large directories efficiently using B-Tree
>
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964433#comment-14964433
]
Yi Liu commented on HDFS-9053:
--
Update the patch:
# Fix some checkstyles and the whitespace.
# Update few
[
https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-9208:
-
Resolution: Fixed
Fix Version/s: 2.8.0
Status: Resolved (was: Patch Available)
Committed to
[
https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962767#comment-14962767
]
Yi Liu commented on HDFS-7964:
--
1. That's right.
2. You can keep it.
> Add support for async edit logging
>
[
https://issues.apache.org/jira/browse/HDFS-8398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu resolved HDFS-8398.
--
Resolution: Duplicate
> Erasure Coding: Correctly calculate last striped block length in
>
[
https://issues.apache.org/jira/browse/HDFS-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu resolved HDFS-8059.
--
Resolution: Duplicate
> Erasure coding: revisit how to store EC schema and cellSize in NameNode
>
[
https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960114#comment-14960114
]
Yi Liu edited comment on HDFS-7964 at 10/16/15 6:40 AM:
Thanks [~daryn] for the
[
https://issues.apache.org/jira/browse/HDFS-8087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu resolved HDFS-8087.
--
Resolution: Invalid
Now, getErasureCodingPolicies and getErasureCodingPolicy are implemented, so
close it as
[
https://issues.apache.org/jira/browse/HDFS-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu resolved HDFS-8376.
--
Resolution: Invalid
> Erasure Coding: Update last cellsize calculation according to whether the
> erasure codec
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959955#comment-14959955
]
Yi Liu edited comment on HDFS-9053 at 10/16/15 12:56 AM:
-
Thanks [~szetszwo] for
[
https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-7964:
-
Status: Patch Available (was: Open)
> Add support for async edit logging
> --
>
>
[
https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960114#comment-14960114
]
Yi Liu commented on HDFS-7964:
--
Thanks [~daryn] for the work.
Further comments:
*1.* In FSEditLogAsync#run
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959988#comment-14959988
]
Yi Liu commented on HDFS-9053:
--
Hi Nicholas, sorry, I may bypass some description here. For 2047, I wanted to
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959955#comment-14959955
]
Yi Liu commented on HDFS-9053:
--
Thanks [~szetszwo] for the comments.
{quote}
>> 24 8 Object[]
[
https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-9221:
-
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.8.0
Status: Resolved (was: Patch
[
https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8988:
-
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.8.0
Status: Resolved (was: Patch
[
https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952724#comment-14952724
]
Yi Liu commented on HDFS-8988:
--
Thanks [~umamaheswararao] for the review, the test failure are not related and
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-9053:
-
Comment: was deleted
(was: \\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime ||
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-9053:
-
Attachment: HDFS-9053.005.patch
> Support large directories efficiently using B-Tree
>
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949847#comment-14949847
]
Yi Liu edited comment on HDFS-9053 at 10/9/15 8:49 AM:
---
Hi [~szetszwo], thanks for
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950082#comment-14950082
]
Yi Liu commented on HDFS-9053:
--
Update the patch. The new patch uses an array list if the children size is
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950084#comment-14950084
]
Yi Liu commented on HDFS-9053:
--
The increased memory usage is only 8 bytes in {{SortedCollection}} comparing
[
https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8988:
-
Attachment: HDFS-8988.002.patch
Rebase the patch.
> Use LightWeightHashSet instead of LightWeightLinkedSet in
>
[
https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8988:
-
Priority: Major (was: Minor)
> Use LightWeightHashSet instead of LightWeightLinkedSet in
>
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-9053:
-
Attachment: HDFS-9053.006.patch
> Support large directories efficiently using B-Tree
>
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950498#comment-14950498
]
Yi Liu edited comment on HDFS-9053 at 10/9/15 2:51 PM:
---
I find a good approach to
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950498#comment-14950498
]
Yi Liu commented on HDFS-9053:
--
I find a good approach to improve B-Tree overhead to make it only increase *8
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14948629#comment-14948629
]
Yi Liu commented on HDFS-9053:
--
Hi [~szetszwo], do you have further comments about it? Thanks.
> Support
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949847#comment-14949847
]
Yi Liu commented on HDFS-9053:
--
Hi [~szetszwo], thanks for your comments.
I will do as your suggestion: use
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949847#comment-14949847
]
Yi Liu edited comment on HDFS-9053 at 10/9/15 3:51 AM:
---
Hi [~szetszwo], thanks for
[
https://issues.apache.org/jira/browse/HDFS-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947963#comment-14947963
]
Yi Liu commented on HDFS-9137:
--
+1, thanks Uma, Colin and Vinay.
> DeadLock between DataNode#refreshVolumes
[
https://issues.apache.org/jira/browse/HDFS-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-9137:
-
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.8.0
Target Version/s: 2.8.0
[
https://issues.apache.org/jira/browse/HDFS-9212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu resolved HDFS-9212.
--
Resolution: Invalid
Send email to u...@hadoop.apache.org
> Are there any official performance tests or reports
[
https://issues.apache.org/jira/browse/HDFS-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14946085#comment-14946085
]
Yi Liu commented on HDFS-9137:
--
I think it's OK to do the fix using this approach and update the
[
https://issues.apache.org/jira/browse/HDFS-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14946080#comment-14946080
]
Yi Liu commented on HDFS-9182:
--
The patch looks good to me too. Thanks [~umamaheswararao] and [~jingzhao].
[
https://issues.apache.org/jira/browse/HDFS-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944873#comment-14944873
]
Yi Liu commented on HDFS-9180:
--
+1, thanks [~jingzhao], also thanks Walter for the review.
> Update excluded
[
https://issues.apache.org/jira/browse/HDFS-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14942520#comment-14942520
]
Yi Liu commented on HDFS-9137:
--
Thanks Uma for the patch. I agree we don't need synchronization of
[
https://issues.apache.org/jira/browse/HDFS-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14942000#comment-14942000
]
Yi Liu commented on HDFS-9180:
--
{quote}
I kicked the Jenkins again. If we all agree the fixes here are valid
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14942004#comment-14942004
]
Yi Liu edited comment on HDFS-9053 at 10/3/15 12:49 AM:
Thanks [~szetszwo], good
1 - 100 of 1473 matches
Mail list logo