[
https://issues.apache.org/jira/browse/HDFS-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-8053:
Attachment: HDFS-8053.001.patch
The v1 patch rebases from the {{trunk}} branch after separate jiras
[
https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-8990:
Attachment: HDFS-8990.000.patch
The v0 patch moves the {{RemoteBlockReader}} and
[
https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-8990:
Attachment: HDFS-8990.001.patch
Move RemoteBlockReader to hdfs-client module
Mingliang Liu created HDFS-8990:
---
Summary: Move RemoteBlockReader to hdfs-client module
Key: HDFS-8990
URL: https://issues.apache.org/jira/browse/HDFS-8990
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-8990:
Fix Version/s: (was: 2.8.0)
Move RemoteBlockReader to hdfs-client module
[
https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-8990:
Hadoop Flags: (was: Reviewed)
Move RemoteBlockReader to hdfs-client module
[
https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-8990:
Description: This jira tracks the effort of moving the
{{RemoteBlockReader}} class into the
[
https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-8990:
Description:
This jira tracks the effort of moving the {{RemoteBlockReader}} class into the
[
https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-8990:
Description:
This jira tracks the effort of moving the {{RemoteBlockReader}} class into the
[
https://issues.apache.org/jira/browse/HDFS-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720812#comment-14720812
]
Mingliang Liu commented on HDFS-8990:
-
Thanks [~wheat9]!
The wrong constant typo was
[
https://issues.apache.org/jira/browse/HDFS-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945427#comment-14945427
]
Mingliang Liu commented on HDFS-9202:
-
Thanks for filing this. The [HDFS-8740] was not aware of the
[
https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047332#comment-15047332
]
Mingliang Liu commented on HDFS-9521:
-
Thanks for reporting this, I also think the detailed time will
[
https://issues.apache.org/jira/browse/HDFS-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9522:
Summary: Cleanup o.a.h.hdfs.protocol.SnapshotDiffReport$DiffReportEntry
(was: Cleanup
[
https://issues.apache.org/jira/browse/HDFS-8555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047286#comment-15047286
]
Mingliang Liu commented on HDFS-8555:
-
Would you kindly explain more by "... only those blocks which
[
https://issues.apache.org/jira/browse/HDFS-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047341#comment-15047341
]
Mingliang Liu commented on HDFS-9522:
-
Refined the title slightly.
> Cleanup
[
https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu reopened HDFS-9129:
-
> Move the safemode block count into BlockManager
> ---
>
[
https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9129:
Status: Patch Available (was: Reopened)
> Move the safemode block count into BlockManager
>
[
https://issues.apache.org/jira/browse/HDFS-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034593#comment-15034593
]
Mingliang Liu commented on HDFS-9485:
-
Thanks [~jingzhao] for your review and commit.
> Make
[
https://issues.apache.org/jira/browse/HDFS-9300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9300:
Summary: TestDirectoryScanner.testThrottle() is still a little flakey
(was:
[
https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034803#comment-15034803
]
Mingliang Liu commented on HDFS-9484:
-
Failing tests are not related and can not re-produce locally.
>
Mingliang Liu created HDFS-9498:
---
Summary: Move BlockManager#numberOfBytesInFutureBlocks to
BlockManagerSafeMode
Key: HDFS-9498
URL: https://issues.apache.org/jira/browse/HDFS-9498
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9436:
Attachment: HDFS-9436.002.patch
Thank you very much [~shv] for your review. Sending a couple of
[
https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037435#comment-15037435
]
Mingliang Liu commented on HDFS-9484:
-
The failing tests seem unrelated.
>
[
https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037433#comment-15037433
]
Mingliang Liu commented on HDFS-9436:
-
The failing tests seem unrelated.
Specially,
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9498:
Summary: Move code that tracks orphan blocks to BlockManagerSafeMode (was:
Move
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9498:
Attachment: HDFS-9498.000.patch
> Move code that tracks orphan blocks to BlockManagerSafeMode
>
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9498:
Status: Patch Available (was: Open)
> Move code that tracks orphan blocks to BlockManagerSafeMode
>
[
https://issues.apache.org/jira/browse/HDFS-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9506:
Issue Type: Task (was: Sub-task)
Parent: (was: HDFS-8966)
> Move invalidate blocks to
[
https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9442:
Attachment: HDFS-9442.007.patch
The v7 patch is to move {{InvalidateBlocks}} to
[
https://issues.apache.org/jira/browse/HDFS-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu resolved HDFS-9506.
-
Resolution: Duplicate
As we keep updating the patch for [HDFS-9442], this issue is addressed
[
https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038353#comment-15038353
]
Mingliang Liu commented on HDFS-9484:
-
[~shv] Thank you very much for your review, discussion and
[
https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu reassigned HDFS-9503:
---
Assignee: Mingliang Liu
> Replace -namenode option with -fs for NNThroughputBenchmark
>
[
https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038411#comment-15038411
]
Mingliang Liu commented on HDFS-9503:
-
Feel free to re-assign it to someone who's actively working on
[
https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038766#comment-15038766
]
Mingliang Liu commented on HDFS-9214:
-
The latest patch looks good to me. Thanks.
> Reconfigure DN
[
https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038772#comment-15038772
]
Mingliang Liu commented on HDFS-9442:
-
s/v5/v6/
I mean, "v6 patch is to...". Sorry for the confusion.
[
https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9442:
Attachment: HDFS-9442.006.patch
Thanks [~wheat9] for your review. The v5 patch is to address this.
[
https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038826#comment-15038826
]
Mingliang Liu commented on HDFS-9436:
-
Thanks for suggesting this jira, reviewing and committing the
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9498:
Attachment: HDFS-9498.001.patch
The v1 patch is to address
[
https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036894#comment-15036894
]
Mingliang Liu commented on HDFS-9129:
-
{noformat}
Step 16 : RUN cd /usr/share/maven/lib && ln -s
[
https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15039546#comment-15039546
]
Mingliang Liu commented on HDFS-9442:
-
Failing tests can not re-produce locally.
Specially,
[
https://issues.apache.org/jira/browse/HDFS-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9506:
Description:
The [HDFS-9442] moves basic replication mechanism from {{BlockManager}} to
newly added
Mingliang Liu created HDFS-9506:
---
Summary: Move invalidate blocks to ReplicationManager
Key: HDFS-9506
URL: https://issues.apache.org/jira/browse/HDFS-9506
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9129:
Attachment: HDFS-9129-branch-2.025.patch
Thank you very much [~jingzhao] for your review, discussion
Mingliang Liu created HDFS-9493:
---
Summary: Test o.a.h.hdfs.server.namenode.TestMetaSave fails in
trunk
Key: HDFS-9493
URL: https://issues.apache.org/jira/browse/HDFS-9493
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035016#comment-15035016
]
Mingliang Liu commented on HDFS-9445:
-
The _bposLock --> FSDatasetLock_ locking order looks good to me.
[
https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9442:
Attachment: HDFS-9442.005.patch
The v5 patch rebases from {{trunk}} branch and fixes conflicts.
>
[
https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9484:
Attachment: HDFS-9484.000.patch
> NNThroughputBenchmark$BlockReportStats should not send empty block
[
https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9484:
Status: Patch Available (was: Open)
> NNThroughputBenchmark$BlockReportStats should not send empty
[
https://issues.apache.org/jira/browse/HDFS-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046242#comment-15046242
]
Mingliang Liu commented on HDFS-9319:
-
+1 (non-binding)
> Make DatanodeInfo thread safe
>
[
https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045815#comment-15045815
]
Mingliang Liu commented on HDFS-9129:
-
Thanks for review and commit the {{branch-2}} patch,
[
https://issues.apache.org/jira/browse/HDFS-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046030#comment-15046030
]
Mingliang Liu commented on HDFS-9519:
-
Thanks for reporting this, [~yzhangal]. The condition check is
[
https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9442:
Attachment: HDFS-9442.008.patch
The v8 patch is to move the {{CorruptReplicasMap}} to
[
https://issues.apache.org/jira/browse/HDFS-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046141#comment-15046141
]
Mingliang Liu commented on HDFS-9441:
-
+1 (non-binding) to remove it.
> Do not construct path string
[
https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9484:
Attachment: HDFS-9484.001.patch
Thanks for the comment, [~shv].
I totally agree with you that the
[
https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9535:
Priority: Major (was: Minor)
> Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate
>
[
https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9535:
Status: Patch Available (was: Open)
> Fix
[
https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9535:
Attachment: HDFS-9535.000.patch
The v0 patch mocks the {{BlockManager#hasMinStorage}}. This way, the
[
https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053819#comment-15053819
]
Mingliang Liu commented on HDFS-9535:
-
Thanks [~jingzhao] and [~iwasakims] for your comments. The
[
https://issues.apache.org/jira/browse/HDFS-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058637#comment-15058637
]
Mingliang Liu commented on HDFS-9557:
-
Does the general case fall into {{ByteString.copyFrom}}?
>
[
https://issues.apache.org/jira/browse/HDFS-9566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060928#comment-15060928
]
Mingliang Liu commented on HDFS-9566:
-
+1 (non-binding) pending on Jenkins.
> Remove expensive
[
https://issues.apache.org/jira/browse/HDFS-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060934#comment-15060934
]
Mingliang Liu commented on HDFS-9565:
-
+1 (non-binding)
>
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9498:
Attachment: HDFS-9498.002.patch
The v2 patch rebases from {{trunk}} branch and resolves some trivial
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061374#comment-15061374
]
Mingliang Liu commented on HDFS-9498:
-
The failing tests can not reproduce locally. Seem not related.
[
https://issues.apache.org/jira/browse/HDFS-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15054815#comment-15054815
]
Mingliang Liu commented on HDFS-9493:
-
Hi [~twu],
Thanks for working on this. I think you analysis is
[
https://issues.apache.org/jira/browse/HDFS-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056792#comment-15056792
]
Mingliang Liu commented on HDFS-9493:
-
Thanks for the prompt update.
+1 (non-binding) pending on
[
https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9535:
Summary: Newly completed blocks are lazily considered under-replicated when
processing IBR (was:
[
https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9503:
Attachment: HDFS-9053.000.patch
The v0 patch:
* replace the {{-namenode}} with {{-fs}}
* Add a unit
[
https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9503:
Status: Patch Available (was: Open)
> Replace -namenode option with -fs for NNThroughputBenchmark
>
[
https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9535:
Attachment: HDFS-9535.001.patch
> Newly completed blocks in IBR should not be considered
[
https://issues.apache.org/jira/browse/HDFS-9528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053870#comment-15053870
]
Mingliang Liu commented on HDFS-9528:
-
+1 (non-binding)
> Cleanup namenode audit/log/exception
[
https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9535:
Attachment: HDFS-9535.002.patch
> Newly completed blocks in IBR should not be considered
[
https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053940#comment-15053940
]
Mingliang Liu commented on HDFS-9535:
-
Thank you both for the comment. The v2 patch is to address this.
[
https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9535:
Component/s: namenode
> Newly completed blocks in IBR should not be considered under-replicated too
[
https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9535:
Summary: Newly completed blocks in IBR should not be considered
under-replicated too quickly (was:
[
https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052397#comment-15052397
]
Mingliang Liu commented on HDFS-9535:
-
Thanks for the insightful discussion.
When client closes the
[
https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056559#comment-15056559
]
Mingliang Liu commented on HDFS-9521:
-
The overhead should be fine. Overall information may be useful
[
https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056457#comment-15056457
]
Mingliang Liu commented on HDFS-9555:
-
Thanks for reporting this.
I'm not sure swallowing
[
https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056476#comment-15056476
]
Mingliang Liu commented on HDFS-9535:
-
Thanks to [~jingzhao] for cutting this jira, reviewing and
[
https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15054079#comment-15054079
]
Mingliang Liu commented on HDFS-9535:
-
Failing tests can not be re-produced locally. Seem unrelated?
>
[
https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086043#comment-15086043
]
Mingliang Liu commented on HDFS-9618:
-
Thanks for working on this, [~iwasakims]i].
Calling
[
https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086050#comment-15086050
]
Mingliang Liu commented on HDFS-9618:
-
We have 5 levels of priority queues and the aggregation should
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086055#comment-15086055
]
Mingliang Liu commented on HDFS-9498:
-
Thank you [~arpitagarwal] for your insightful comments and
[
https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086063#comment-15086063
]
Mingliang Liu commented on HDFS-9618:
-
+1 (non-binding)
> Fix mismatch between log level and guard in
[
https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9618:
Component/s: namenode
> Fix mismatch between log level and guard in
>
[
https://issues.apache.org/jira/browse/HDFS-9617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086069#comment-15086069
]
Mingliang Liu commented on HDFS-9617:
-
If this is not yet confirmed a bug or a feature request, please
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074400#comment-15074400
]
Mingliang Liu commented on HDFS-9498:
-
Thanks for your interest. I'm not blocked by this so following
[
https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074309#comment-15074309
]
Mingliang Liu commented on HDFS-9601:
-
Thanks for working on this, [~iwasakims]. I think the patch
[
https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074341#comment-15074341
]
Mingliang Liu commented on HDFS-9600:
-
Thanks [~yangzhe1991] for reporting this. The fix looks good to
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083943#comment-15083943
]
Mingliang Liu commented on HDFS-9498:
-
Thanks for the further discussion.
I should wrote my last
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9498:
Description:
[HDFS-4015] counts and reports orphaned blocks {{numberOfBytesInFutureBlocks}}
in
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083799#comment-15083799
]
Mingliang Liu commented on HDFS-9498:
-
Thanks [~arpitagarwal] for your comment.
Suppose the NN is in
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083800#comment-15083800
]
Mingliang Liu commented on HDFS-9498:
-
Good suggestion. I'll update the patch.
> Move code that tracks
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9498:
Target Version/s: 3.0.0 (was: 2.8.0)
> Move code that tracks orphan blocks to BlockManagerSafeMode
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9498:
Attachment: HDFS-9498.004.patch
The v4 patch addresses [~arpitagarwal]'s comments. Specially,
*
[
https://issues.apache.org/jira/browse/HDFS-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067239#comment-15067239
]
Mingliang Liu commented on HDFS-9590:
-
# Do you mean {{Storage$StorageDirectory#unlock()}}? There is no
[
https://issues.apache.org/jira/browse/HDFS-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067286#comment-15067286
]
Mingliang Liu commented on HDFS-9590:
-
{quote}
2 threads are calling unlock()
{quote}
Oh, I thought it
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068915#comment-15068915
]
Mingliang Liu commented on HDFS-9498:
-
Failing tests can not reproduce locally, and seem unrelated.
>
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15065068#comment-15065068
]
Mingliang Liu commented on HDFS-9498:
-
Thanks [~anu] for your comment.
Yes we should check the orphan
[
https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9498:
Attachment: HDFS-9498.003.patch
The v3 patch rebases from the {{trunk}} branch. Thanks [~anu] for
[
https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-9503:
Status: Open (was: Patch Available)
> Replace -namenode option with -fs for NNThroughputBenchmark
>
501 - 600 of 1745 matches
Mail list logo
