[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Affects Version/s: (was: 3.2.1) (was: 2.9.2) > Split DataNode FsDatasetImpl

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Target Version/s: (was: 3.2.0, 2.9.2) > Split DataNode FsDatasetImpl lock to blockpool volume lock >

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Attachment: (was: image-2020-06-02.png) > Split DataNode FsDatasetImpl lock to blockpool volume lock >

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Attachment: image-2020-06-02.png > Split DataNode FsDatasetImpl lock to blockpool volume lock >

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Affects Version/s: 2.9.2 3.2.1 > Split DataNode FsDatasetImpl lock to blockpool

[jira] [Work started] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15382 started by Aiphago. -- > Split DataNode FsDatasetImpl lock to blockpool volume lock >

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Fix Version/s: 2.9.2 3.2.1 > Split DataNode FsDatasetImpl lock to blockpool volume lock

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Fix Version/s: (was: 2.9.2) > Split DataNode FsDatasetImpl lock to blockpool volume lock >

[jira] [Created] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
Aiphago created HDFS-15382: -- Summary: Split DataNode FsDatasetImpl lock to blockpool volume lock Key: HDFS-15382 URL: https://issues.apache.org/jira/browse/HDFS-15382 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123340#comment-17123340 ] Hadoop QA commented on HDFS-15379: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-01 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15346: --- Attachment: HDFS-15346.005.patch > RBF: DistCpFedBalance implementation >

[jira] [Updated] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-01 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15346: --- Attachment: HDFS-15346.005.patch > RBF: DistCpFedBalance implementation >

[jira] [Updated] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-01 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15346: --- Attachment: (was: HDFS-15346.005.patch) > RBF: DistCpFedBalance implementation >

[jira] [Commented] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-01 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121517#comment-17121517 ] Jinglun commented on HDFS-15346: Hi [~linyiqun], thanks your great comments ! Yes it is a big patch, 

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Status: Open (was: Patch Available) > DataStreamer should reset thread interrupted state in

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Attachment: HDFS-15379.004.patch Target Version/s: (was: 3.3.0) Status: Patch Available

[jira] [Commented] (HDFS-14773) SWEBHDFS closes the connection before a client can read the error response for a DSQuotaExceededException

2020-06-01 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121283#comment-17121283 ] Simbarashe Dzinamarira commented on HDFS-14773: --- [~zhaoyim] so I encountered the error with

[jira] [Updated] (HDFS-14773) SWEBHDFS closes the connection before a client can read the error response for a DSQuotaExceededException

2020-06-01 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-14773: -- Affects Version/s: 2.7.0 > SWEBHDFS closes the connection before a client can

[jira] [Commented] (HDFS-15321) Make DFSAdmin tool to work with ViewFSOverloadScheme

2020-06-01 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121179#comment-17121179 ] Uma Maheswara Rao G commented on HDFS-15321: I have updated the PR for review! Thanks > Make

[jira] [Commented] (HDFS-15377) BlockScanner scans one part per round, expect full scans after several rounds

2020-06-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121054#comment-17121054 ] Hadoop QA commented on HDFS-15377: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Fix Version/s: (was: 3.3.0) > DataStreamer should reset thread interrupted state in createBlockOutputStream

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Attachment: HDFS-15379.003.patch Status: Patch Available (was: Open) > DataStreamer should reset thread

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Target Version/s: 3.3.0 (was: 3.1.3) Status: Open (was: Patch Available) > DataStreamer should

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Fix Version/s: (was: 3.1.3) 3.3.0 > DataStreamer should reset thread interrupted state in

[jira] [Commented] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120991#comment-17120991 ] Hadoop QA commented on HDFS-15379: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-01 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120981#comment-17120981 ] Yiqun Lin edited comment on HDFS-15346 at 6/1/20, 12:23 PM: Hi [~LiJinglun] ,

[jira] [Commented] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-01 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120981#comment-17120981 ] Yiqun Lin commented on HDFS-15346: -- Hi [~LiJinglun] , some initial review comments from me:

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Attachment: HDFS-15379.002.patch Status: Patch Available (was: Open) > DataStreamer should reset thread

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Status: Open (was: Patch Available) > DataStreamer should reset thread interrupted state in

[jira] [Commented] (HDFS-15370) listStatus and getFileStatus behave inconsistent in the case of ViewFs implementation for isDirectory

2020-06-01 Thread Srinivasu Majeti (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120934#comment-17120934 ] Srinivasu Majeti commented on HDFS-15370: - Thank you for the quick clarification

[jira] [Updated] (HDFS-15377) BlockScanner scans one part per round, expect full scans after several rounds

2020-06-01 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15377: Status: Open (was: Patch Available) > BlockScanner scans one part per round, expect full scans after

[jira] [Updated] (HDFS-15377) BlockScanner scans one part per round, expect full scans after several rounds

2020-06-01 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15377: Attachment: HDFS-15377.004.patch Status: Patch Available (was: Open) > BlockScanner scans one

[jira] [Commented] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120881#comment-17120881 ] Hadoop QA commented on HDFS-15379: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120133#comment-17120133 ] ludun edited comment on HDFS-15379 at 6/1/20, 8:42 AM: --- [~brahmareddy] please

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Attachment: HDFS-15379.001.patch Fix Version/s: 3.1.3 Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Attachment: (was: HDFS-15379.001.patch) > DataStreamer should reset thread interrupted state in

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-06-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120816#comment-17120816 ] Ayush Saxena commented on HDFS-15359: - Test Failures not related. the Xmits ones failed in other

[jira] [Updated] (HDFS-15374) RBF: Add documentation for fedbalance tool

2020-06-01 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15374: - Summary: RBF: Add documentation for fedbalance tool (was: Add documentation for command `fedbalance`)

[jira] [Updated] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-01 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15346: - Summary: RBF: DistCpFedBalance implementation (was: RBF: Balance data across federation namespaces with