[jira] [Updated] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-10827: Attachment: HDFS-10827.4.patch I uploaded a new patch. It uses

[jira] [Updated] (HDFS-11008) Add unit test for parsing "-source" parameter in Balancer tool

[ https://issues.apache.org/jira/browse/HDFS-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11008: - Status: Patch Available (was: Open) > Add unit test for parsing "-source" parameter in Balancer

[jira] [Updated] (HDFS-11008) Add unit test for parsing "-source" parameter in Balancer tool

[ https://issues.apache.org/jira/browse/HDFS-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11008: - Description: [HDFS-8826] added an option {{-source}} to specify the source node list so that

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573882#comment-15573882 ] Brahma Reddy Battula commented on HDFS-10987: - Thanks all. > Make Decommission less expensive

[jira] [Commented] (HDFS-11008) Add unit test for parsing "-source" parameter in Balancer tool

[ https://issues.apache.org/jira/browse/HDFS-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573917#comment-15573917 ] Hadoop QA commented on HDFS-11008: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574154#comment-15574154 ] Takanobu Asanuma commented on HDFS-10827: - bq. As follow-on work, maybe we can create a utility

[jira] [Created] (HDFS-11008) Add unit test for parsing "-source" parameter in Balancer tool

Mingliang Liu created HDFS-11008: Summary: Add unit test for parsing "-source" parameter in Balancer tool Key: HDFS-11008 URL: https://issues.apache.org/jira/browse/HDFS-11008 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11010) Update to Protobuf 3 in trunk

[ https://issues.apache.org/jira/browse/HDFS-11010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11010: Issue Type: Improvement (was: Bug) > Update to Protobuf 3 in trunk > -

[jira] [Updated] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10990: --- Attachment: HDFS-10990.004.branch-2.patch Attaching the same file for branch-2. >

[jira] [Commented] (HDFS-11010) Update to Protobuf 3 in trunk

[ https://issues.apache.org/jira/browse/HDFS-11010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573801#comment-15573801 ] Andrew Wang commented on HDFS-11010: I'm really hesitant to bump PB considering the pain it brought

[jira] [Commented] (HDFS-11007) AliyunOSSInputStream#read() should update read bytes stat correctly

[ https://issues.apache.org/jira/browse/HDFS-11007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573684#comment-15573684 ] Kai Zheng commented on HDFS-11007: -- Thanks [~liuml07] for the reporting. The patch LGTM and +1. Will

[jira] [Updated] (HDFS-11008) Add unit test for parsing "-source" parameter in Balancer tool

[ https://issues.apache.org/jira/browse/HDFS-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11008: - Attachment: HDFS-11008.000.patch [~szetszwo] Could you kindly review? Thanks. > Add unit test

[jira] [Updated] (HDFS-11008) Add unit test for parsing "-source" parameter in Balancer tool

[ https://issues.apache.org/jira/browse/HDFS-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11008: - Description: [HDFS-8826] added an option to specify the source node list so that balancer only

[jira] [Updated] (HDFS-11008) Add unit test for parsing "-source" parameter in Balancer tool

[ https://issues.apache.org/jira/browse/HDFS-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11008: - Component/s: tools > Add unit test for parsing "-source" parameter in Balancer tool >

[jira] [Commented] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

[ https://issues.apache.org/jira/browse/HDFS-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573735#comment-15573735 ] Andrew Wang commented on HDFS-10883: Thanks for working on this [~yuanbo], just one nit: *

[jira] [Created] (HDFS-11009) Add a tool to reconstruct block meta file from CLI

Xiao Chen created HDFS-11009: Summary: Add a tool to reconstruct block meta file from CLI Key: HDFS-11009 URL: https://issues.apache.org/jira/browse/HDFS-11009 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-11010) Update to Protobuf 3 n trunk

Anu Engineer created HDFS-11010: --- Summary: Update to Protobuf 3 n trunk Key: HDFS-11010 URL: https://issues.apache.org/jira/browse/HDFS-11010 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-11010) Update to Protobuf 3 in trunk

[ https://issues.apache.org/jira/browse/HDFS-11010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11010: Summary: Update to Protobuf 3 in trunk (was: Update to Protobuf 3 n trunk) > Update to Protobuf 3

[jira] [Commented] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574328#comment-15574328 ] Hadoop QA commented on HDFS-10827: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11003) Expose "XmitsInProgress" through DataNodeMXBean

Brahma Reddy Battula created HDFS-11003: --- Summary: Expose "XmitsInProgress" through DataNodeMXBean Key: HDFS-11003 URL: https://issues.apache.org/jira/browse/HDFS-11003 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571411#comment-15571411 ] Takanobu Asanuma commented on HDFS-10827: - This jira will solve HDFS-10975. > When there are

[jira] [Updated] (HDFS-11003) Expose "XmitsInProgress" through DataNodeMXBean

[ https://issues.apache.org/jira/browse/HDFS-11003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11003: Assignee: Brahma Reddy Battula Status: Patch Available (was: Open) > Expose

[jira] [Updated] (HDFS-11003) Expose "XmitsInProgress" through DataNodeMXBean

[ https://issues.apache.org/jira/browse/HDFS-11003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11003: Attachment: HDFS-11003.patch Uploaded the patch .kindly review. > Expose

[jira] [Commented] (HDFS-10827) When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

[ https://issues.apache.org/jira/browse/HDFS-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571403#comment-15571403 ] Takanobu Asanuma commented on HDFS-10827: - Thanks for your confirmation. I will upload the next

[jira] [Commented] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

[ https://issues.apache.org/jira/browse/HDFS-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571395#comment-15571395 ] Takanobu Asanuma commented on HDFS-10975: - "fsck -list-corruptfileblocks" calls

[jira] [Commented] (HDFS-11003) Expose "XmitsInProgress" through DataNodeMXBean

[ https://issues.apache.org/jira/browse/HDFS-11003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571487#comment-15571487 ] Hadoop QA commented on HDFS-11003: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10905) Refactor DataStreamer#createBlockOutputStream

[ https://issues.apache.org/jira/browse/HDFS-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571467#comment-15571467 ] Yuanbo Liu commented on HDFS-10905: --- [~jojochuang] {{DataStreamer#createBlockOutputStream}} is based on

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571926#comment-15571926 ] Brahma Reddy Battula commented on HDFS-10987: - hmm..it was coincidence( same time we

[jira] [Commented] (HDFS-10990) TestPendingInvalidateBlock should wait for IBRs

[ https://issues.apache.org/jira/browse/HDFS-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571980#comment-15571980 ] Yiqun Lin commented on HDFS-10990: -- The failed test are not related. Hi, [~andrew.wang], can make a quick

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571896#comment-15571896 ] Vinayakumar B commented on HDFS-10987: -- Looks good to me. +1 > Make Decommission less expensive when

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571905#comment-15571905 ] Brahma Reddy Battula commented on HDFS-10987: - [~vinayrpet] thanks for review, will wait for

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571904#comment-15571904 ] Kihwal Lee commented on HDFS-10987: --- +1 from me too. Will commit it shortly. > Make Decommission less

[jira] [Commented] (HDFS-11000) webhdfs PUT does not work if requests are routed to call queue.

[ https://issues.apache.org/jira/browse/HDFS-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571913#comment-15571913 ] Daryn Sharp commented on HDFS-11000: +1 > webhdfs PUT does not work if requests are routed to call

[jira] [Commented] (HDFS-10987) Make Decommission less expensive when lot of blocks present.

[ https://issues.apache.org/jira/browse/HDFS-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571920#comment-15571920 ] Kihwal Lee commented on HDFS-10987: --- Ok. Not committing. Let's wait for Andrew. > Make Decommission

[jira] [Commented] (HDFS-11000) webhdfs PUT does not work if requests are routed to call queue.

[ https://issues.apache.org/jira/browse/HDFS-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572010#comment-15572010 ] Hudson commented on HDFS-11000: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10600 (See

[jira] [Updated] (HDFS-11000) webhdfs PUT does not work if requests are routed to call queue.

[ https://issues.apache.org/jira/browse/HDFS-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11000: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11000) webhdfs PUT does not work if requests are routed to call queue.

[ https://issues.apache.org/jira/browse/HDFS-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11000: -- Description: If webhdfs calls are routed to ipc call queue, PUT does not work. I think this is what we

[jira] [Commented] (HDFS-11002) Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md

[ https://issues.apache.org/jira/browse/HDFS-11002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570970#comment-15570970 ] Hudson commented on HDFS-11002: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10599 (See

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570992#comment-15570992 ] SammiChen commented on HDFS-10935: -- Hi Wei-Chiu Chuang, "java.lang.OutOfMemoryError" indicate that JVM

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571000#comment-15571000 ] SammiChen commented on HDFS-10935: -- Hi Wei-CHiu, I'd like to know how you launch the TestFileChecksum

[jira] [Commented] (HDFS-10996) Ability to specify per-file EC policy at create time

[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571012#comment-15571012 ] SammiChen commented on HDFS-10996: -- Hi [~andrew.wang], I'd like to take this task if you don't mind. >

<    1   2