[jira] [Commented] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707882#comment-15707882 ] Kai Zheng commented on HDFS-10994: -- Note there was a mistake in the previous commit, by wrongly deleting

[jira] [Comment Edited] (HDFS-11191) In the command “hdfs dfsadmin -report” The Configured Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file sys

[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707849#comment-15707849 ] Deepak Chander edited comment on HDFS-11191 at 11/30/16 7:39 AM: - If the

[jira] [Updated] (HDFS-11191) In the command “hdfs dfsadmin -report” The Configured Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Chander updated HDFS-11191: -- Description: In the command “hdfs dfsadmin -report” The Configured Capacity is misleading if

[jira] [Created] (HDFS-11191) In the command “hdfs dfsadmin -report” The Configured Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

Deepak Chander created HDFS-11191: - Summary: In the command “hdfs dfsadmin -report” The Configured Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system. Key: HDFS-11191

[jira] [Commented] (HDFS-5517) Lower the default maximum number of blocks per file

[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707833#comment-15707833 ] Akira Ajisaka commented on HDFS-5517: - LGTM, +1. Thanks Andrew. > Lower the default maximum number of

[jira] [Commented] (HDFS-11171) add metric to report client shortcircuit reads

[ https://issues.apache.org/jira/browse/HDFS-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707801#comment-15707801 ] 5feixiang commented on HDFS-11171: -- Now I have not find the good method to get short-circuit read bytes

[jira] [Comment Edited] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707772#comment-15707772 ] Jingcheng Du edited comment on HDFS-9668 at 11/30/16 7:00 AM: -- Thanks a lot

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707772#comment-15707772 ] Jingcheng Du commented on HDFS-9668: Thanks a lot for comments [~arpitagarwal]! bq.

[jira] [Commented] (HDFS-11100) Recursively deleting file protected by sticky bit should fail

[ https://issues.apache.org/jira/browse/HDFS-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707724#comment-15707724 ] Yongjun Zhang commented on HDFS-11100: -- Sure [~jzhuge], I did not mean that we need to implement item

[jira] [Updated] (HDFS-11190) Namenode support for data stored in external stores.

[ https://issues.apache.org/jira/browse/HDFS-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11190: -- Description: The goal of this JIRA is to enable the Namenode to know about blocks that

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707711#comment-15707711 ] Yuanbo Liu commented on HDFS-11150: --- [~rakeshr] Thanks for your response. I have one question about my

[jira] [Updated] (HDFS-11190) Namenode support for data stored in external stores.

[ https://issues.apache.org/jira/browse/HDFS-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11190: -- Issue Type: Sub-task (was: Task) Parent: HDFS-9806 > Namenode support for data

[jira] [Created] (HDFS-11190) Namenode support for data stored in external stores.

Virajith Jalaparti created HDFS-11190: - Summary: Namenode support for data stored in external stores. Key: HDFS-11190 URL: https://issues.apache.org/jira/browse/HDFS-11190 Project: Hadoop HDFS

[jira] [Created] (HDFS-11189) WebHDFS and FollowRedirects

Oscar Guadilla created HDFS-11189: - Summary: WebHDFS and FollowRedirects Key: HDFS-11189 URL: https://issues.apache.org/jira/browse/HDFS-11189 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-11100) Recursively deleting file protected by sticky bit should fail

[ https://issues.apache.org/jira/browse/HDFS-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707690#comment-15707690 ] John Zhuge commented on HDFS-11100: --- [~yzhangal] Thanks for the great review! Item 4 may be hard

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707674#comment-15707674 ] Xiaoyu Yao commented on HDFS-10930: --- Thanks [~arpitagarwal] for the review and commit. I will post a

[jira] [Commented] (HDFS-11100) Recursively deleting file protected by sticky bit should fail

[ https://issues.apache.org/jira/browse/HDFS-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707672#comment-15707672 ] Yongjun Zhang commented on HDFS-11100: -- Hi [~jzhuge], Thanks for reporting the issue and the patch.

[jira] [Updated] (HDFS-11171) add metric to report client shortcircuit reads

[ https://issues.apache.org/jira/browse/HDFS-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 5feixiang updated HDFS-11171: - Status: Patch Available (was: Open) > add metric to report client shortcircuit reads >

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10930: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707553#comment-15707553 ] Hudson commented on HDFS-11149: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10911 (See

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707537#comment-15707537 ] Ming Ma commented on HDFS-11096: Thanks [~andrew.wang] [~ka...@cloudera.com] for bringing up this

[jira] [Commented] (HDFS-10206) getBlockLocations might not sort datanodes properly by distance

[ https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707535#comment-15707535 ] Ming Ma commented on HDFS-10206: bq. Can you point out the variables which are to be made more generic?

[jira] [Commented] (HDFS-11184) Ozone: SCM: Make SCM use container protocol

[ https://issues.apache.org/jira/browse/HDFS-11184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707524#comment-15707524 ] Hadoop QA commented on HDFS-11184: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11171) add metric to report client shortcircuit reads

[ https://issues.apache.org/jira/browse/HDFS-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11171: Fix Version/s: (was: 2.7.1) > add metric to report client shortcircuit reads >

[jira] [Updated] (HDFS-11171) add metric to report client shortcircuit reads

[ https://issues.apache.org/jira/browse/HDFS-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11171: Status: Open (was: Patch Available) > add metric to report client shortcircuit

[jira] [Commented] (HDFS-11171) add metric to report client shortcircuit reads

[ https://issues.apache.org/jira/browse/HDFS-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707426#comment-15707426 ] Brahma Reddy Battula commented on HDFS-11171: - do you want to contribute patch for this..?

[jira] [Commented] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707395#comment-15707395 ] 5feixiang commented on HDFS-347: How to get short-circuit read bytes and time from datanode? > DFS read

[jira] [Updated] (HDFS-11171) add metric to report client shortcircuit reads

[ https://issues.apache.org/jira/browse/HDFS-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 5feixiang updated HDFS-11171: - Status: Patch Available (was: Open) > add metric to report client shortcircuit reads >

[jira] [Commented] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

[ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707386#comment-15707386 ] Hadoop QA commented on HDFS-11182: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707367#comment-15707367 ] Weiwei Yang commented on HDFS-11156: Hello [~liuml07], [~andrew.wang] I agree with [~liuml07]'s

[jira] [Commented] (HDFS-11188) Change min supported DN and NN versions back to 2.x

[ https://issues.apache.org/jira/browse/HDFS-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707366#comment-15707366 ] Hadoop QA commented on HDFS-11188: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707357#comment-15707357 ] Hadoop QA commented on HDFS-11149: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11184) Ozone: SCM: Make SCM use container protocol

[ https://issues.apache.org/jira/browse/HDFS-11184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11184: Attachment: HDFS-11184-HDFS-7240.003.patch Patch v3 : Fix an issue with leader ID being wrong in

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707313#comment-15707313 ] Xiaoyu Yao commented on HDFS-11149: --- Thanks [~arpitagarwal] for updating the patch. Patch v12 looks

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707209#comment-15707209 ] SammiChen commented on HDFS-11072: -- Thank you [~rakeshr]! > Add ability to unset and change directory EC

[jira] [Updated] (HDFS-11188) Change min supported DN and NN versions back to 2.x

[ https://issues.apache.org/jira/browse/HDFS-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11188: --- Attachment: HDFS-11188.001.patch Patch attached. I grepped the java sources for "3.0.0" and found

[jira] [Updated] (HDFS-11188) Change min supported DN and NN versions back to 2.x

[ https://issues.apache.org/jira/browse/HDFS-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11188: --- Status: Patch Available (was: Open) > Change min supported DN and NN versions back to 2.x >

[jira] [Commented] (HDFS-6648) Order of namenodes in ConfiguredFailoverProxyProvider is not defined by order in hdfs-site.xml

[ https://issues.apache.org/jira/browse/HDFS-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707134#comment-15707134 ] Hadoop QA commented on HDFS-6648: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-11188) Change min supported DN and NN versions back to 2.x

[ https://issues.apache.org/jira/browse/HDFS-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-11188: -- Assignee: Andrew Wang > Change min supported DN and NN versions back to 2.x >

[jira] [Created] (HDFS-11188) Change min supported DN and NN versions back to 2.x

Andrew Wang created HDFS-11188: -- Summary: Change min supported DN and NN versions back to 2.x Key: HDFS-11188 URL: https://issues.apache.org/jira/browse/HDFS-11188 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-10398) Update NN/DN min software version to 3.0.0-beta1

[ https://issues.apache.org/jira/browse/HDFS-10398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-10398. Resolution: Invalid I'm resolving this since we're attempting to preserve rolling upgrade between

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707104#comment-15707104 ] Arpit Agarwal commented on HDFS-10930: -- Jenkins seems to be hopelessly confused as it's picking up

[jira] [Commented] (HDFS-5517) Lower the default maximum number of blocks per file

[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707100#comment-15707100 ] Andrew Wang commented on HDFS-5517: --- Checkstyles are ones I'm apt to ignore (line length in

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.12.patch Thanks [~xyao] for the review. The v12 patch addresses your

[jira] [Commented] (HDFS-5517) Lower the default maximum number of blocks per file

[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707073#comment-15707073 ] Hadoop QA commented on HDFS-5517: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706994#comment-15706994 ] Hadoop QA commented on HDFS-11149: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706915#comment-15706915 ] Hadoop QA commented on HDFS-10930: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11184) Ozone: SCM: Make SCM use container protocol

[ https://issues.apache.org/jira/browse/HDFS-11184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706909#comment-15706909 ] Hadoop QA commented on HDFS-11184: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706889#comment-15706889 ] Andrew Wang commented on HDFS-11156: I looked at the git blame, and HDFS-2527 which added the

[jira] [Updated] (HDFS-6648) Order of namenodes in ConfiguredFailoverProxyProvider is not defined by order in hdfs-site.xml

[ https://issues.apache.org/jira/browse/HDFS-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-6648: -- Affects Version/s: (was: 2.2.0) 2.7.0 Status: Patch Available

[jira] [Commented] (HDFS-11106) libhdfs++: Some refactoring to better organize files

[ https://issues.apache.org/jira/browse/HDFS-11106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706863#comment-15706863 ] James Clampffer commented on HDFS-11106: Committed the first patch. The protobuf and hdfs.cc

[jira] [Updated] (HDFS-5517) Lower the default maximum number of blocks per file

[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5517: -- Status: Patch Available (was: Reopened) > Lower the default maximum number of blocks per file >

[jira] [Updated] (HDFS-5517) Lower the default maximum number of blocks per file

[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5517: -- Attachment: HDFS-5517.003.patch New patch to address the two unit test issues. > Lower the default

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706770#comment-15706770 ] Xiaoyu Yao commented on HDFS-11149: --- Thanks [~arpitagarwal] for working on this and [~anu] for the

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706678#comment-15706678 ] Arpit Agarwal commented on HDFS-11149: -- Thanks for the code review [~anu]. I don't think the volume

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.11.patch > Support for parallel checking of FsVolumes >

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: (was: HDFS-11149.11.patch) > Support for parallel checking of FsVolumes >

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.11.patch > Support for parallel checking of FsVolumes >

[jira] [Commented] (HDFS-8674) Improve performance of postponed block scans

[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706649#comment-15706649 ] Hadoop QA commented on HDFS-8674: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8674) Improve performance of postponed block scans

[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-8674: -- Attachment: HDFS-8674.2.patch Resolved minor conflicts. > Improve performance of postponed block scans

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706582#comment-15706582 ] Xiaoyu Yao commented on HDFS-10930: --- Remove the PR link and resubmit for Jenkins. > Refactor: Wrap

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10930: -- Status: Patch Available (was: Open) > Refactor: Wrap Datanode IO related operations >

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10930: -- Status: Open (was: Patch Available) > Refactor: Wrap Datanode IO related operations >

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706571#comment-15706571 ] ASF GitHub Bot commented on HDFS-10930: --- Github user xiaoyuyao closed the pull request at:

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706540#comment-15706540 ] Arpit Agarwal commented on HDFS-9668: - Comments from reviewing the rest of the changes: #

[jira] [Updated] (HDFS-11184) Ozone: SCM: Make SCM use container protocol

[ https://issues.apache.org/jira/browse/HDFS-11184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11184: Attachment: HDFS-11184-HDFS-7240.002.patch Patch v2 * Fixed a checkstyle warning, rest of the

[jira] [Commented] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706427#comment-15706427 ] Hadoop QA commented on HDFS-11187: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706299#comment-15706299 ] Anu Engineer commented on HDFS-11149: - [~arpitagarwal] Thanks for the patch. It looks quite good

[jira] [Updated] (HDFS-6648) Order of namenodes in ConfiguredFailoverProxyProvider is not defined by order in hdfs-site.xml

[ https://issues.apache.org/jira/browse/HDFS-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-6648: -- Attachment: HDFS-6648-000.patch Accessing addresses in a random order and fixing comment for the class.

[jira] [Commented] (HDFS-6648) Order of namenodes in ConfiguredFailoverProxyProvider is not defined by order in hdfs-site.xml

[ https://issues.apache.org/jira/browse/HDFS-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706258#comment-15706258 ] Inigo Goiri commented on HDFS-6648: --- I'm working on Router-based HDFS federation (HDFS-10467) and I've

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706254#comment-15706254 ] Arpit Agarwal commented on HDFS-9668: - A few early comments on the v25 patch: #

[jira] [Updated] (HDFS-10675) Datanode support to read from external stores.

[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10675: -- Status: Open (was: Patch Available) > Datanode support to read from external stores.

[jira] [Commented] (HDFS-5517) Lower the default maximum number of blocks per file

[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706199#comment-15706199 ] Hudson commented on HDFS-5517: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10907 (See

[jira] [Commented] (HDFS-10675) Datanode support to read from external stores.

[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706196#comment-15706196 ] Virajith Jalaparti commented on HDFS-10675: --- One thing that came up in conversations with

[jira] [Comment Edited] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706153#comment-15706153 ] Wei-Chiu Chuang edited comment on HDFS-11187 at 11/29/16 6:55 PM: -- Submit

[jira] [Comment Edited] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706153#comment-15706153 ] Wei-Chiu Chuang edited comment on HDFS-11187 at 11/29/16 6:53 PM: -- Submit

[jira] [Updated] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11187: --- Summary: Optimize disk access for last partial chunk checksum of Finalized replica (was:

[jira] [Updated] (HDFS-11187) Optimize last partial chunk checksum loading for Finalized replica

[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11187: --- Target Version/s: 2.7.4 > Optimize last partial chunk checksum loading for Finalized replica

[jira] [Reopened] (HDFS-5517) Lower the default maximum number of blocks per file

[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-5517: --- Sorry about the fuss, reverted for now. > Lower the default maximum number of blocks per file >

[jira] [Updated] (HDFS-5517) Lower the default maximum number of blocks per file

[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5517: -- Fix Version/s: (was: 3.0.0-alpha2) > Lower the default maximum number of blocks per file >

[jira] [Updated] (HDFS-11187) Optimize last partial chunk checksum loading for Finalized replica

[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11187: --- Summary: Optimize last partial chunk checksum loading for Finalized replica (was: Optimize

[jira] [Updated] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11160: --- Description: Due to a race condition initially reported in HDFS-6804, VolumeScanner may

[jira] [Updated] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11160: --- Description: Due to a race condition initially reported in HDFS-6804, VolumeScanner may

[jira] [Commented] (HDFS-10675) Datanode support to read from external stores.

[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706158#comment-15706158 ] Virajith Jalaparti commented on HDFS-10675: --- The javadoc error is not introduced by this patch.

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706155#comment-15706155 ] Wei-Chiu Chuang commented on HDFS-11160: Posted the optimization patch at HDFS-11187. >

[jira] [Updated] (HDFS-11187) Optimize last partial chunk checksum calculation for Finalized replica

[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11187: --- Status: Patch Available (was: Open) > Optimize last partial chunk checksum calculation for

[jira] [Updated] (HDFS-11187) Optimize last partial chunk checksum calculation for Finalized replica

[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11187: --- Attachment: HDFS-11187.001.patch Submit patch 001. * This patch adds a new field

[jira] [Commented] (HDFS-10913) Introduce fault injectors to simulate slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706142#comment-15706142 ] Arpit Agarwal commented on HDFS-10913: -- Thanks for this testability improvement [~xiaobingo]. Few

[jira] [Created] (HDFS-11187) Optimize last partial chunk checksum calculation for Finalized replica

Wei-Chiu Chuang created HDFS-11187: -- Summary: Optimize last partial chunk checksum calculation for Finalized replica Key: HDFS-11187 URL: https://issues.apache.org/jira/browse/HDFS-11187 Project:

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10930: - Status: Patch Available (was: Open) > Refactor: Wrap Datanode IO related operations >

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10930: - Status: Open (was: Patch Available) > Refactor: Wrap Datanode IO related operations >

[jira] [Commented] (HDFS-11106) libhdfs++: Some refactoring to better organize files

[ https://issues.apache.org/jira/browse/HDFS-11106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705974#comment-15705974 ] James Clampffer commented on HDFS-11106: Thanks for the review [~xiaowei.zhu]. I'll leave this

[jira] [Commented] (HDFS-11106) libhdfs++: Some refactoring to better organize files

[ https://issues.apache.org/jira/browse/HDFS-11106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705938#comment-15705938 ] Xiaowei Zhu commented on HDFS-11106: +1. Changes all look reasonable, except the parts which are not

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705922#comment-15705922 ] Mingliang Liu commented on HDFS-11156: -- They are two different problems. P1. The mismatch of REST

[jira] [Updated] (HDFS-6262) HDFS doesn't raise FileNotFoundException if the source of a rename() is missing

[ https://issues.apache.org/jira/browse/HDFS-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HDFS-6262: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) Closing this as "Won't Fix".

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705840#comment-15705840 ] Wei-Chiu Chuang commented on HDFS-11160: I have been also trying to optimize checksum calculation.

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705818#comment-15705818 ] Eric Badger commented on HDFS-11094: {quote} 1. I discussed with Arpit Agarwal offline and he

[jira] [Resolved] (HDFS-303) Make contracts of LocalFileSystem and DistributedFileSystem consistent

[ https://issues.apache.org/jira/browse/HDFS-303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor resolved HDFS-303. --- Resolution: Done > Make contracts of LocalFileSystem and DistributedFileSystem consistent >

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705166#comment-15705166 ] Akira Ajisaka commented on HDFS-11180: -- This patch is now ready for review. * TestDirectoryScanner,

  1   2   >