[jira] [Updated] (HDFS-8674) Improve performance of postponed block scans

2016-12-01 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-8674: -- Attachment: HDFS-8674.trunk.2.patch HDFS-8674.branch-2.patch Posted wrong patches.

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712124#comment-15712124 ] Hudson commented on HDFS-11180: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10923 (See

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712067#comment-15712067 ] Akira Ajisaka commented on HDFS-11180: -- The precommit job for branch-2 looks good. The failed tests

[jira] [Commented] (HDFS-11179) LightWeightHashSet can't remove blocks correctly which have a large number blockId

2016-12-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712026#comment-15712026 ] Kihwal Lee commented on HDFS-11179: --- We have been running with HDFS-8674 internally for quite some time

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Fix Version/s: 3.0.0-alpha2 Committed v4 patch to trunk. > Intermittent deadlock in NameNode

[jira] [Assigned] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

2016-12-01 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G reassigned HDFS-11123: -- Assignee: Uma Maheswara Rao G > [SPS] Make storage policy satisfier daemon

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Attachment: HDFS-11180-branch-2.8.01.patch The branch-2 patch can be applied to branch-2.8

[jira] [Commented] (HDFS-11131) TestThrottledAsyncChecker#testContextIsPassed is flaky

2016-12-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712070#comment-15712070 ] Kihwal Lee commented on HDFS-11131: --- {{testCancellation}} also fails. Failure doesn't seem to be rare.

[jira] [Commented] (HDFS-8674) Improve performance of postponed block scans

2016-12-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712103#comment-15712103 ] Kihwal Lee commented on HDFS-8674: -- {{LightWeightLinkedSet}} does not support {{remove()}}. > Improve

[jira] [Created] (HDFS-11197) Listing encryption zones fails when deleting a EZ that is on a snapshotted directory

2016-12-01 Thread Wellington Chevreuil (JIRA)
Wellington Chevreuil created HDFS-11197: --- Summary: Listing encryption zones fails when deleting a EZ that is on a snapshotted directory Key: HDFS-11197 URL: https://issues.apache.org/jira/browse/HDFS-11197

[jira] [Created] (HDFS-11198) NN UI should link DN web address using hostnames

2016-12-01 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-11198: - Summary: NN UI should link DN web address using hostnames Key: HDFS-11198 URL: https://issues.apache.org/jira/browse/HDFS-11198 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-8674) Improve performance of postponed block scans

2016-12-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8674: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.8.0

[jira] [Updated] (HDFS-11197) Listing encryption zones fails when deleting a EZ that is on a snapshotted directory

2016-12-01 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-11197: Status: Patch Available (was: Open) First patch proposal. > Listing encryption

[jira] [Comment Edited] (HDFS-11146) Excess replicas will not be deleted until all storages's FBR received after failover

2016-12-01 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702527#comment-15702527 ] Brahma Reddy Battula edited comment on HDFS-11146 at 12/1/16 4:18 PM: --

[jira] [Updated] (HDFS-11197) Listing encryption zones fails when deleting a EZ that is on a snapshotted directory

2016-12-01 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-11197: Attachment: HDFS-11197-1.patch > Listing encryption zones fails when deleting a EZ

[jira] [Updated] (HDFS-11197) Listing encryption zones fails when deleting a EZ that is on a snapshotted directory

2016-12-01 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-11197: Priority: Minor (was: Major) > Listing encryption zones fails when deleting a EZ

[jira] [Updated] (HDFS-11198) NN UI should link DN web address using hostnames

2016-12-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11198: -- Description: The new NN UI shows links to DN web pages, but since the link is from the info address

[jira] [Updated] (HDFS-11197) Listing encryption zones fails when deleting a EZ that is on a snapshotted directory

2016-12-01 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-11197: Description: If a EZ directory is under a snapshotable directory, and a snapshot

[jira] [Commented] (HDFS-8674) Improve performance of postponed block scans

2016-12-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712633#comment-15712633 ] Kihwal Lee commented on HDFS-8674: -- +1 The patch looks good. > Improve performance of postponed block

[jira] [Commented] (HDFS-8674) Improve performance of postponed block scans

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712495#comment-15712495 ] Hadoop QA commented on HDFS-8674: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8674) Improve performance of postponed block scans

2016-12-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712703#comment-15712703 ] Hudson commented on HDFS-8674: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10924 (See

[jira] [Commented] (HDFS-10206) getBlockLocations might not sort datanodes properly by distance

2016-12-01 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712724#comment-15712724 ] Nandakumar commented on HDFS-10206: --- bq. nonDataNodeReader. However, it turns out NetworkTopology has

[jira] [Commented] (HDFS-11196) Ozone: Improve logging and error handling in the container layer

2016-12-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712903#comment-15712903 ] Anu Engineer commented on HDFS-11196: - updated the patch to fix some checkstyle warnings. > Ozone:

[jira] [Commented] (HDFS-11166) Doc for GET_BLOCK_LOCATIONS is missing in webhdfs API

2016-12-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712909#comment-15712909 ] Andrew Wang commented on HDFS-11166: GET_BLOCK_LOCATIONS is similar to our internal client-server

[jira] [Commented] (HDFS-11197) Listing encryption zones fails when deleting a EZ that is on a snapshotted directory

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712699#comment-15712699 ] Hadoop QA commented on HDFS-11197: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11156: - Summary: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API (was: Webhdfs rest api

[jira] [Updated] (HDFS-11196) Ozone: Improve logging and error handling in the container layer

2016-12-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11196: Attachment: (was: HDFS-11196-HDFS-7240.001.patch) > Ozone: Improve logging and error handling

[jira] [Updated] (HDFS-7650) Snapshot Corruption for OPENFORWRITE files

2016-12-01 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-7650: - Component/s: snapshots > Snapshot Corruption for OPENFORWRITE files >

[jira] [Updated] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11156: - Issue Type: Improvement (was: Bug) +1 Please also add doc in the REST API page

[jira] [Updated] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11156: - Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 3.0.0-alpha2) > Webhdfs rest api GET_BLOCK_LOCATIONS

[jira] [Updated] (HDFS-11196) Ozone: Improve logging and error handling in the container layer

2016-12-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11196: Attachment: HDFS-11196-HDFS-7240.001.patch > Ozone: Improve logging and error handling in the

[jira] [Updated] (HDFS-7650) Snapshot Corruption for OPENFORWRITE files

2016-12-01 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-7650: - Assignee: Manoj Govindassamy Taking up for investigation. > Snapshot Corruption for

[jira] [Commented] (HDFS-11166) Doc for GET_BLOCK_LOCATIONS is missing in webhdfs API

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712884#comment-15712884 ] Mingliang Liu commented on HDFS-11166: -- In [HDFS-11156], we add a new op {{GETFILEBLOCKLOCATIONS}} to

[jira] [Commented] (HDFS-11166) Doc for GET_BLOCK_LOCATIONS is missing in webhdfs API

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712918#comment-15712918 ] Mingliang Liu commented on HDFS-11166: -- private/stable change only makes more sense to me. Thanks, >

[jira] [Commented] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2016-12-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713117#comment-15713117 ] Hudson commented on HDFS-11132: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10925 (See

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-12-01 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713254#comment-15713254 ] Uma Maheswara Rao G commented on HDFS-10885: Overall patch looks nice to me. Great work

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11132: - Summary: Allow AccessControlException in contract tests when getFileStatus on subdirectory of

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2016-12-01 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713180#comment-15713180 ] Uma Maheswara Rao G commented on HDFS-11193: I think API itself will not worry whether it is

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11132: - Component/s: test > Allow AccessControlException in contract tests when getFileStatus on >

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11132: - Assignee: Vishwajeet Dusane > Allow AccessControlException in contract tests when getFileStatus

[jira] [Updated] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11132: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-8422) Recursive mkdir removes sticky bit when adding implicit u+wx to intermediate directories

2016-12-01 Thread David Tucker (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713281#comment-15713281 ] David Tucker commented on HDFS-8422: Jake should probably be unassigned from this issue. > Recursive

[jira] [Commented] (HDFS-8422) Recursive mkdir removes sticky bit when adding implicit u+wx to intermediate directories

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713343#comment-15713343 ] Hadoop QA commented on HDFS-8422: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10474) hftp copy fails when file name with Chinese+special char in branch-2

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10474: -- Fix Version/s: 2.8.0 > hftp copy fails when file name with Chinese+special char in branch-2 >

[jira] [Updated] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7645: - Fix Version/s: 2.8.0 > Rolling upgrade is restoring blocks from trash multiple times >

[jira] [Updated] (HDFS-11197) Listing encryption zones fails when deleting a EZ that is on a snapshotted directory

2016-12-01 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-11197: Attachment: HDFS-11197-2.patch Second patch with the checkstyle issues fixed for

[jira] [Updated] (HDFS-11197) Listing encryption zones fails when deleting a EZ that is on a snapshotted directory

2016-12-01 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-11197: Status: In Progress (was: Patch Available) > Listing encryption zones fails when

[jira] [Updated] (HDFS-11197) Listing encryption zones fails when deleting a EZ that is on a snapshotted directory

2016-12-01 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-11197: Status: Patch Available (was: In Progress) > Listing encryption zones fails when

[jira] [Updated] (HDFS-2580) NameNode#main(...) can make use of GenericOptionsParser.

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-2580: - Fix Version/s: 2.8.0 > NameNode#main(...) can make use of GenericOptionsParser. >

[jira] [Updated] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7725: - Fix Version/s: 2.8.0 > Incorrect "nodes in service" metrics caused all writes to fail >

[jira] [Updated] (HDFS-10917) Collect peer performance statistics on DataNode.

2016-12-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10917: - Status: Patch Available (was: Open) > Collect peer performance statistics on DataNode. >

[jira] [Updated] (HDFS-9874) Long living DataXceiver threads cause volume shutdown to block.

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9874: - Fix Version/s: 2.8.0 > Long living DataXceiver threads cause volume shutdown to block. >

[jira] [Updated] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9904: - Fix Version/s: 2.8.0 > testCheckpointCancellationDuringUpload occasionally fails >

[jira] [Updated] (HDFS-10917) Collect peer performance statistics on DataNode.

2016-12-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10917: - Attachment: HDFS-10917.000.patch > Collect peer performance statistics on DataNode. >

[jira] [Updated] (HDFS-8852) HDFS architecture documentation of version 2.x is outdated about append write support

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8852: - Fix Version/s: 2.8.0 > HDFS architecture documentation of version 2.x is outdated about append write >

[jira] [Updated] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-12-01 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8411: Attachment: HDFS-8411-007.patch 1 fixe 2 checkstyle issue 2.firebug is irrelevent 3. last failed unit test

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-12-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713875#comment-15713875 ] Rakesh R commented on HDFS-8411: Thank you [~Sammi] for the good work. Apart from the following comment,

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713802#comment-15713802 ] Akira Ajisaka commented on HDFS-11180: -- I ran the failed tests locally and they passed. I'll commit

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-12-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713810#comment-15713810 ] Rakesh R commented on HDFS-10885: - {quote} The API what we are exposing is named as

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Fix Version/s: 2.8.0 Committed branch-2 patch to branch-2/2.8. I'll provide a branch-2.7 patch

[jira] [Commented] (HDFS-11193) [SPS]: Erasure coded files should be considered for satisfying storage policy

2016-12-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713828#comment-15713828 ] Rakesh R commented on HDFS-11193: - bq. But worth checking the part on scanning blocks specifically for

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713957#comment-15713957 ] Hadoop QA commented on HDFS-8411: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Attachment: HDFS-11180-branch-2.7.01.patch > Intermittent deadlock in NameNode when failover

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Attachment: HDFS-11180-branch-2.6.01.patch > Intermittent deadlock in NameNode when failover

[jira] [Updated] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8850: - Fix Version/s: 2.8.0 > VolumeScanner thread exits with exception if there is no block pool to be >

[jira] [Commented] (HDFS-11197) Listing encryption zones fails when deleting a EZ that is on a snapshotted directory

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713591#comment-15713591 ] Hadoop QA commented on HDFS-11197: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713719#comment-15713719 ] Weiwei Yang commented on HDFS-11156: Hello [~liuml07] Thanks, actually I created HDFS-11166 along

[jira] [Updated] (HDFS-11166) Add webhdfs GETFILEBLOCKLOCATIONS document

2016-12-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11166: --- Description: HDFS-11156 adds GETFILEBLOCKLOCATIONS in webhdfs, user can uses this http request to get

[jira] [Commented] (HDFS-10917) Collect peer performance statistics on DataNode.

2016-12-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713564#comment-15713564 ] Xiaobing Zhou commented on HDFS-10917: -- Posted v000 patch. * added these peer metrics: **

[jira] [Commented] (HDFS-10917) Collect peer performance statistics on DataNode.

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713563#comment-15713563 ] Hadoop QA commented on HDFS-10917: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713560#comment-15713560 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8845) DiskChecker should not traverse the entire tree

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8845: - Fix Version/s: 2.8.0 > DiskChecker should not traverse the entire tree >

[jira] [Commented] (HDFS-11166) Doc for GET_BLOCK_LOCATIONS is missing in webhdfs API

2016-12-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713728#comment-15713728 ] Weiwei Yang commented on HDFS-11166: Hello [~liuml07], [~andrew.wang] The motivation of this ticket

[jira] [Updated] (HDFS-11166) Add webhdfs GETFILEBLOCKLOCATIONS document

2016-12-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11166: --- Summary: Add webhdfs GETFILEBLOCKLOCATIONS document (was: Doc for GET_BLOCK_LOCATIONS is missing in

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714329#comment-15714329 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714376#comment-15714376 ] Akira Ajisaka commented on HDFS-11180: -- TestHttpsFileSystem and TestRenameWithSnapshots failed on

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711320#comment-15711320 ] Hadoop QA commented on HDFS-9668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711273#comment-15711273 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11196) Ozone: Improve logging and error handling in the container layer

2016-12-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11196: Attachment: HDFS-11196-HDFS-7240.001.patch Posting an early patch for code review. This patch

[jira] [Created] (HDFS-11196) Ozone: Improve logging and error handling in the container layer

2016-12-01 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11196: --- Summary: Ozone: Improve logging and error handling in the container layer Key: HDFS-11196 URL: https://issues.apache.org/jira/browse/HDFS-11196 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-12-01 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8411: Attachment: HDFS-8411-006.patch > Add bytes count metrics to datanode for ECWorker >

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-12-01 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711748#comment-15711748 ] SammiChen commented on HDFS-8411: - Thanks [~rakeshr] very much for helping review the patch! bq. 1.

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711917#comment-15711917 ] Hadoop QA commented on HDFS-8411: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714045#comment-15714045 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714091#comment-15714091 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Attachment: HDFS-11180-branch-2.7.01.patch > Intermittent deadlock in NameNode when failover

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-12-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Attachment: (was: HDFS-11180-branch-2.7.01.patch) > Intermittent deadlock in NameNode when