[jira] [Updated] (HDFS-8926) Update the distcp document for new improvements by using snapshot diff report

2016-05-17 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated HDFS-8926: --- Assignee: (was: Yufei Gu) > Update the distcp document for new improvements by using snapshot diff report

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15288455#comment-15288455 ] Arpit Agarwal commented on HDFS-9226: - +1 pending Jenkins. Thank you [~elserj]! > MiniDFSCluster leaks

[jira] [Commented] (HDFS-10303) DataStreamer#ResponseProcessor calculates packet ack latency incorrectly.

2016-05-17 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15288200#comment-15288200 ] Surendra Singh Lilhore commented on HDFS-10303: --- Thanks [~kihwal] for review and commit. >

[jira] [Commented] (HDFS-10421) The nameservice for a Hadoop Namenode HA should be discoverable across clusters

2016-05-17 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15288190#comment-15288190 ] Allen Wittenauer commented on HDFS-10421: - I hate that the HDFS folks and the YARN folks don't

[jira] [Updated] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2016-05-17 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated HDFS-9226: - Attachment: HDFS-9926.006.patch .006 Rebased .004 on top of the correct "trunk" branch :) >

[jira] [Updated] (HDFS-10276) HDFS throws AccessControlException when checking for the existence of /a/b when /a is a file

2016-05-17 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10276: -- Status: Patch Available (was: In Progress) > HDFS throws AccessControlException when checking for the

[jira] [Updated] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2016-05-17 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated HDFS-9226: - Attachment: (was: HDFS-9926.006.patch) > MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

[jira] [Updated] (HDFS-10276) HDFS throws AccessControlException when checking for the existence of /a/b when /a is a file

2016-05-17 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10276: -- Attachment: HDFS-10276.006.patch > HDFS throws AccessControlException when checking for the existence

[jira] [Updated] (HDFS-10276) HDFS throws AccessControlException when checking for the existence of /a/b when /a is a file

2016-05-17 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10276: -- Status: In Progress (was: Patch Available) > HDFS throws AccessControlException when checking for the

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2016-05-17 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15288134#comment-15288134 ] Josh Elser commented on HDFS-9226: -- bq. so here's a rebase on top of master. Oh my. {{master}} is not

[jira] [Commented] (HDFS-10400) hdfs dfs -put exits with zero on error

2016-05-17 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15288127#comment-15288127 ] Yiqun Lin commented on HDFS-10400: -- Hi, [~knoguchi], your commets looks right. I have tested the case and

[jira] [Updated] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2016-05-17 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated HDFS-9226: - Attachment: HDFS-9926.006.patch .006 This one came across my radar again today, so here's a rebase on top

[jira] [Commented] (HDFS-10276) HDFS throws AccessControlException when checking for the existence of /a/b when /a is a file

2016-05-17 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15288119#comment-15288119 ] Yuanbo Liu commented on HDFS-10276: --- Discussed with [~yzhangal] who committed the patch of HDFS-5802,

[jira] [Updated] (HDFS-10422) Do not throw AccessControlException for syntax errors of security.hdfs.unreadable.by.superuser

2016-05-17 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated HDFS-10422: -- Description: The xattr {{security.hdfs.unreadable.by.superuser}} has certain syntax rules: "this xattr

[jira] [Commented] (HDFS-7240) Object store in HDFS

2016-05-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15288087#comment-15288087 ] Andrew Wang commented on HDFS-7240: --- Thanks for the reply Anu, I'd like to follow up on some points. bq.

[jira] [Commented] (HDFS-10404) Fix formatting of CacheAdmin command usage help text

2016-05-17 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15288062#comment-15288062 ] Yiqun Lin commented on HDFS-10404: -- Thanks [~cmccabe] for commit! > Fix formatting of CacheAdmin command

[jira] [Commented] (HDFS-10414) allow disabling trash on per-directory basis

2016-05-17 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15288060#comment-15288060 ] Sergey Shelukhin commented on HDFS-10414: - 1) Is it true for all APIs? 2) This might be hard to

[jira] [Updated] (HDFS-10422) Do not throw AccessControlException for syntax errors of security.hdfs.unreadable.by.superuser

2016-05-17 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated HDFS-10422: -- Description: The xattr {{security.hdfs.unreadable.by.superuser}} has certain syntax rules: "this xattr

[jira] [Updated] (HDFS-10422) Do not throw AccessControlException for syntax errors of security.hdfs.unreadable.by.superuser

2016-05-17 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated HDFS-10422: -- Status: Patch Available (was: Open) > Do not throw AccessControlException for syntax errors of >

[jira] [Updated] (HDFS-10422) Do not throw AccessControlException for syntax errors of security.hdfs.unreadable.by.superuser

2016-05-17 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated HDFS-10422: -- Attachment: HDFS-10422.000.patch > Do not throw AccessControlException for syntax errors of >

[jira] [Updated] (HDFS-10422) Do not throw AccessControlException for syntax errors of security.hdfs.unreadable.by.superuser

2016-05-17 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated HDFS-10422: -- Description: The xattr {{security.hdfs.unreadable.by.superuser}} has certain syntax rules: "this xattr

[jira] [Updated] (HDFS-10422) Do not throw AccessControlException for syntax errors of security.hdfs.unreadable.by.superuser

2016-05-17 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated HDFS-10422: -- Summary: Do not throw AccessControlException for syntax errors of security.hdfs.unreadable.by.superuser

[jira] [Created] (HDFS-10422) Do not throw AccessControlException for {{security.hdfs.unreadable.by.superuser}} ops

2016-05-17 Thread Tianyin Xu (JIRA)
Tianyin Xu created HDFS-10422: - Summary: Do not throw AccessControlException for {{security.hdfs.unreadable.by.superuser}} ops Key: HDFS-10422 URL: https://issues.apache.org/jira/browse/HDFS-10422

[jira] [Updated] (HDFS-10415) TestDistributedFileSystem#testDFSCloseOrdering() fails on branch-2

2016-05-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10415: - Attachment: HDFS-10415.000.patch > TestDistributedFileSystem#testDFSCloseOrdering() fails on

[jira] [Updated] (HDFS-10415) TestDistributedFileSystem#testDFSCloseOrdering() fails on branch-2

2016-05-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10415: - Attachment: HDFS-10415-branch-2.001.patch > TestDistributedFileSystem#testDFSCloseOrdering()

[jira] [Commented] (HDFS-10415) TestDistributedFileSystem#testDFSCloseOrdering() fails on branch-2

2016-05-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287977#comment-15287977 ] Mingliang Liu commented on HDFS-10415: -- [~sjlee0], interesting question. I see code difference in

[jira] [Updated] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10381: -- Labels: supportability (was: ) > DataStreamer DataNode exclusion log message should be warning >

[jira] [Updated] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10383: - Attachment: HDFS-10383-branch-2.000.patch Thanks [~xyao] for the review and commit. I attached

[jira] [Updated] (HDFS-10421) The nameservice for a Hadoop Namenode HA should be discoverable across clusters

2016-05-17 Thread Mahipal Jupalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahipal Jupalli updated HDFS-10421: --- Description: Name service configured in NameNode HA mode, should be discoverable across

[jira] [Updated] (HDFS-10421) The nameservice for a Hadoop Namenode HA should be discoverable across clusters

2016-05-17 Thread Mahipal Jupalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahipal Jupalli updated HDFS-10421: --- Description: Name service configured in NameNode HA mode, should be discoverable across

[jira] [Created] (HDFS-10421) The nameservice for a Hadoop Namenode HA should be discoverable across clusters

2016-05-17 Thread Mahipal Jupalli (JIRA)
Mahipal Jupalli created HDFS-10421: -- Summary: The nameservice for a Hadoop Namenode HA should be discoverable across clusters Key: HDFS-10421 URL: https://issues.apache.org/jira/browse/HDFS-10421

[jira] [Updated] (HDFS-10363) Ozone: Introduce new config keys for SCM service endpoints

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10363: - Attachment: HDFS-10363-HDFS-7240.05.patch v05 patch fixes the remaining two checkstyle failures.

[jira] [Commented] (HDFS-10363) Ozone: Introduce new config keys for SCM service endpoints

2016-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287929#comment-15287929 ] Hadoop QA commented on HDFS-10363: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287910#comment-15287910 ] John Zhuge commented on HDFS-10381: --- Thanks [~liuml07], [~jojochuang], [~jingzhao], and [~yzhangal]. >

[jira] [Updated] (HDFS-10360) DataNode may format directory and lose blocks if current/VERSION is missing

2016-05-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10360: - Labels: dataloss datanode (was: ) > DataNode may format directory and lose blocks if

[jira] [Updated] (HDFS-10360) DataNode may format directory and lose blocks if current/VERSION is missing

2016-05-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10360: - Resolution: Fixed Fix Version/s: 3.0.0-alpha1 2.9.0 Target

[jira] [Work started] (HDFS-10420) Fix Ozone unit tests to use MiniOzoneCluster

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10420 started by Arpit Agarwal. > Fix Ozone unit tests to use MiniOzoneCluster >

[jira] [Commented] (HDFS-10415) TestDistributedFileSystem#testDFSCloseOrdering() fails on branch-2

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287898#comment-15287898 ] Sangjin Lee commented on HDFS-10415: Thanks for the analysis [~liuml07]. Do you know why the trunk

[jira] [Commented] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287887#comment-15287887 ] Xiaoyu Yao commented on HDFS-10383: --- [~liuml07], I'v commit the patch v003 to trunk. Can you attach

[jira] [Updated] (HDFS-10420) Fix Ozone unit tests to use MiniOzoneCluster

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10420: - Description: [~cnauroth] added MiniOzoneCluster support to the Ozone feature branch. We should

[jira] [Assigned] (HDFS-10420) Fix Ozone unit tests to use MiniOzoneCluster

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-10420: Assignee: Arpit Agarwal > Fix Ozone unit tests to use MiniOzoneCluster >

[jira] [Created] (HDFS-10420) Fix Ozone unit tests to use MiniOzoneCluster

2016-05-17 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-10420: Summary: Fix Ozone unit tests to use MiniOzoneCluster Key: HDFS-10420 URL: https://issues.apache.org/jira/browse/HDFS-10420 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10360) DataNode may format directory and lose blocks if current/VERSION is missing

2016-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287875#comment-15287875 ] Hadoop QA commented on HDFS-10360: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287869#comment-15287869 ] Hudson commented on HDFS-10383: --- SUCCESS: Integrated in Hadoop-trunk-Commit #9810 (See

[jira] [Commented] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287868#comment-15287868 ] Hudson commented on HDFS-10381: --- SUCCESS: Integrated in Hadoop-trunk-Commit #9810 (See

[jira] [Commented] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287831#comment-15287831 ] Hudson commented on HDFS-10397: --- SUCCESS: Integrated in Hadoop-trunk-Commit #9809 (See

[jira] [Updated] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10381: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Commented] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287823#comment-15287823 ] Mingliang Liu commented on HDFS-10397: -- Thanks [~jingzhao] and [~yzhangal] for the review and

[jira] [Updated] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10397: - Component/s: distcp > Distcp should ignore -delete option if -diff option is provided instead of >

[jira] [Updated] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10397: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287750#comment-15287750 ] Jing Zhao commented on HDFS-10381: -- Thanks for the contribution, [~jzhuge]. +1 > DataStreamer DataNode

[jira] [Commented] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287744#comment-15287744 ] Yongjun Zhang commented on HDFS-10397: -- Sorry for the delayed response [~liuml07], +1 on rev 003. >

[jira] [Commented] (HDFS-10415) TestDistributedFileSystem#testDFSCloseOrdering() fails on branch-2

2016-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287732#comment-15287732 ] Hadoop QA commented on HDFS-10415: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287730#comment-15287730 ] Yongjun Zhang commented on HDFS-10381: -- Hi [~jzhuge], Thanks for reporting and working on this

[jira] [Closed] (HDFS-8679) Move DatasetSpi to new package

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal closed HDFS-8679. --- > Move DatasetSpi to new package > -- > > Key: HDFS-8679 >

[jira] [Closed] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal closed HDFS-8677. --- > Ozone: Introduce KeyValueContainerDatasetSpi > > >

[jira] [Closed] (HDFS-8457) Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal closed HDFS-8457. --- > Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into > parent interface >

[jira] [Closed] (HDFS-8661) DataNode should filter the set of NameSpaceInfos passed to Datasets

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal closed HDFS-8661. --- > DataNode should filter the set of NameSpaceInfos passed to Datasets >

[jira] [Commented] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287714#comment-15287714 ] Arpit Agarwal commented on HDFS-8677: - These changes were discarded in the HDFS-7240 branch due to

[jira] [Resolved] (HDFS-8661) DataNode should filter the set of NameSpaceInfos passed to Datasets

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8661. - Resolution: Later > DataNode should filter the set of NameSpaceInfos passed to Datasets >

[jira] [Reopened] (HDFS-8661) DataNode should filter the set of NameSpaceInfos passed to Datasets

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8661: - > DataNode should filter the set of NameSpaceInfos passed to Datasets >

[jira] [Commented] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287715#comment-15287715 ] Xiaoyu Yao commented on HDFS-10383: --- Thanks [~liuml07] for updating the patch. +1 for v3 patch and I

[jira] [Commented] (HDFS-8661) DataNode should filter the set of NameSpaceInfos passed to Datasets

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287717#comment-15287717 ] Arpit Agarwal commented on HDFS-8661: - These changes were discarded in the HDFS-7240 branch due to

[jira] [Resolved] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8677. - Resolution: Later > Ozone: Introduce KeyValueContainerDatasetSpi >

[jira] [Resolved] (HDFS-8679) Move DatasetSpi to new package

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8679. - Resolution: Later These changes were discarded in the HDFS-7240 branch due to merge resolution

[jira] [Reopened] (HDFS-8679) Move DatasetSpi to new package

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8679: - > Move DatasetSpi to new package > -- > > Key: HDFS-8679 >

[jira] [Reopened] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8677: - > Ozone: Introduce KeyValueContainerDatasetSpi > > >

[jira] [Resolved] (HDFS-8457) Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8457. - Resolution: Later These changes were discarded in the HDFS-7240 branch due to merge resolution

[jira] [Reopened] (HDFS-8457) Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8457: - > Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into > parent interface >

[jira] [Commented] (HDFS-9732) Improve DelegationTokenIdentifier.toString() for better logging

2016-05-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287687#comment-15287687 ] Hudson commented on HDFS-9732: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9807 (See

[jira] [Commented] (HDFS-10415) TestDistributedFileSystem#testDFSCloseOrdering() fails on branch-2

2016-05-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287671#comment-15287671 ] Mingliang Liu commented on HDFS-10415: -- # If we call the {{initialize()}} method in the test, it will

[jira] [Updated] (HDFS-9782) RollingFileSystemSink should have configurable roll interval

2016-05-17 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated HDFS-9782: --- Status: Open (was: Patch Available) Canceling patch to address comments. >

[jira] [Updated] (HDFS-10323) transient deleteOnExit failure in ViewFileSystem due to close() ordering

2016-05-17 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-10323: -- Affects Version/s: 2.6.0 Target Version/s: 3.0.0-beta1 Agree, seems incompatible.

[jira] [Updated] (HDFS-10360) DataNode may format directory and lose blocks if current/VERSION is missing

2016-05-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10360: --- Attachment: HDFS-10360.007.patch Many thanks to [~eddyxu] for the comments. Here's the new

[jira] [Commented] (HDFS-10417) Improve error message from checkBlockLocalPathAccess

2016-05-17 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287606#comment-15287606 ] Tianyin Xu commented on HDFS-10417: --- Sorry for that. I changed the unit test, and passed the

[jira] [Updated] (HDFS-10417) Improve error message from checkBlockLocalPathAccess

2016-05-17 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated HDFS-10417: -- Attachment: HDFS-10417.001.patch New patch with the unit test adjusted. > Improve error message from

[jira] [Updated] (HDFS-9732) Improve DelegationTokenIdentifier.toString() for better logging

2016-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9732: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha1 Status:

[jira] [Commented] (HDFS-9782) RollingFileSystemSink should have configurable roll interval

2016-05-17 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287586#comment-15287586 ] Karthik Kambatla commented on HDFS-9782: Sorry for the delay in getting to this. Looks mostly good.

[jira] [Commented] (HDFS-9732) Improve DelegationTokenIdentifier.toString() for better logging

2016-05-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287588#comment-15287588 ] Yongjun Zhang commented on HDFS-9732: - Thanks [~steve_l], [~cnauroth] and [~aw] again! I just

[jira] [Updated] (HDFS-10363) Ozone: Introduce new config keys for SCM service endpoints

2016-05-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10363: - Attachment: HDFS-10363-HDFS-7240.04.patch v04 patch fixes checkstyle issues and a bugfix in

[jira] [Commented] (HDFS-10417) Improve error message from checkBlockLocalPathAccess

2016-05-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287522#comment-15287522 ] Hudson commented on HDFS-10417: --- SUCCESS: Integrated in Hadoop-trunk-Commit #9806 (See

[jira] [Comment Edited] (HDFS-10417) Improve error message from checkBlockLocalPathAccess

2016-05-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287488#comment-15287488 ] Kihwal Lee edited comment on HDFS-10417 at 5/17/16 8:24 PM: Sorry, I reverted

[jira] [Commented] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287491#comment-15287491 ] Hadoop QA commented on HDFS-10188: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10417) Improve error message from checkBlockLocalPathAccess

2016-05-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287488#comment-15287488 ] Kihwal Lee commented on HDFS-10417: --- Sorry, I reverted it. It breaks a test case which compares the

[jira] [Issue Comment Deleted] (HDFS-10417) Improve error message from checkBlockLocalPathAccess

2016-05-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10417: -- Comment: was deleted (was: Committed to trunk, branch-2 and branch-2.8. Thanks for improving the error

[jira] [Reopened] (HDFS-10417) Improve error message from checkBlockLocalPathAccess

2016-05-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reopened HDFS-10417: --- > Improve error message from checkBlockLocalPathAccess >

[jira] [Commented] (HDFS-10417) Improve error message from checkBlockLocalPathAccess

2016-05-17 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287465#comment-15287465 ] Tianyin Xu commented on HDFS-10417: --- Thanks a lot, [~kihwal]! Yes, I understand. The related docs are

[jira] [Updated] (HDFS-10417) Improve error message from checkBlockLocalPathAccess

2016-05-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10417: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-10417) Improve error message from checkBlockLocalPathAccess

2016-05-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287461#comment-15287461 ] Kihwal Lee commented on HDFS-10417: --- +1. BTW, this is for the "legacy" short-circuit reads. The newer

[jira] [Updated] (HDFS-10417) Improve error message from checkBlockLocalPathAccess

2016-05-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10417: -- Summary: Improve error message from checkBlockLocalPathAccess (was: Actionable msgs for

[jira] [Updated] (HDFS-10417) Actionable msgs for checkBlockLocalPathAccess

2016-05-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10417: -- Assignee: Tianyin Xu > Actionable msgs for checkBlockLocalPathAccess >

[jira] [Updated] (HDFS-10419) Building HDFS on top of Ozone's storage containers

2016-05-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10419: - Description: In HDFS-7240, Ozone defines storage containers to store both the data and the metadata. The

[jira] [Updated] (HDFS-10419) Building HDFS on top of Ozone's storage containers

2016-05-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10419: - Description: In HDFS-7240, Ozone defines storage containers to store both the data and the metadata. The

[jira] [Created] (HDFS-10419) Building HDFS on top of Ozone's storage containers

2016-05-17 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-10419: Summary: Building HDFS on top of Ozone's storage containers Key: HDFS-10419 URL: https://issues.apache.org/jira/browse/HDFS-10419 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10415) TestDistributedFileSystem#testDFSCloseOrdering() fails on branch-2

2016-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287439#comment-15287439 ] Steve Loughran commented on HDFS-10415: --- we could also consider having dfs.close() being resilient

[jira] [Commented] (HDFS-1208) DFSClient swallows InterruptedException

2016-05-17 Thread Bob Tiernay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287435#comment-15287435 ] Bob Tiernay commented on HDFS-1208: --- Any word on this? My application is blocking because it cannot be

[jira] [Commented] (HDFS-10363) Ozone: Introduce new config keys for SCM service endpoints

2016-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287397#comment-15287397 ] Hadoop QA commented on HDFS-10363: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10390) Implement asynchronous setAcl/getAclStatus for DistributedFileSystem

2016-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287398#comment-15287398 ] Hadoop QA commented on HDFS-10390: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10415) TestDistributedFileSystem#testDFSCloseOrdering() fails on branch-2

2016-05-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10415: - Status: Patch Available (was: Open) If the patch looks good, I think we can apply it to

[jira] [Updated] (HDFS-10370) Allow DataNode to be started with numactl

2016-05-17 Thread Dave Marion (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-10370: --- Attachment: HDFS-10370-3.patch > Allow DataNode to be started with numactl >

  1   2   >