[jira] [Commented] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2016-10-25 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606385#comment-15606385 ] Erik Krogen commented on HDFS-9500: --- The {{TestDiskspaceQuotaUpdate}} failure is unrelated and documented

[jira] [Updated] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11053: -- Status: Patch Available (was: Open) > Unnecessary superuser check in versionRequest() >

[jira] [Updated] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11053: -- Attachment: HDFS-11053.patch > Unnecessary superuser check in versionRequest() >

[jira] [Updated] (HDFS-10860) Switch HttpFS to use Jetty

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10860: --- Issue Type: New Feature (was: Improvement) > Switch HttpFS to use Jetty > --

[jira] [Commented] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606527#comment-15606527 ] Kihwal Lee commented on HDFS-11053: --- The check was added in the process of fixing HDFS-2264. >

[jira] [Updated] (HDFS-5684) o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public methods.

2016-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-5684: - Attachment: HDFS-5684.02.patch > o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public

[jira] [Comment Edited] (HDFS-5684) o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public methods.

2016-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606579#comment-15606579 ] Manoj Govindassamy edited comment on HDFS-5684 at 10/25/16 9:50 PM: *

[jira] [Created] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-11054: Summary: Suppress verbose log message in BlockPlacementPolicyDefault Key: HDFS-11054 URL: https://issues.apache.org/jira/browse/HDFS-11054 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11054: -- Status: Patch Available (was: Open) > Suppress verbose log message in BlockPlacementPolicyDefault >

[jira] [Commented] (HDFS-5684) o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public methods.

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606656#comment-15606656 ] Andrew Wang commented on HDFS-5684: --- +1 LGTM, that failure looks like a flake. Will commit shortly. >

[jira] [Updated] (HDFS-11040) Add documentation for HDFS-9820 distcp improvement

2016-10-25 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11040: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11053: -- Component/s: security namenode > Unnecessary superuser check in versionRequest() >

[jira] [Comment Edited] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606527#comment-15606527 ] Kihwal Lee edited comment on HDFS-11053 at 10/25/16 9:34 PM: - The check was

[jira] [Updated] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11054: -- Attachment: HDFS-11054.002.patch Thanks [~xyao] for pointing out the spacing issue, fixed it in v002

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606308#comment-15606308 ] Hudson commented on HDFS-9820: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10676 (See

[jira] [Commented] (HDFS-11040) Add documentation for HDFS-9820 distcp improvement

2016-10-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606306#comment-15606306 ] Hudson commented on HDFS-11040: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10676 (See

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606310#comment-15606310 ] Hadoop QA commented on HDFS-11031: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606316#comment-15606316 ] Hadoop QA commented on HDFS-9500: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606317#comment-15606317 ] Mingliang Liu commented on HDFS-11031: -- Checkstyle is fixed in new v3 patch and test failures are not

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606343#comment-15606343 ] John Zhuge commented on HDFS-11043: --- Reproduced Andrew's case: expect "connect timed out" but got "Read

[jira] [Updated] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11043: -- Status: In Progress (was: Patch Available) > TestWebHdfsTimeouts fails > - > >

[jira] [Commented] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606621#comment-15606621 ] Arpit Agarwal commented on HDFS-11054: -- +1 pending Jenkins. Thanks for the quick fix [~vagarychen]!

[jira] [Commented] (HDFS-5684) o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public methods.

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606654#comment-15606654 ] Hadoop QA commented on HDFS-5684: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10756) Expose getTrashRoot to HTTPFS and WebHDFS

2016-10-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606653#comment-15606653 ] Xiao Chen commented on HDFS-10756: -- Thanks for revving. Patch looks good. Some comments: - Let's add

[jira] [Commented] (HDFS-11015) Enforce timeout in balancer

2016-10-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606292#comment-15606292 ] Kihwal Lee commented on HDFS-11015: --- [~zhz], thanks for reviews and commits. > Enforce timeout in

[jira] [Commented] (HDFS-11045) TestDirectoryScanner#testThrottling fails: Throttle is too permissive

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606451#comment-15606451 ] Hadoop QA commented on HDFS-11045: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11050) Change log level to 'warn' when ssl initialization fails and defaults to DEFAULT_TIMEOUT_CONN_CONFIGURATOR

2016-10-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606660#comment-15606660 ] Kuhu Shukla commented on HDFS-11050: [~kihwal], request for comments/review.Thanks a lot! > Change

[jira] [Assigned] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-11053: - Assignee: Kihwal Lee > Unnecessary superuser check in versionRequest() >

[jira] [Commented] (HDFS-11001) Ozone:SCM: Add support for registerNode in SCM

2016-10-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606480#comment-15606480 ] Xiaoyu Yao commented on HDFS-11001: --- Thanks [~anu] for working on this. The patch looks good overall, I

[jira] [Commented] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606505#comment-15606505 ] Andrew Wang commented on HDFS-10999: Good finds Wei-chiu. Could you file JIRAs to fix these per the

[jira] [Resolved] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

2016-10-25 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu resolved HDFS-10638. -- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 +1 . Thanks for the good work! I re-run

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606470#comment-15606470 ] Hadoop QA commented on HDFS-11031: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606571#comment-15606571 ] Hadoop QA commented on HDFS-11053: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606623#comment-15606623 ] Xiaoyu Yao commented on HDFS-11054: --- Thanks [~arpitagarwal] for reporting the issue and [~vagarychen]

[jira] [Commented] (HDFS-11050) Change log level to 'warn' when ssl initialization fails and defaults to DEFAULT_TIMEOUT_CONN_CONFIGURATOR

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606637#comment-15606637 ] Hadoop QA commented on HDFS-11050: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11047: - Status: Patch Available (was: Open) > Remove deep copies of FinalizedReplica to alleviate heap

[jira] [Created] (HDFS-11053) Unnecessary superuser check in versionRequest()

2016-10-25 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-11053: - Summary: Unnecessary superuser check in versionRequest() Key: HDFS-11053 URL: https://issues.apache.org/jira/browse/HDFS-11053 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-5684) o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public methods.

2016-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606579#comment-15606579 ] Manoj Govindassamy commented on HDFS-5684: -- * For now its used by tests only. We already expose

[jira] [Updated] (HDFS-11050) Change log level to 'warn' when ssl initialization fails and defaults to DEFAULT_TIMEOUT_CONN_CONFIGURATOR

2016-10-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-11050: --- Attachment: HDFS-11050.002.patch Fixing test to not rely on stdout. > Change log level to 'warn'

[jira] [Updated] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11054: -- Attachment: HDFS-11054.001.patch > Suppress verbose log message in BlockPlacementPolicyDefault >

[jira] [Commented] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606682#comment-15606682 ] Xiaobing Zhou commented on HDFS-11047: -- I posted patch v000, please kindly review it, thanks. 1. It

[jira] [Updated] (HDFS-5684) Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5684: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > Annotate

[jira] [Updated] (HDFS-5684) Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5684: -- Summary: Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting (was:

[jira] [Updated] (HDFS-5684) Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5684: -- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11047: - Description: DirectoryScanner does scan by deep copying FinalizedReplica. In a deployment with

[jira] [Updated] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11055: --- Status: Patch Available (was: Open) > Update log4j.properties for httpfs to imporve test

[jira] [Updated] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11055: --- Attachment: HDFS-11055.001.patch Attach patch 001 > Update log4j.properties for httpfs to

[jira] [Commented] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606833#comment-15606833 ] Xiaobing Zhou commented on HDFS-11055: -- Thanks [~jojochuang] for the work. The patch LGTM. Do you

[jira] [Commented] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606836#comment-15606836 ] Hadoop QA commented on HDFS-11047: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-10-25 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11058: - Summary: Implement 'hadoop fs -df' command for ViewFileSystem Key: HDFS-11058 URL: https://issues.apache.org/jira/browse/HDFS-11058 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11016) Add unit tests for HDFS command 'dfsadmin -set/clrQuota'

2016-10-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606869#comment-15606869 ] Xiaoyu Yao commented on HDFS-11016: --- The name looks similar and both use the same RPC call. But they are

[jira] [Resolved] (HDFS-11057) Implement 'df' for View

2016-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy resolved HDFS-11057. --- Resolution: Duplicate Assignee: Manoj Govindassamy > Implement 'df' for View

[jira] [Commented] (HDFS-11050) Change log level to 'warn' when ssl initialization fails and defaults to DEFAULT_TIMEOUT_CONN_CONFIGURATOR

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606870#comment-15606870 ] Xiaobing Zhou commented on HDFS-11050: -- Thank you for the work [~kihwal]. It looks good to me. Do you

[jira] [Updated] (HDFS-10935) TestFileChecksum fails in some cases

2016-10-25 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10935: - Summary: TestFileChecksum fails in some cases (was: Java-based EC codec does not reconstruct blocks

[jira] [Updated] (HDFS-10935) TestFileChecksum fails in some cases

2016-10-25 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10935: - Priority: Major (was: Critical) > TestFileChecksum fails in some cases >

[jira] [Commented] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607261#comment-15607261 ] Hudson commented on HDFS-11054: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10680 (See

[jira] [Commented] (HDFS-11051) Test Balancer behavior when some block moves are slow

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607301#comment-15607301 ] Hadoop QA commented on HDFS-11051: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607451#comment-15607451 ] John Zhuge commented on HDFS-11043: --- It seems the {{connect}} in the following code returned

[jira] [Updated] (HDFS-10935) TestFileChecksum fails in some cases

2016-10-25 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10935: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Updated] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11054: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10935) TestFileChecksum fails in some cases

2016-10-25 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607291#comment-15607291 ] Kai Zheng commented on HDFS-10935: -- Thanks [~jojochuang] for helping verify the fix. The patch LGTM and

[jira] [Commented] (HDFS-10935) TestFileChecksum fails in some cases

2016-10-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607326#comment-15607326 ] Hudson commented on HDFS-10935: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10681 (See

[jira] [Commented] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606873#comment-15606873 ] Wei-Chiu Chuang commented on HDFS-11055: Thanks for review [~xiaobingo]. I think ALL has too

[jira] [Updated] (HDFS-11057) Implement 'df' for viewfs

2016-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11057: -- Summary: Implement 'df' for viewfs (was: Implement 'df' for View) > Implement

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607081#comment-15607081 ] John Zhuge commented on HDFS-11043: --- Filed HDFS-11059 for the other failure. > TestWebHdfsTimeouts

[jira] [Updated] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11043: -- Attachment: (was: HDFS-11043.001.patch) > TestWebHdfsTimeouts fails > - > >

[jira] [Created] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11056: -- Summary: Concurrent append and read operations lead to checksum error Key: HDFS-11056 URL: https://issues.apache.org/jira/browse/HDFS-11056 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5684) Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting

2016-10-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606729#comment-15606729 ] Hudson commented on HDFS-5684: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10678 (See

[jira] [Commented] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606753#comment-15606753 ] Hadoop QA commented on HDFS-11055: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (HDFS-11057) Implement 'df' for View

2016-10-25 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11057: - Summary: Implement 'df' for View Key: HDFS-11057 URL: https://issues.apache.org/jira/browse/HDFS-11057 Project: Hadoop HDFS Issue Type: Task

[jira] [Assigned] (HDFS-11051) Test Balancer behavior when some block moves are slow

2016-10-25 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-11051: Assignee: Yiqun Lin > Test Balancer behavior when some block moves are slow >

[jira] [Commented] (HDFS-11005) Ozone: TestBlockPoolManager fails in ozone branch.

2016-10-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606955#comment-15606955 ] Xiaoyu Yao commented on HDFS-11005: --- Thanks [~arpitagarwal]/[~vagarychen] for the discussion, +1 for fix

[jira] [Updated] (HDFS-11051) Test Balancer behavior when some block moves are slow

2016-10-25 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11051: - Attachment: HDFS-11051.001.patch I make a code glance for the balancer tests and add the block-move

[jira] [Updated] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11047: - Attachment: HDFS-11047.000.patch > Remove deep copies of FinalizedReplica to alleviate heap

[jira] [Commented] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606794#comment-15606794 ] Xiaobing Zhou commented on HDFS-11047: -- Thanks [~jpallas]. I also did that check and tried to modify

[jira] [Commented] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606816#comment-15606816 ] Xiaobing Zhou commented on HDFS-11054: -- Thanks [~vagarychen] for the fix. +1 the patch v002. >

[jira] [Commented] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606839#comment-15606839 ] Hadoop QA commented on HDFS-11054: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606859#comment-15606859 ] Wei-Chiu Chuang commented on HDFS-11055: My bad. Should stick to INFO instead. > Update

[jira] [Issue Comment Deleted] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11055: --- Comment: was deleted (was: My bad. Should stick to INFO instead.) > Update log4j.properties

[jira] [Commented] (HDFS-11005) Ozone: TestBlockPoolManager fails in ozone branch.

2016-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606892#comment-15606892 ] Arpit Agarwal commented on HDFS-11005: -- [~vagarychen] just pointed out offline that using the

[jira] [Reopened] (HDFS-11038) DiskBalancer: support running multiple commands under one setup of disk balancer

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reopened HDFS-11038: -- Reopened this ticket since HDFS-9462 will be deprecated in that some of work overlaps with Query

[jira] [Commented] (HDFS-11001) Ozone:SCM: Add support for registerNode in SCM

2016-10-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606906#comment-15606906 ] Anu Engineer commented on HDFS-11001: - [~xyao] Thanks for a very detailed code review. Please see my

[jira] [Updated] (HDFS-11023) I/O based throttling of DN replication work

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11023: --- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > I/O based throttling

[jira] [Commented] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2016-10-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607096#comment-15607096 ] Konstantin Shvachko commented on HDFS-9500: --- Good find Erik. I agree we should decrement version

[jira] [Commented] (HDFS-11054) Suppress verbose log message in BlockPlacementPolicyDefault

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606761#comment-15606761 ] Hadoop QA commented on HDFS-11054: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11005) Ozone: TestBlockPoolManager fails in ozone branch.

2016-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606788#comment-15606788 ] Arpit Agarwal commented on HDFS-11005: -- Hi [~vagarychen], thanks for the fix. In the v2 patch - we

[jira] [Updated] (HDFS-11023) I/O based throttling of DN replication work

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11023: --- Component/s: (was: erasure-coding) > I/O based throttling of DN replication work >

[jira] [Commented] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607035#comment-15607035 ] Andrew Wang commented on HDFS-11058: Seems reasonable to me, though I'd prefer we put the new "Mounted

[jira] [Commented] (HDFS-11001) Ozone:SCM: Add support for registerNode in SCM

2016-10-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607072#comment-15607072 ] Xiaoyu Yao commented on HDFS-11001: --- Thanks [~anu] for the responses, below are some follow up

[jira] [Commented] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606884#comment-15606884 ] Xiaobing Zhou commented on HDFS-11055: -- Then, +1 the patch. Thanks. > Update log4j.properties for

[jira] [Commented] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606922#comment-15606922 ] Manoj Govindassamy commented on HDFS-11058: --- Current {{df}} command behavior for *DFS*

[jira] [Commented] (HDFS-11051) Test Balancer behavior when some block moves are slow

2016-10-25 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606928#comment-15606928 ] Yiqun Lin commented on HDFS-11051: -- Hi [~zhz], I am ready to work on this. But before I do that, I have

[jira] [Commented] (HDFS-11023) I/O based throttling of DN replication work

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607010#comment-15607010 ] Andrew Wang commented on HDFS-11023: I looked at our existing replication controls in more detail, and

[jira] [Commented] (HDFS-11058) Implement 'hadoop fs -df' command for ViewFileSystem

2016-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607041#comment-15607041 ] Manoj Govindassamy commented on HDFS-11058: --- * 'Mounted on' as the last column sounds good to

[jira] [Created] (HDFS-11059) TestWebHdfsTimeouts fails due to null SocketTimeoutException

2016-10-25 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11059: - Summary: TestWebHdfsTimeouts fails due to null SocketTimeoutException Key: HDFS-11059 URL: https://issues.apache.org/jira/browse/HDFS-11059 Project: Hadoop HDFS

[jira] [Created] (HDFS-11055) Update log4j.properties for httpfs to imporve test logging

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11055: -- Summary: Update log4j.properties for httpfs to imporve test logging Key: HDFS-11055 URL: https://issues.apache.org/jira/browse/HDFS-11055 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11047: - Description: DirectoryScanner does scan by deep copying FinalizedReplica. In a deployment with

[jira] [Commented] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606738#comment-15606738 ] Wei-Chiu Chuang commented on HDFS-11056: This bug seems to be the root cause of HDFS-11022 in the

[jira] [Updated] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-10-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11056: --- Attachment: HDFS-11056.reproduce.patch Attach a unit test to reproduce the error. >

[jira] [Commented] (HDFS-11047) Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode

2016-10-25 Thread Joe Pallas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606777#comment-15606777 ] Joe Pallas commented on HDFS-11047: --- It looks like the directory scanner and one test are the only

  1   2   >