[jira] [Commented] (HDFS-11027) libhdfs++: Don't retry if there is an authentication failure

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595611#comment-15595611 ] Hadoop QA commented on HDFS-11027: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11001) Ozone:SCM: Add support for registerNode in SCM

2016-10-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11001: Status: Patch Available (was: Open) > Ozone:SCM: Add support for registerNode in SCM >

[jira] [Commented] (HDFS-11015) Enforce timeout in balancer

2016-10-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595313#comment-15595313 ] Kihwal Lee commented on HDFS-11015: --- Heh. Looks like the unit tests are doing their job. > Enforce

[jira] [Updated] (HDFS-11027) libhdfs++: Don't retry if there is an authentication failure

2016-10-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11027: --- Attachment: HDFS-11027.HDFS-8707.001.patch New Patch from [~xiaowei.zhu]. Looks good to me,

[jira] [Commented] (HDFS-11041) Unable to unregister FsDatasetState MBean if if DataNode is shutdown twice

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595575#comment-15595575 ] Wei-Chiu Chuang commented on HDFS-11041: The failed tests in TestDiskBalancerWithMockMover are

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-21 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595527#comment-15595527 ] Xiaobing Zhou commented on HDFS-11011: -- There were still some check styles missed, v007 fixed them.

[jira] [Updated] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-21 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11011: - Attachment: HDFS-11011.007.patch > Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

[jira] [Commented] (HDFS-11001) Ozone:SCM: Add support for registerNode in SCM

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595643#comment-15595643 ] Hadoop QA commented on HDFS-11001: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10938) Ozone: SCM: Add datanode protocol

2016-10-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10938: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Created] (HDFS-11042) Add missing cleanupSSLConfig() call for tests that use setupSSLConfig()

2016-10-21 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created HDFS-11042: -- Summary: Add missing cleanupSSLConfig() call for tests that use setupSSLConfig() Key: HDFS-11042 URL: https://issues.apache.org/jira/browse/HDFS-11042 Project: Hadoop

[jira] [Commented] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-10-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596252#comment-15596252 ] Xiaoyu Yao commented on HDFS-10757: --- Thanks [~xiaochen] for the review. I've done all the manual testing

[jira] [Updated] (HDFS-11042) Add missing cleanupSSLConfig() call for tests that use setupSSLConfig()

2016-10-21 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-11042: --- Status: Patch Available (was: Open) > Add missing cleanupSSLConfig() call for tests that use

[jira] [Updated] (HDFS-11042) Add missing cleanupSSLConfig() call for tests that use setupSSLConfig()

2016-10-21 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-11042: --- Attachment: HDFS-11042.001.patch Patch that addresses only the hdfs-project tests that need the fix.

[jira] [Updated] (HDFS-11042) Add missing cleanupSSLConfig() call for tests that use setupSSLConfig()

2016-10-21 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-11042: --- Component/s: test > Add missing cleanupSSLConfig() call for tests that use setupSSLConfig() >

[jira] [Updated] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8410: -- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11042) Add missing cleanupSSLConfig() call for tests that use setupSSLConfig()

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596262#comment-15596262 ] Hadoop QA commented on HDFS-11042: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11041) Unable to unregister FsDatasetState MBean if if DataNode is shutdown twice

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595743#comment-15595743 ] Wei-Chiu Chuang commented on HDFS-11041: Hi [~xyao] as you can see in the original description,

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-10-21 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595745#comment-15595745 ] Erik Krogen commented on HDFS-10872: [~andrew.wang] I did some profiling and it seems that the

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-10-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595794#comment-15595794 ] Zhe Zhang commented on HDFS-10872: -- Thanks for the benchmark [~xkrogen]! Results look very interesting. I

[jira] [Issue Comment Deleted] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-10-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10872: - Comment: was deleted (was: Thanks for the benchmark [~xkrogen]! Results look very interesting. I think

[jira] [Comment Edited] (HDFS-11001) Ozone:SCM: Add support for registerNode in SCM

2016-10-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570508#comment-15570508 ] Anu Engineer edited comment on HDFS-11001 at 10/21/16 5:43 PM: --- Attaching a

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595836#comment-15595836 ] Hadoop QA commented on HDFS-11011: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-10-21 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595897#comment-15595897 ] Uma Maheswara Rao G commented on HDFS-10885: {quote} I do think it's a very good way, but what

[jira] [Commented] (HDFS-11041) Unable to unregister FsDatasetState MBean if if DataNode is shutdown twice

2016-10-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595733#comment-15595733 ] Xiaoyu Yao commented on HDFS-11041: --- [~jojochuang], thanks for reporting this and post the fix. The fix

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595707#comment-15595707 ] Xiaoyu Yao commented on HDFS-11011: --- Thanks [~xiaobingo] and [~liuml07] for working on this. The v007

[jira] [Updated] (HDFS-11041) Unable to unregister FsDatasetState MBean if if DataNode is shutdown twice

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11041: --- Attachment: HDFS-11041.02.patch Upload patch v02. Instead of resetting FsDatasetSpi reference

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-10-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595792#comment-15595792 ] Zhe Zhang commented on HDFS-10872: -- Thanks for the benchmark [~xkrogen]! Results look very interesting. I

[jira] [Commented] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595927#comment-15595927 ] Andrew Wang commented on HDFS-10872: This looks great, thanks Erik! I was a bit worried since

[jira] [Commented] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596555#comment-15596555 ] Wei-Chiu Chuang commented on HDFS-10975: Sure I'll do it. > fsck -list-corruptfileblocks does not

[jira] [Updated] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10975: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10975: --- Release Note: Fixed a bug that made fsck -list-corruptfileblocks counts corrupt erasure coded

[jira] [Commented] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

2016-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596596#comment-15596596 ] Andrew Wang commented on HDFS-10368: Thanks for the investigation Rakesh. I think there's little harm

[jira] [Commented] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

2016-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596614#comment-15596614 ] Hudson commented on HDFS-10975: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10659 (See

[jira] [Commented] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596649#comment-15596649 ] Wei-Chiu Chuang commented on HDFS-11033: Committing v2 patch > Add documents for native raw

[jira] [Updated] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11033: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-11026) Convert BlockTokenIdentifier to use Protobuf

2016-10-21 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596667#comment-15596667 ] Chris Douglas commented on HDFS-11026: -- The length prefix is a

[jira] [Commented] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

2016-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596551#comment-15596551 ] Andrew Wang commented on HDFS-10975: I'm +1 too, [~jojochuang] you want to handle the commit since you

[jira] [Assigned] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-11043: - Assignee: John Zhuge > TestWebHdfsTimeouts fails > - > >

[jira] [Commented] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596553#comment-15596553 ] Andrew Wang commented on HDFS-11033: LGTM too thanks Sammi and Wei-Chiu! > Add documents for native

[jira] [Commented] (HDFS-11042) Add missing cleanupSSLConfig() call for tests that use setupSSLConfig()

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596623#comment-15596623 ] Hadoop QA commented on HDFS-11042: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11010) Update to Protobuf 3 in trunk

2016-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596678#comment-15596678 ] Andrew Wang commented on HDFS-11010: bq. I am expecting that our clients will have to move to using

[jira] [Commented] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596693#comment-15596693 ] Hudson commented on HDFS-11033: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10660 (See

[jira] [Created] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-21 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11043: -- Summary: TestWebHdfsTimeouts fails Key: HDFS-11043 URL: https://issues.apache.org/jira/browse/HDFS-11043 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-10-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596372#comment-15596372 ] Xiao Chen commented on HDFS-10757: -- Thanks [~xyao] for the explanation. On the final pass I see 1

[jira] [Commented] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596303#comment-15596303 ] Hudson commented on HDFS-8410: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10656 (See

[jira] [Updated] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-10-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10757: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11042) Add missing cleanupSSLConfig() call for tests that use setupSSLConfig()

2016-10-21 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-11042: --- Attachment: HDFS-11042.002.patch > Add missing cleanupSSLConfig() call for tests that use

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596287#comment-15596287 ] Andrew Wang commented on HDFS-8411: --- Thanks for picking this up [~Sammi], I'd like to go a bit deeper in

[jira] [Updated] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11043: --- Attachment: org.apache.hadoop.hdfs.web.TestWebHdfsTimeouts.txt Attaching surefire log from my local

[jira] [Updated] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11043: --- {noformat} -> % java -version java version "1.8.0_101" Java(TM) SE Runtime Environment (build

[jira] [Commented] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596461#comment-15596461 ] Hudson commented on HDFS-10757: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10658 (See

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596905#comment-15596905 ] John Zhuge commented on HDFS-11043: --- Reproduced 4 out of 100 times on Ubuntu 14.04 and Java 1.8.0_91. >

[jira] [Commented] (HDFS-11042) Add missing cleanupSSLConfig() call for tests that use setupSSLConfig()

2016-10-21 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596850#comment-15596850 ] Kuhu Shukla commented on HDFS-11042: [~kihwal], Request for comments/review. Thanks a lot! > Add

[jira] [Assigned] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2016-10-21 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-9500: - Assignee: Erik Krogen (was: Phil Yang) > datanodesSoftwareVersions map may counting wrong when

[jira] [Work started] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-11043 started by John Zhuge. - > TestWebHdfsTimeouts fails > - > > Key:

[jira] [Commented] (HDFS-11043) TestWebHdfsTimeouts fails

2016-10-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596946#comment-15596946 ] John Zhuge commented on HDFS-11043: --- {{SocksSocketImpl#remainingMillis}} can return such exception, so

[jira] [Commented] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

2016-10-21 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596866#comment-15596866 ] Takanobu Asanuma commented on HDFS-10975: - Thanks for committing and creating this issue,

[jira] [Created] (HDFS-11044) TestRollingUpgrade fails intermittently

2016-10-21 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-11044: Summary: TestRollingUpgrade fails intermittently Key: HDFS-11044 URL: https://issues.apache.org/jira/browse/HDFS-11044 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-10938) Ozone: SCM: Add datanode protocol

2016-10-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595547#comment-15595547 ] Xiaoyu Yao commented on HDFS-10938: --- Thanks [~anu] for the update. +1 for v002 patch. The unit test

[jira] [Updated] (HDFS-11044) TestRollingUpgrade fails intermittently

2016-10-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11044: - Description: The test {{TestRollingUpgrade#testRollback}} fails intermittently in

[jira] [Updated] (HDFS-11044) TestRollingUpgrade fails intermittently

2016-10-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11044: - Status: Patch Available (was: Open) Attach a patch to fix this. > TestRollingUpgrade fails

[jira] [Commented] (HDFS-10730) Fix some failed tests due to BindException

2016-10-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15597070#comment-15597070 ] Yiqun Lin commented on HDFS-10730: -- Thanks, [~brahmareddy]. > Fix some failed tests due to BindException

[jira] [Updated] (HDFS-11044) TestRollingUpgrade fails intermittently

2016-10-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11044: - Affects Version/s: 3.0.0-alpha1 > TestRollingUpgrade fails intermittently >

[jira] [Commented] (HDFS-11044) TestRollingUpgrade fails intermittently

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15597191#comment-15597191 ] Hadoop QA commented on HDFS-11044: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10884) [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN

2016-10-21 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15597224#comment-15597224 ] Uma Maheswara Rao G commented on HDFS-10884: [~rakeshr] Thanks. Please check below. # {quote}

[jira] [Updated] (HDFS-11044) TestRollingUpgrade fails intermittently

2016-10-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11044: - Description: The test {{TestRollingUpgrade#testRollback}} fails intermittently in

[jira] [Updated] (HDFS-11044) TestRollingUpgrade fails intermittently

2016-10-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11044: - Description: The test {{TestRollingUpgrade#testRollback}} fails intermittently in

[jira] [Updated] (HDFS-11044) TestRollingUpgrade fails intermittently

2016-10-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11044: - Attachment: HDFS-11044.001.patch > TestRollingUpgrade fails intermittently >

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15594212#comment-15594212 ] Hadoop QA commented on HDFS-11011: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15594297#comment-15594297 ] Hadoop QA commented on HDFS-11031: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15594185#comment-15594185 ] Hadoop QA commented on HDFS-11031: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10730) Fix some failed tests due to BindException

2016-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595049#comment-15595049 ] Hudson commented on HDFS-10730: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10653 (See

[jira] [Updated] (HDFS-11015) Enforce timeout in balancer

2016-10-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11015: -- Attachment: HDFS-11015-2.patch Attaching the updated patch. > Enforce timeout in balancer >

[jira] [Commented] (HDFS-11041) Unable to unregister FsDatasetState MBean if if DataNode is shutdown twice

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595015#comment-15595015 ] Hadoop QA commented on HDFS-11041: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10905) Refactor DataStreamer#createBlockOutputStream

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15594969#comment-15594969 ] Wei-Chiu Chuang commented on HDFS-10905: I ran the whole set of unit tests against this patch

[jira] [Updated] (HDFS-10730) Fix some failed tests due to BindException

2016-10-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10730: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-11015) Enforce timeout in balancer

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595232#comment-15595232 ] Hadoop QA commented on HDFS-11015: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11041) Unable to unregister FsDatasetState MBean if if DataNode is shutdown twice

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11041: --- Attachment: HDFS-11041.01.patch I think this simple patch should fix the issue. Submit this

[jira] [Assigned] (HDFS-11041) Unable to unregister FsDatasetState MBean if if DataNode is shutdown twice

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-11041: -- Assignee: Wei-Chiu Chuang > Unable to unregister FsDatasetState MBean if if DataNode

[jira] [Updated] (HDFS-11041) Unable to unregister FsDatasetState MBean if if DataNode is shutdown twice

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11041: --- Status: Patch Available (was: Open) > Unable to unregister FsDatasetState MBean if if

[jira] [Created] (HDFS-11041) Unable to unregister FsDatasetState MBean if if DataNode is shutdown twice

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11041: -- Summary: Unable to unregister FsDatasetState MBean if if DataNode is shutdown twice Key: HDFS-11041 URL: https://issues.apache.org/jira/browse/HDFS-11041

[jira] [Updated] (HDFS-10935) Java-based EC codec does not reconstruct blocks correctly

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10935: --- Summary: Java-based EC codec does not reconstruct blocks correctly (was: TestFileChecksum

[jira] [Commented] (HDFS-10935) Java-based EC codec does not reconstruct blocks correctly

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15594869#comment-15594869 ] Wei-Chiu Chuang commented on HDFS-10935: Bump priority to critical as it seems to generate corrupt

[jira] [Updated] (HDFS-10935) Java-based EC codec does not reconstruct blocks correctly

2016-10-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10935: --- Priority: Critical (was: Major) > Java-based EC codec does not reconstruct blocks correctly