[jira] [Commented] (HDFS-10821) DiskBalancer: Report command support with multiple nodes

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477140#comment-15477140 ] Hadoop QA commented on HDFS-10821: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10821) DiskBalancer: Report command support with multiple nodes

2016-09-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477007#comment-15477007 ] Yiqun Lin commented on HDFS-10821: -- ReUpload the v003 patch. I found there was need to print the line

[jira] [Commented] (HDFS-10821) DiskBalancer: Report command support with multiple nodes

2016-09-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15476939#comment-15476939 ] Yiqun Lin commented on HDFS-10821: -- Thanks a lot for the quick review, [~anu]. {quote} You might have to

[jira] [Commented] (HDFS-10821) DiskBalancer: Report command support with multiple nodes

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477228#comment-15477228 ] Hadoop QA commented on HDFS-10821: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10821) DiskBalancer: Report command support with multiple nodes

2016-09-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10821: - Attachment: HDFS-10821.003.patch > DiskBalancer: Report command support with multiple nodes >

[jira] [Updated] (HDFS-10821) DiskBalancer: Report command support with multiple nodes

2016-09-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10821: - Attachment: HDFS-10821.003.patch > DiskBalancer: Report command support with multiple nodes >

[jira] [Comment Edited] (HDFS-10821) DiskBalancer: Report command support with multiple nodes

2016-09-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477007#comment-15477007 ] Yiqun Lin edited comment on HDFS-10821 at 9/9/16 1:01 PM: -- ReUpload the v003

[jira] [Updated] (HDFS-10821) DiskBalancer: Report command support with multiple nodes

2016-09-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10821: - Attachment: (was: HDFS-10821.003.patch) > DiskBalancer: Report command support with multiple nodes >

[jira] [Commented] (HDFS-10450) libhdfs++: Implement Cyrus SASL implementation in sasl_enigne.cc

2016-09-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477704#comment-15477704 ] James Clampffer commented on HDFS-10450: Looks good to me, +1. Hopefully that strerr warning goes

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477827#comment-15477827 ] Xiao Chen commented on HDFS-9781: - Committed the addendum patch (#4) to trunk. >

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477889#comment-15477889 ] Hudson commented on HDFS-9781: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10419 (See

[jira] [Updated] (HDFS-10832) HttpFS does not use the ephemeral ACL bit introduced in HDFS-6326

2016-09-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10832: --- Attachment: HDFS-10832.003.patch One more rev to address checkstyle, thanks again for the review. >

[jira] [Commented] (HDFS-10838) Last full block report received time for each DN should be easily discoverable

2016-09-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478006#comment-15478006 ] Arpit Agarwal commented on HDFS-10838: -- Thank you for the updated patch [~surendrasingh]. Looks good,

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477833#comment-15477833 ] Manoj Govindassamy commented on HDFS-9781: -- Thanks [~xiaochen] for the review and commit help.

[jira] [Updated] (HDFS-10450) libhdfs++: Implement Cyrus SASL implementation in sasl_enigne.cc

2016-09-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-10450: -- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: Implement Cyrus SASL

[jira] [Commented] (HDFS-10832) HttpFS does not use the ephemeral ACL bit introduced in HDFS-6326

2016-09-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477918#comment-15477918 ] Xiao Chen commented on HDFS-10832: -- Thanks Andrew! The new patch looks great, and I had a fun time

[jira] [Resolved] (HDFS-10708) libhdfs++: Expose an InputStream interface for the apache ORC project

2016-09-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer resolved HDFS-10708. Resolution: Won't Fix Closing this. It's already covered by ORC-17 and it's better to make

[jira] [Updated] (HDFS-10832) Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions

2016-09-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10832: --- Summary: Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions (was: HttpFS does

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477713#comment-15477713 ] Xiao Chen commented on HDFS-9781: - Talked with [~manojg] offline. The test failure is because we didn't

[jira] [Updated] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-09-09 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10757: -- Attachment: HDFS-10757.01.patch Thanks [~jnp] for the feedback. bq. However, in a client context, I

[jira] [Updated] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2016-09-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-9433: -- Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) > DFS getEZForPath API on a non-existent

[jira] [Created] (HDFS-10850) getEZForPath should NOT throw FNF

2016-09-09 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10850: -- Summary: getEZForPath should NOT throw FNF Key: HDFS-10850 URL: https://issues.apache.org/jira/browse/HDFS-10850 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-10832) HttpFS does not use the ephemeral ACL bit introduced in HDFS-6326

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477970#comment-15477970 ] Hadoop QA commented on HDFS-10832: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10832) Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions

2016-09-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10832: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.9.0 Status:

[jira] [Commented] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478063#comment-15478063 ] Hadoop QA commented on HDFS-10757: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10830: - Attachment: (was: HDFS-10830.01.patch) > FsDatasetImpl#removeVolumes() crashes with

[jira] [Commented] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-09-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478236#comment-15478236 ] Anu Engineer commented on HDFS-10808: - [~arpitagarwal] & [~eddyxu] Thanks for the code review and the

[jira] [Commented] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-09-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478269#comment-15478269 ] Xiao Chen commented on HDFS-10757: -- Thanks [~xyao] for the new patch and [~jnp] for reviews. It seems

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478295#comment-15478295 ] Xiao Chen commented on HDFS-9781: - {code} // lets return without volRemoveCompletedLatch // count down, so

[jira] [Updated] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10851: --- Status: Patch Available (was: Open) > FSDirStatAndListingOp: stop passing path as string >

[jira] [Updated] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10851: --- Attachment: HDFS-10851.patch Passes IIP around instead of re-resolving or extracting and passing the

[jira] [Updated] (HDFS-10837) Standardize serializiation of WebHDFS DirectoryListing

2016-09-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10837: --- Summary: Standardize serializiation of WebHDFS DirectoryListing (was: Standardize serialziation of

[jira] [Updated] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-09-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10636: -- Attachment: HDFS-10636.010.patch Fixed issues with {{FsDatasetImpl#LOG}} in earlier

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478373#comment-15478373 ] Xiao Chen commented on HDFS-9781: - +1 pending jenkins. Thanks, Manoj! > FsDatasetImpl#getBlockReports can

[jira] [Commented] (HDFS-10853) Fix TestWebHdfsProxySelector in branch-2.8

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478445#comment-15478445 ] Hadoop QA commented on HDFS-10853: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9883) Change the hard-code value to variable

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478446#comment-15478446 ] Hadoop QA commented on HDFS-9883: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478465#comment-15478465 ] Hadoop QA commented on HDFS-9333: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478462#comment-15478462 ] Manoj Govindassamy commented on HDFS-10830: --- [~arpitagarwal], * But the base changeset in v04

[jira] [Updated] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10830: - Attachment: (was: HDFS-10830.04.patch) > FsDatasetImpl#removeVolumes() crashes with

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478468#comment-15478468 ] Arpit Agarwal commented on HDFS-10830: -- Can you please post an updated test patch for trunk that just

[jira] [Updated] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10830: - Attachment: (was: HDFS-10830.03.patch) > FsDatasetImpl#removeVolumes() crashes with

[jira] [Commented] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478494#comment-15478494 ] Hudson commented on HDFS-10808: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10422 (See

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478497#comment-15478497 ] Hadoop QA commented on HDFS-10830: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-09-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10808: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Target

[jira] [Updated] (HDFS-10837) Standardize serializiation of WebHDFS DirectoryListing

2016-09-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10837: --- Attachment: hdfs-10837.002.patch Checkstyle fixed, failed tests are a port conflict and HDFS-10499.

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478411#comment-15478411 ] Manoj Govindassamy commented on HDFS-10830: --- [~arpitagarwal], In the following block, *

[jira] [Created] (HDFS-10853) Fix TestWebHdfsProxySelector in branch-2.8

2016-09-09 Thread Eric Badger (JIRA)
Eric Badger created HDFS-10853: -- Summary: Fix TestWebHdfsProxySelector in branch-2.8 Key: HDFS-10853 URL: https://issues.apache.org/jira/browse/HDFS-10853 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-10853) Fix TestWebHdfsProxySelector in branch-2.8

2016-09-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10853: --- Status: Patch Available (was: Open) > Fix TestWebHdfsProxySelector in branch-2.8 >

[jira] [Updated] (HDFS-10853) Fix TestWebHdfsProxySelector in branch-2.8

2016-09-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10853: --- Attachment: HDFS-10853.001.patch Attaching patch to use GenericTestUtils to set log levels > Fix

[jira] [Commented] (HDFS-9883) Change the hard-code value to variable

2016-09-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478426#comment-15478426 ] Andrew Wang commented on HDFS-9883: --- For some of these replacements, they are only used in one place

[jira] [Commented] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2016-09-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478433#comment-15478433 ] Andrew Wang commented on HDFS-9333: --- This looks good to me. Do you mind also fixing

[jira] [Commented] (HDFS-10839) Add new BlockReader#readFully(ByteBuffer buf) API

2016-09-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15476064#comment-15476064 ] Zhe Zhang commented on HDFS-10839: -- [~drankye] Good idea. I think {{ByteBufferReadable}} is a better

[jira] [Commented] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478605#comment-15478605 ] Hadoop QA commented on HDFS-10851: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10823) Implement HttpFSFileSystem#listStatusIterator

2016-09-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10823: --- Attachment: HDFS-10823.001.patch WIP Patch attached. This depends on HDFS-10837 which isn't committed

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478703#comment-15478703 ] Hadoop QA commented on HDFS-9781: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478701#comment-15478701 ] Manoj Govindassamy commented on HDFS-10830: --- v05 patch looks good to me. Test also passes

[jira] [Updated] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10830: - Attachment: HDFS-10830.05.patch v05: Let's try this once more. I tried to keep the test changes

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478611#comment-15478611 ] Hadoop QA commented on HDFS-10830: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478666#comment-15478666 ] Hadoop QA commented on HDFS-10636: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10657) testAclCLI.xml setfacl test should expect mask r-x

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478730#comment-15478730 ] Hadoop QA commented on HDFS-10657: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478781#comment-15478781 ] Manoj Govindassamy commented on HDFS-10830: --- Hopefully the just previous failed [test results |

[jira] [Commented] (HDFS-10599) DiskBalancer: Execute CLI via Shell

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478628#comment-15478628 ] Hadoop QA commented on HDFS-10599: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478710#comment-15478710 ] Hadoop QA commented on HDFS-10830: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10837) Standardize serializiation of WebHDFS DirectoryListing

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478712#comment-15478712 ] Hadoop QA commented on HDFS-10837: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478773#comment-15478773 ] Arpit Agarwal commented on HDFS-10830: -- Thank you [~manojg]. [~xiaochen], can you take a look at the

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478786#comment-15478786 ] Arpit Agarwal commented on HDFS-10830: -- Correct. The Jenkins result contains the patch file name that

[jira] [Commented] (HDFS-10832) Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions

2016-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478049#comment-15478049 ] Hudson commented on HDFS-10832: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10421 (See

[jira] [Updated] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10830: - Attachment: HDFS-10830.01.patch v03 patch: rebased to trunk. > FsDatasetImpl#removeVolumes()

[jira] [Commented] (HDFS-10789) Route webhdfs through the RPC call queue

2016-09-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478210#comment-15478210 ] Daryn Sharp commented on HDFS-10789: The current situation is all the jetty handler threads end up

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9781: - Attachment: HDFS-9781-branch-2.003.patch Attaching v003 patch for branch-2. * v002 + Log

[jira] [Commented] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478178#comment-15478178 ] Arpit Agarwal commented on HDFS-10562: -- Hi [~anu], thanks for the doc improvements. One question

[jira] [Updated] (HDFS-10599) DiskBalancer: Execute CLI via Shell

2016-09-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10599: -- Status: Patch Available (was: Open) > DiskBalancer: Execute CLI via Shell >

[jira] [Commented] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478335#comment-15478335 ] Konstantin Shvachko commented on HDFS-10843: You are right {{completeBlock()}} calls are too

[jira] [Updated] (HDFS-10599) DiskBalancer: Execute CLI via Shell

2016-09-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10599: -- Attachment: HDFS-10599.001.patch Attaching v001 patch * Updated {{DiskBalancerCLI}}

[jira] [Updated] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10830: - Attachment: HDFS-10830.04.patch Thanks [~manojg]. Updated patch attached (although it still times

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9781: - Attachment: HDFS-9781-branch-2.004.patch Sure [~xiaochen], that will make the test fail

[jira] [Updated] (HDFS-10657) testAclCLI.xml setfacl test should expect mask r-x

2016-09-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10657: -- Attachment: HDFS-10657.001.patch Patch 001: * Expect mask r-x, not rwx * Add a new

[jira] [Updated] (HDFS-10657) testAclCLI.xml setfacl test should expect mask r-x

2016-09-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10657: -- Status: Patch Available (was: In Progress) > testAclCLI.xml setfacl test should expect mask r-x >

[jira] [Commented] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-09-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478176#comment-15478176 ] Arpit Agarwal commented on HDFS-10808: -- +1 for the v002 patch. > DiskBalancer does not execute

[jira] [Updated] (HDFS-10657) testAclCLI.xml setfacl test should expect mask r-x

2016-09-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10657: -- Summary: testAclCLI.xml setfacl test should expect mask r-x (was: testAclCLI.xml inherit default ACL

[jira] [Created] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-09 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10851: -- Summary: FSDirStatAndListingOp: stop passing path as string Key: HDFS-10851 URL: https://issues.apache.org/jira/browse/HDFS-10851 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10852) Verify existence of all Tool classes mentioned in HDFS script

2016-09-09 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-10852: - Summary: Verify existence of all Tool classes mentioned in HDFS script Key: HDFS-10852 URL: https://issues.apache.org/jira/browse/HDFS-10852 Project:

[jira] [Updated] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-09-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10636: -- Status: Patch Available (was: Open) > Modify ReplicaInfo to remove the assumption that

[jira] [Updated] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10830: - Attachment: HDFS-10830.03.patch Attaching the patch with the correct name. Hi [~manojg], can you

[jira] [Comment Edited] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478380#comment-15478380 ] Arpit Agarwal edited comment on HDFS-10830 at 9/9/16 9:56 PM: -- Attaching the

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478821#comment-15478821 ] Hadoop QA commented on HDFS-9781: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10854) Remove createStripedFile and addBlockToFile by creating real EC files

2016-09-09 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-10854: Summary: Remove createStripedFile and addBlockToFile by creating real EC files Key: HDFS-10854 URL: https://issues.apache.org/jira/browse/HDFS-10854 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478839#comment-15478839 ] Hadoop QA commented on HDFS-10830: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10837) Standardize serializiation of WebHDFS DirectoryListing

2016-09-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478859#comment-15478859 ] Xiao Chen commented on HDFS-10837: -- Thanks Andrew for catching and fixing this! Some small comments: -

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9781: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9883) Change the hard-code value to variable

2016-09-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1547#comment-1547 ] Yiqun Lin commented on HDFS-9883: - {quote} For some of these replacements, they are only used in one place

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478814#comment-15478814 ] Xiao Chen commented on HDFS-10830: -- Thank you both for working on this! I can take a look later today, if

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-09-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478899#comment-15478899 ] Virajith Jalaparti commented on HDFS-10636: --- The failed test case seems like a spurious failure

[jira] [Work stopped] (HDFS-9480) Expose nonDfsUsed via StorageTypeStats and DatanodeStatistics

2016-09-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9480 stopped by Brahma Reddy Battula. -- > Expose nonDfsUsed via StorageTypeStats and DatanodeStatistics >

[jira] [Work started] (HDFS-9480) Expose nonDfsUsed via StorageTypeStats and DatanodeStatistics

2016-09-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9480 started by Brahma Reddy Battula. -- > Expose nonDfsUsed via StorageTypeStats and DatanodeStatistics >

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478966#comment-15478966 ] Yiqun Lin commented on HDFS-10830: -- Just say a little, hope not to disturb you: {quote} Hopefully the

[jira] [Updated] (HDFS-10853) Fix TestWebHdfsProxySelector in branch-2.8

2016-09-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10853: --- Resolution: Invalid Status: Resolved (was: Patch Available) Internal problem only, not

[jira] [Commented] (HDFS-10756) Expose getTrashRoot to HTTPFS and WebHDFS

2016-09-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478084#comment-15478084 ] Xiao Chen commented on HDFS-10756: -- Thanks [~yuanbo] for the new patch! Overall looks good. Some comments

[jira] [Commented] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478188#comment-15478188 ] Hadoop QA commented on HDFS-10562: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478213#comment-15478213 ] Manoj Govindassamy commented on HDFS-10830: --- [~arpitagarwal], * I don't see v03 patch, probably

  1   2   >