[jira] [Commented] (HDFS-9478) Reason for failing ipc.FairCallQueue contruction should be thrown

2016-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215482#comment-15215482 ] Hadoop QA commented on HDFS-9478: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2016-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215462#comment-15215462 ] Hadoop QA commented on HDFS-7060: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215459#comment-15215459 ] Hadoop QA commented on HDFS-10225: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215449#comment-15215449 ] Chris Douglas commented on HDFS-9847: - Have you tried to set units on these variables, then format and

[jira] [Updated] (HDFS-8356) Document missing properties in hdfs-default.xml

2016-03-28 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated HDFS-8356: - Attachment: HDFS-8356.011.patch - Clean up whitespace and see how a test re-run looks > Document missing

[jira] [Commented] (HDFS-9805) TCP_NODELAY not set before SASL handshake in data transfer pipeline

2016-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215424#comment-15215424 ] Hadoop QA commented on HDFS-9805: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9871) "Bytes Being Moved" -ve(-1 B) when cluster was already balanced.

2016-03-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215420#comment-15215420 ] Hudson commented on HDFS-9871: -- FAILURE: Integrated in Hadoop-trunk-Commit #9517 (See

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2016-03-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215413#comment-15215413 ] John Zhuge commented on HDFS-7060: -- If we assume dataset lock protects {{bpSlices}}. The following

[jira] [Commented] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215404#comment-15215404 ] Hadoop QA commented on HDFS-10225: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10226) Track and use BlockScheduled size for DatanodeDescriptor instead of count.

2016-03-28 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-10226: --- Summary: Track and use BlockScheduled size for DatanodeDescriptor instead of count. Key: HDFS-10226 URL: https://issues.apache.org/jira/browse/HDFS-10226

[jira] [Commented] (HDFS-8356) Document missing properties in hdfs-default.xml

2016-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215387#comment-15215387 ] Hadoop QA commented on HDFS-8356: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-5177) blocksScheduled count should be decremented for abandoned blocks

2016-03-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215385#comment-15215385 ] Vinayakumar B commented on HDFS-5177: - Test failures are not related. > blocksScheduled count should

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215380#comment-15215380 ] Hadoop QA commented on HDFS-9349: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9885) In distcp cmd ouput, Display name should be given for org.apache.hadoop.tools.mapred.CopyMapper$Counter.

2016-03-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215376#comment-15215376 ] Surendra Singh Lilhore commented on HDFS-9885: -- Hi [~yzhangal], Please can you review .. >

[jira] [Commented] (HDFS-9871) "Bytes Being Moved" -ve(-1 B) when cluster was already balanced.

2016-03-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215366#comment-15215366 ] Brahma Reddy Battula commented on HDFS-9871: Thanks [~vinayrpet] for review and commit and

[jira] [Commented] (HDFS-9478) Reason for failing ipc.FairCallQueue contruction should be thrown

2016-03-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215356#comment-15215356 ] Arpit Agarwal commented on HDFS-9478: - +1 pending Jenkins. > Reason for failing ipc.FairCallQueue

[jira] [Updated] (HDFS-9871) "Bytes Being Moved" -ve(-1 B) when cluster was already balanced.

2016-03-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9871: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-03-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215302#comment-15215302 ] Brahma Reddy Battula commented on HDFS-9579: ok..you can handle as part of HDFS-10208. >

[jira] [Updated] (HDFS-10182) Hedged read might overwrite user's buf

2016-03-28 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-10182: Attachment: HDFS-10182-branch26.patch Patch of branch-2.6 > Hedged read might overwrite user's buf

[jira] [Updated] (HDFS-9478) Reason for failing ipc.FairCallQueue contruction should be thrown

2016-03-28 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated HDFS-9478: -- Attachment: HDFS-9478.3.patch Thanks for the input, i have updated the patch as per review comment. > Reason

[jira] [Updated] (HDFS-9599) TestDecommissioningStatus.testDecommissionStatus occasionally fails

2016-03-28 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9599: Attachment: HDFS-9599.002.patch Thanks [~jojochuang] for comment. Update the latest patch for addressing

[jira] [Commented] (HDFS-7651) [ NN Bench ] Refactor nnbench as a Tool implementation.

2016-03-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215272#comment-15215272 ] Brahma Reddy Battula commented on HDFS-7651: bq.Patch generated 17 ASF License warnings. Only

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-03-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215270#comment-15215270 ] Jitendra Nath Pandey commented on HDFS-10175: - This proposal is very simple and lightweight

[jira] [Updated] (HDFS-7651) [ NN Bench ] Refactor nnbench as a Tool implementation.

2016-03-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7651: --- Attachment: HDFS-7651-004.patch > [ NN Bench ] Refactor nnbench as a Tool

[jira] [Commented] (HDFS-10213) there is a corrupt/missing block report, but fsck result is HEALTHY

2016-03-28 Thread Wataru Yukawa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215264#comment-15215264 ] Wataru Yukawa commented on HDFS-10213: -- Thank you for comment. I'll check it out. but I think that

[jira] [Commented] (HDFS-10197) TestFsDatasetCache failing intermittently due to timeout

2016-03-28 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215232#comment-15215232 ] Lin Yiqun commented on HDFS-10197: -- Thanks [~andrew.wang] for reviewing the patch. I think we can commit

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-28 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215223#comment-15215223 ] Lin Yiqun commented on HDFS-9847: - So [~chris.douglas], what can we do next for this jira? > HDFS

[jira] [Updated] (HDFS-10206) getBlockLocations might not sort datanodes properly by distance

2016-03-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10206: --- Description: If the DFSClient machine is not a datanode, but it shares its rack with some datanodes of the

[jira] [Updated] (HDFS-5442) Zero loss HDFS data replication for multiple datacenters

2016-03-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5442: --- Target Version/s: (was: 3.0.0) > Zero loss HDFS data replication for multiple

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-03-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215187#comment-15215187 ] Colin Patrick McCabe commented on HDFS-10175: - I'm still -1 on this change. v3 creates a very

[jira] [Commented] (HDFS-9918) Erasure Coding: Sort located striped blocks based on decommissioned states

2016-03-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215182#comment-15215182 ] Rakesh R commented on HDFS-9918: Thanks [~zhz], attached another patch fixing the comment. > Erasure

[jira] [Updated] (HDFS-9918) Erasure Coding: Sort located striped blocks based on decommissioned states

2016-03-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9918: --- Attachment: HDFS-9918-006.patch > Erasure Coding: Sort located striped blocks based on decommissioned states >

[jira] [Commented] (HDFS-5442) Zero loss HDFS data replication for multiple datacenters

2016-03-28 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215175#comment-15215175 ] Konstantin Boudnik commented on HDFS-5442: -- Don't think this goes anywhere > Zero loss HDFS data

[jira] [Commented] (HDFS-5442) Zero loss HDFS data replication for multiple datacenters

2016-03-28 Thread Liang Dianpeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215174#comment-15215174 ] Liang Dianpeng commented on HDFS-5442: -- what's the status for this issue. Is it on the development or

[jira] [Commented] (HDFS-10223) peerFromSocketAndKey performs SASL exchange before setting connection timeouts

2016-03-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215168#comment-15215168 ] Colin Patrick McCabe commented on HDFS-10223: - Thanks for the reviews, [~cnauroth] and

[jira] [Updated] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-03-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10225: - Attachment: HDFS-10225.000.patch > DataNode hot swap drives should recognize storage type tags.

[jira] [Updated] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-03-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10225: - Attachment: (was: HDFS-10225.000.patch) > DataNode hot swap drives should recognize storage

[jira] [Updated] (HDFS-9805) TCP_NODELAY not set before SASL handshake in data transfer pipeline

2016-03-28 Thread Gary Helmling (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Helmling updated HDFS-9805: Attachment: HDFS-9805.002.patch Here's a new patch rebased against the latest trunk. > TCP_NODELAY

[jira] [Updated] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Attachment: HDFS-9349-HDFS-9000.008.patch v008 fixed one unit test failure. > Support reconfiguring

[jira] [Updated] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-03-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10225: - Status: Patch Available (was: Open) > DataNode hot swap drives should recognize storage type

[jira] [Updated] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-03-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10225: - Attachment: HDFS-10225.000.patch Upload an initial patch to set {{FsVolumeSpi#storageType}}

[jira] [Created] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-03-28 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-10225: Summary: DataNode hot swap drives should recognize storage type tags. Key: HDFS-10225 URL: https://issues.apache.org/jira/browse/HDFS-10225 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9939) Increase DecompressorStream skip buffer size

2016-03-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215119#comment-15215119 ] John Zhuge commented on HDFS-9939: -- Thanks. That could have been caught by HADOOP-12701 since I ran

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215101#comment-15215101 ] Xiaobing Zhou commented on HDFS-9349: - I posted patch v007. It's hard to do that change directly on

[jira] [Updated] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Attachment: HDFS-9349-HDFS-9000.007.patch > Support reconfiguring fs.protected.directories without

[jira] [Updated] (HDFS-8356) Document missing properties in hdfs-default.xml

2016-03-28 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated HDFS-8356: - Attachment: HDFS-8356.010.patch - Updated with latest feedback. > Document missing properties in

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-03-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215055#comment-15215055 ] Jitendra Nath Pandey commented on HDFS-10175: - [~cmccabe], and [~andrew.wang] the latest patch

[jira] [Commented] (HDFS-9939) Increase DecompressorStream skip buffer size

2016-03-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215032#comment-15215032 ] Andrew Wang commented on HDFS-9939: --- Only one little nit, unused variable {{buf}} in testSkip. Otherwise

[jira] [Commented] (HDFS-9478) Reason for failing ipc.FairCallQueue contruction should be thrown

2016-03-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215022#comment-15215022 ] Arpit Agarwal commented on HDFS-9478: - Thanks for updating the patch [~ajithshetty]. Nitpick for the

[jira] [Commented] (HDFS-10224) Augment DistributedFileSystem to support asynchronous HDFS access

2016-03-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215016#comment-15215016 ] Xiaobing Zhou commented on HDFS-10224: -- I posted HDFS-10224 patch (i.e.

[jira] [Updated] (HDFS-10224) Augment DistributedFileSystem to support asynchronous HDFS access

2016-03-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Status: Patch Available (was: Open) > Augment DistributedFileSystem to support asynchronous HDFS

[jira] [Updated] (HDFS-10224) Augment DistributedFileSystem to support asynchronous HDFS access

2016-03-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: HDFS-10224-HDFS-9924.000.patch > Augment DistributedFileSystem to support

[jira] [Updated] (HDFS-10224) Augment DistributedFileSystem to support asynchronous HDFS access

2016-03-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: HDFS-10224-and-HADOOP-12909.000.patch > Augment DistributedFileSystem to support

[jira] [Updated] (HDFS-10224) Augment DistributedFileSystem to support asynchronous HDFS access

2016-03-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Description: Instead of pushing asynchronous HDFS API up to FileSystem, this is to scope changes

[jira] [Created] (HDFS-10224) Augment DistributedFileSystem to support asynchronous HDFS access

2016-03-28 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-10224: Summary: Augment DistributedFileSystem to support asynchronous HDFS access Key: HDFS-10224 URL: https://issues.apache.org/jira/browse/HDFS-10224 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6520) hdfs fsck -move not working

2016-03-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214966#comment-15214966 ] John Zhuge commented on HDFS-6520: -- Wrote the unit test that reproduced the problem. Got checksum

[jira] [Updated] (HDFS-10223) peerFromSocketAndKey performs SASL exchange before setting connection timeouts

2016-03-28 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10223: - Hadoop Flags: Reviewed +1 for patch v002, pending pre-commit. Thank you for making the update.

[jira] [Commented] (HDFS-9918) Erasure Coding: Sort located striped blocks based on decommissioned states

2016-03-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214940#comment-15214940 ] Zhe Zhang commented on HDFS-9918: - Thanks for the update Rakesh. {code} // FSNamesystem#getBlockLocations

[jira] [Updated] (HDFS-10223) peerFromSocketAndKey performs SASL exchange before setting connection timeouts

2016-03-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-10223: Attachment: HDFS-10223.002.patch * Add {{IOUtils#cleanup}} in the unit test in a

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

2016-03-28 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214934#comment-15214934 ] Ravi Prakash commented on HDFS-10220: - Thank you for the report Nicolas! Which version of Hadoop did

[jira] [Commented] (HDFS-10197) TestFsDatasetCache failing intermittently due to timeout

2016-03-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214920#comment-15214920 ] Andrew Wang commented on HDFS-10197: Hi [~linyiqun], thanks for doing the analysis. I'm +1 on your

[jira] [Commented] (HDFS-10223) peerFromSocketAndKey performs SASL exchange before setting connection timeouts

2016-03-28 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214913#comment-15214913 ] Chris Nauroth commented on HDFS-10223: -- Thank you, Colin. This is a good catch. In the test, would

[jira] [Updated] (HDFS-10222) libhdfs++: Shutdown sockets to avoid "Connection reset by peer"

2016-03-28 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10222: --- Status: Patch Available (was: Open) > libhdfs++: Shutdown sockets to avoid "Connection reset

[jira] [Updated] (HDFS-10222) libhdfs++: Shutdown sockets to avoid "Connection reset by peer"

2016-03-28 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10222: --- Attachment: HDFS-10222.HDFS-8707.000.patch Added patch. The fix has two parts: 1) Always

[jira] [Commented] (HDFS-10223) peerFromSocketAndKey performs SASL exchange before setting connection timeouts

2016-03-28 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214867#comment-15214867 ] Sean Busbey commented on HDFS-10223: +1 non-binding, pending non-surprising buildbot feedback >

[jira] [Commented] (HDFS-9805) TCP_NODELAY not set before SASL handshake in data transfer pipeline

2016-03-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214854#comment-15214854 ] Colin Patrick McCabe commented on HDFS-9805: Hi [~ghelmling], thanks for looking at this. Can

[jira] [Updated] (HDFS-10223) peerFromSocketAndKey performs SASL exchange before setting connection timeouts

2016-03-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-10223: Attachment: HDFS-10223.001.patch > peerFromSocketAndKey performs SASL exchange

[jira] [Updated] (HDFS-10223) peerFromSocketAndKey performs SASL exchange before setting connection timeouts

2016-03-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-10223: Attachment: (was: HDFS-10223.001.patch) > peerFromSocketAndKey performs SASL

[jira] [Updated] (HDFS-9805) TCP_NODELAY not set before SASL handshake in data transfer pipeline

2016-03-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9805: --- Attachment: (was: HDFS-10223.001.patch) > TCP_NODELAY not set before SASL

[jira] [Updated] (HDFS-9805) TCP_NODELAY not set before SASL handshake in data transfer pipeline

2016-03-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9805: --- Attachment: (was: HDFS-9805.001.patch) > TCP_NODELAY not set before SASL handshake

[jira] [Updated] (HDFS-9805) TCP_NODELAY not set before SASL handshake in data transfer pipeline

2016-03-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9805: --- Attachment: HDFS-10223.001.patch > TCP_NODELAY not set before SASL handshake in data

[jira] [Updated] (HDFS-10223) peerFromSocketAndKey performs SASL exchange before setting connection timeouts

2016-03-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-10223: Attachment: HDFS-10223.001.patch > peerFromSocketAndKey performs SASL exchange

[jira] [Updated] (HDFS-10223) peerFromSocketAndKey performs SASL exchange before setting connection timeouts

2016-03-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-10223: Status: Patch Available (was: Open) > peerFromSocketAndKey performs SASL exchange

[jira] [Created] (HDFS-10223) peerFromSocketAndKey performs SASL exchange before setting connection timeouts

2016-03-28 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-10223: --- Summary: peerFromSocketAndKey performs SASL exchange before setting connection timeouts Key: HDFS-10223 URL: https://issues.apache.org/jira/browse/HDFS-10223

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-03-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214680#comment-15214680 ] Jing Zhao commented on HDFS-9820: - Thanks for working on this, [~yzhangal]! Some comments on the current

[jira] [Created] (HDFS-10222) libhdfs++: Shutdown sockets to avoid "Connection reset by peer"

2016-03-28 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10222: -- Summary: libhdfs++: Shutdown sockets to avoid "Connection reset by peer" Key: HDFS-10222 URL: https://issues.apache.org/jira/browse/HDFS-10222 Project: Hadoop

[jira] [Commented] (HDFS-7651) [ NN Bench ] Refactor nnbench as a Tool implementation.

2016-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214590#comment-15214590 ] Hadoop QA commented on HDFS-7651: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-4949) Centralized cache management in HDFS

2016-03-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-4949: -- Fix Version/s: 2.3.0 > Centralized cache management in HDFS > > >

[jira] [Commented] (HDFS-9720) DiskBalancer : Add configuration parameters

2016-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214559#comment-15214559 ] Hadoop QA commented on HDFS-9720: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214540#comment-15214540 ] Chris Douglas commented on HDFS-9847: - bq. Are you okay with making this a INFO ? Sure. bq. Should we

[jira] [Commented] (HDFS-9918) Erasure Coding: Sort located striped blocks based on decommissioned states

2016-03-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214520#comment-15214520 ] Rakesh R commented on HDFS-9918: Attached new patch, here modified sort logic of lastlocatedBlock to fix

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-03-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214518#comment-15214518 ] Ming Ma commented on HDFS-9579: --- [~brahmareddy], that is right for the case where ScriptBasedMapping is used

[jira] [Updated] (HDFS-9918) Erasure Coding: Sort located striped blocks based on decommissioned states

2016-03-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9918: --- Attachment: HDFS-9918-005.patch > Erasure Coding: Sort located striped blocks based on decommissioned states >

[jira] [Updated] (HDFS-9720) DiskBalancer : Add configuration parameters

2016-03-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9720: Status: Patch Available (was: Open) > DiskBalancer : Add configuration parameters >

[jira] [Commented] (HDFS-9599) TestDecommissioningStatus.testDecommissionStatus occasionally fails

2016-03-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214475#comment-15214475 ] Wei-Chiu Chuang commented on HDFS-9599: --- Hi [~linyiqun], thanks for the contribution. I think your

[jira] [Commented] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-03-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214460#comment-15214460 ] Ming Ma commented on HDFS-10208: asf license will be taken care of by HDFS-10221. The unit test failures

[jira] [Updated] (HDFS-9309) Tests that use KeyStoreUtil must call KeyStoreUtil.cleanupSSLConfig()

2016-03-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9309: -- Assignee: (was: Wei-Chiu Chuang) > Tests that use KeyStoreUtil must call

[jira] [Updated] (HDFS-9277) IOException "Unable to load OAuth2 connection factory." in TestWebHDFSOAuth2.listStatusReturnsAsExpected

2016-03-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9277: -- Assignee: (was: Wei-Chiu Chuang) > IOException "Unable to load OAuth2 connection factory."

[jira] [Updated] (HDFS-9309) Tests that use KeyStoreUtil must call KeyStoreUtil.cleanupSSLConfig()

2016-03-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9309: -- Resolution: Cannot Reproduce Status: Resolved (was: Patch Available) The issue does not

[jira] [Updated] (HDFS-9466) TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky

2016-03-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9466: -- Attachment: org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitCache-output.txt Attaching the

[jira] [Commented] (HDFS-8101) DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime

2016-03-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214422#comment-15214422 ] Kihwal Lee commented on HDFS-8101: -- Fixed CHANGES.txt. > DFSClient use of non-constant DFSConfigKeys

[jira] [Comment Edited] (HDFS-8101) DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime

2016-03-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214417#comment-15214417 ] Kihwal Lee edited comment on HDFS-8101 at 3/28/16 4:28 PM: --- The CHANGES.txt entry

[jira] [Updated] (HDFS-10221) Add test resource dfs.hosts.json to the rat exclusions

2016-03-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10221: --- Assignee: Ming Ma Status: Patch Available (was: Open) > Add test resource dfs.hosts.json to the rat

[jira] [Commented] (HDFS-8101) DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime

2016-03-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214417#comment-15214417 ] Kihwal Lee commented on HDFS-8101: -- The CHANGES.txt entry was added to 2.7.2 (released) section. >

[jira] [Updated] (HDFS-10221) Add test resource dfs.hosts.json to the rat exclusions

2016-03-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10221: --- Attachment: HDFS-10221.patch Here is the patch. > Add test resource dfs.hosts.json to the rat exclusions >

[jira] [Updated] (HDFS-9277) IOException "Unable to load OAuth2 connection factory." in TestWebHDFSOAuth2.listStatusReturnsAsExpected

2016-03-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9277: -- Resolution: Cannot Reproduce Status: Resolved (was: Patch Available) Resolve as "cannot

[jira] [Commented] (HDFS-9005) Provide configuration support for upgrade domain

2016-03-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214379#comment-15214379 ] Ming Ma commented on HDFS-9005: --- Thank you [~eddyxu] for the commit! Thank you [~aw] for the suggestion on

[jira] [Updated] (HDFS-10221) Add test resource dfs.hosts.json to the rat exclusions

2016-03-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10221: --- Summary: Add test resource dfs.hosts.json to the rat exclusions (was: Add test resource dfs.hosts.json to

[jira] [Updated] (HDFS-10221) Add test resource dfs.hosts.json to the RAT exclusions

2016-03-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10221: --- Description: A new test resource dfs.hosts.json was added to HDFS-9005 for better readability. Given json

[jira] [Updated] (HDFS-10221) Add test resource dfs.hosts.json to the RAT exclusions

2016-03-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10221: --- Summary: Add test resource dfs.hosts.json to the RAT exclusions (was: Replace test resource dfs.hosts.json

  1   2   >