[jira] [Updated] (HDFS-8215) Refactor NamenodeFsck#check method

2015-04-23 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-8215: --- Status: Patch Available (was: Open) Refactor NamenodeFsck#check method

[jira] [Updated] (HDFS-6763) Perform file system-wide quota initialization once on transitioning to active

2015-04-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6763: - Target Version/s: 2.8.0 (was: 2.6.0) Perform file system-wide quota initialization once on transitioning

[jira] [Commented] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509357#comment-14509357 ] Anu Engineer commented on HDFS-8211: I will make the test simpler, thanx for the

[jira] [Commented] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509402#comment-14509402 ] Arpit Agarwal commented on HDFS-8211: - The storageUuid/storageId is different from the

[jira] [Updated] (HDFS-8232) Missing datanode counters when using Metrics2 sink interface

2015-04-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8232: --- Description: When using the Metric2 Sink interface none of the counters declared under

[jira] [Created] (HDFS-8232) Missing datanode counters when using Metrics2 sink interface

2015-04-23 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-8232: -- Summary: Missing datanode counters when using Metrics2 sink interface Key: HDFS-8232 URL: https://issues.apache.org/jira/browse/HDFS-8232 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8204) Mover/Balancer should not schedule two replicas to the same DN

2015-04-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509554#comment-14509554 ] Tsz Wo Nicholas Sze commented on HDFS-8204: --- My previous comment was for the bug,

[jira] [Updated] (HDFS-8213) DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace

2015-04-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8213: --- Summary: DFSClient should use hdfs.client.htrace HTrace configuration prefix rather

[jira] [Commented] (HDFS-8231) StackTrace displayed at client while QuotaByStorageType exceeds

2015-04-23 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509383#comment-14509383 ] Chris Nauroth commented on HDFS-8231: - [~andreina], thank you for reporting the bug.

[jira] [Commented] (HDFS-8204) Mover/Balancer should not schedule two replicas to the same DN

2015-04-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509560#comment-14509560 ] Tsz Wo Nicholas Sze commented on HDFS-8204: --- Just found that you updated the

[jira] [Commented] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509377#comment-14509377 ] Anu Engineer commented on HDFS-8211: I looked at the SimulatedFSDataSet unfortunately

[jira] [Updated] (HDFS-6763) Perform file system-wide quota initialization once on transitioning to active

2015-04-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6763: - Summary: Perform file system-wide quota initialization once on transitioning to active (was: Standby NN

[jira] [Commented] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509407#comment-14509407 ] Hadoop QA commented on HDFS-8033: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Assigned] (HDFS-6763) Perform file system-wide quota initialization once on transitioning to active

2015-04-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-6763: Assignee: Kihwal Lee Perform file system-wide quota initialization once on transitioning to active

[jira] [Updated] (HDFS-6763) Perform file system-wide quota initialization once on transitioning to active

2015-04-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6763: - Attachment: HDFS-6763.patch Perform file system-wide quota initialization once on transitioning to active

[jira] [Commented] (HDFS-6763) Standby NN stalls after processing edits

2015-04-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509389#comment-14509389 ] Kihwal Lee commented on HDFS-6763: -- It is not just SBN that is being affected. Even ANN

[jira] [Updated] (HDFS-8147) Mover should not schedule two replicas to the same DN storage

2015-04-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8147: -- Hadoop Flags: Reviewed +1 the new patch looks good. Mover should not schedule two

[jira] [Commented] (HDFS-8215) Refactor NamenodeFsck#check method

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509704#comment-14509704 ] Hadoop QA commented on HDFS-8215: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8204) Mover/Balancer should not schedule two replicas to the same DN

2015-04-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509608#comment-14509608 ] Tsz Wo Nicholas Sze commented on HDFS-8204: --- Update: This issue is about DN.

[jira] [Created] (HDFS-8233) Fix DFSStripedOutputStream#getCurrentBlockGroupBytes when the last stripe is at the block group boundary

2015-04-23 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-8233: --- Summary: Fix DFSStripedOutputStream#getCurrentBlockGroupBytes when the last stripe is at the block group boundary Key: HDFS-8233 URL: https://issues.apache.org/jira/browse/HDFS-8233

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2015-04-23 Thread Rashmi Vinayak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509711#comment-14509711 ] Rashmi Vinayak commented on HDFS-7337: -- Hi Kai, For each of the modes in Hitchhiker,

[jira] [Commented] (HDFS-8147) Mover should not schedule two replicas to the same DN storage

2015-04-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509599#comment-14509599 ] Hudson commented on HDFS-8147: -- FAILURE: Integrated in Hadoop-trunk-Commit #7652 (See

[jira] [Updated] (HDFS-8234) DistributedFileSystem and Globber should apply PathFilter early

2015-04-23 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated HDFS-8234: - Description: HDFS-985 added partial listing in listStatus to avoid listing entries of

[jira] [Commented] (HDFS-7959) WebHdfs logging is missing on Datanode

2015-04-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509956#comment-14509956 ] Haohui Mai commented on HDFS-7959: -- The current approach looks okay. A cleaner approach

[jira] [Created] (HDFS-8235) Create DFSStripedInputStream in DFSClient#open

2015-04-23 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-8235: --- Summary: Create DFSStripedInputStream in DFSClient#open Key: HDFS-8235 URL: https://issues.apache.org/jira/browse/HDFS-8235 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-8223) Should calculate checksum for parity blocks in DFSStripedOutputStream

2015-04-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509985#comment-14509985 ] Jing Zhao commented on HDFS-8223: - Thanks for fixing this, Yi! The patch looks good to me.

[jira] [Updated] (HDFS-8231) StackTrace displayed at client while QuotaByStorageType exceeds

2015-04-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8231: - Attachment: HDFS-8231.00.patch Thanks [~andreina] and [~cnauroth] for looking at the issue. I attached a

[jira] [Updated] (HDFS-8213) DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace

2015-04-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8213: --- Assignee: Colin Patrick McCabe (was: Brahma Reddy Battula) Status: Patch

[jira] [Updated] (HDFS-8213) DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace

2015-04-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8213: --- Attachment: HDFS-8213.001.patch DFSClient should use hdfs.client.htrace HTrace

[jira] [Updated] (HDFS-8233) Fix DFSStripedOutputStream#getCurrentBlockGroupBytes when the last stripe is at the block group boundary

2015-04-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8233: Attachment: hdfs8233-HDFS-7285.000.patch When we call {{getCurrentBlockGroupBytes}}, the block object in

[jira] [Resolved] (HDFS-8223) Should calculate checksum for parity blocks in DFSStripedOutputStream

2015-04-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8223. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this to the

[jira] [Updated] (HDFS-8215) Refactor NamenodeFsck#check method

2015-04-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8215: -- Priority: Minor (was: Major) Hadoop Flags: Reviewed +1 the patch looks good.

[jira] [Commented] (HDFS-8215) Refactor NamenodeFsck#check method

2015-04-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509845#comment-14509845 ] Hudson commented on HDFS-8215: -- FAILURE: Integrated in Hadoop-trunk-Commit #7654 (See

[jira] [Updated] (HDFS-8223) Should calculate checksum for parity blocks in DFSStripedOutputStream

2015-04-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8223: Attachment: HDFS-8223.rebase.patch Upload the rebased patch. Should calculate checksum for parity blocks

[jira] [Updated] (HDFS-8215) Refactor NamenodeFsck#check method

2015-04-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8215: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Resolved] (HDFS-8233) Fix DFSStripedOutputStream#getCurrentBlockGroupBytes when the last stripe is at the block group boundary

2015-04-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8233. - Resolution: Fixed Fix Version/s: HDFS-7285 Thanks for the review, Nicholas! I've committed this.

[jira] [Updated] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-04-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6763: - Status: Patch Available (was: Open) Initialize file system-wide quota once on transitioning to active

[jira] [Updated] (HDFS-8233) Fix DFSStripedOutputStream#getCurrentBlockGroupBytes when the last stripe is at the block group boundary

2015-04-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8233: Description: Currently {{DFSStripedOutputStream#getCurrentBlockGroupBytes}} simply uses

[jira] [Created] (HDFS-8236) Merge HDFS-8227 into EC branch

2015-04-23 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8236: Summary: Merge HDFS-8227 into EC branch Key: HDFS-8236 URL: https://issues.apache.org/jira/browse/HDFS-8236 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-8236) Merge HDFS-8227 into EC branch

2015-04-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8236: - Attachment: HDFS-8236.000.patch Merge HDFS-8227 into EC branch --

[jira] [Updated] (HDFS-8233) Fix DFSStripedOutputStream#getCurrentBlockGroupBytes when the last stripe is at the block group boundary

2015-04-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8233: -- Hadoop Flags: Reviewed +1 patch looks good. Fix

[jira] [Commented] (HDFS-8228) TestDFSStripedOutputStream#testFileSmallerThanOneStripe2 failed

2015-04-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509979#comment-14509979 ] Tsz Wo Nicholas Sze commented on HDFS-8228: --- Just tried. It did not fail in my

[jira] [Commented] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509367#comment-14509367 ] Arpit Agarwal commented on HDFS-8211: - bq. The reason being that all the functions of

[jira] [Commented] (HDFS-8147) Mover should not schedule two replicas to the same DN storage

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509401#comment-14509401 ] Hadoop QA commented on HDFS-8147: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-04-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6763: - Summary: Initialize file system-wide quota once on transitioning to active (was: Perform file system-wide

[jira] [Commented] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509472#comment-14509472 ] Colin Patrick McCabe commented on HDFS-8213: bq. can you people suggest

[jira] [Commented] (HDFS-7281) Missing block is marked as corrupted block

2015-04-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510451#comment-14510451 ] Yongjun Zhang commented on HDFS-7281: - Hi [~mingma], Thanks for the new rev and sorry

[jira] [Updated] (HDFS-8147) Mover should not schedule two replicas to the same DN storage

2015-04-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8147: -- Resolution: Fixed Fix Version/s: 2.7.1 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-8228) TestDFSStripedOutputStream#testFileSmallerThanOneStripe2 failed

2015-04-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8228: Summary: TestDFSStripedOutputStream#testFileSmallerThanOneStripe2 failed (was:

[jira] [Updated] (HDFS-8228) TestDFSStripedInputStream#testFileSmallerThanOneStripe2 failed

2015-04-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8228: Issue Type: Sub-task (was: Bug) Parent: HDFS-7285

[jira] [Created] (HDFS-8234) DistributedFileSystem should override listStatus(Path f, PathFilter filter)

2015-04-23 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created HDFS-8234: Summary: DistributedFileSystem should override listStatus(Path f, PathFilter filter) Key: HDFS-8234 URL: https://issues.apache.org/jira/browse/HDFS-8234

[jira] [Updated] (HDFS-8234) DistributedFileSystem should override listStatus(Path f, PathFilter filter)

2015-04-23 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated HDFS-8234: - Labels: newbie (was: ) DistributedFileSystem should override listStatus(Path f,

[jira] [Commented] (HDFS-8236) Merge HDFS-8227 into EC branch

2015-04-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510030#comment-14510030 ] Tsz Wo Nicholas Sze commented on HDFS-8236: --- In the EC branch,

[jira] [Updated] (HDFS-8228) TestDFSStripedInputStream#testFileSmallerThanOneStripe2 failed

2015-04-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8228: Summary: TestDFSStripedInputStream#testFileSmallerThanOneStripe2 failed (was:

[jira] [Commented] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

2015-04-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510048#comment-14510048 ] Andrew Wang commented on HDFS-8191: --- I kicked the precommit, dunno why it didn't run.

[jira] [Updated] (HDFS-8209) Support different number of datanode directories in MiniDFSCluster.

2015-04-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8209: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) Summary:

[jira] [Commented] (HDFS-8052) Move WebHdfsFileSystem into hadoop-hdfs-client

2015-04-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510159#comment-14510159 ] Hudson commented on HDFS-8052: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7657 (See

[jira] [Updated] (HDFS-8052) Move WebHdfsFileSystem into hadoop-hdfs-client

2015-04-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8052: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) I've

[jira] [Created] (HDFS-8237) Move all protocol classes used by ClientProtocol to hdfs-client

2015-04-23 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8237: Summary: Move all protocol classes used by ClientProtocol to hdfs-client Key: HDFS-8237 URL: https://issues.apache.org/jira/browse/HDFS-8237 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8237) Move all protocol classes used by ClientProtocol to hdfs-client

2015-04-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8237: - Attachment: HDFS-8237.000.patch Move all protocol classes used by ClientProtocol to hdfs-client

[jira] [Updated] (HDFS-8237) Move all protocol classes used by ClientProtocol to hdfs-client

2015-04-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8237: - Status: Patch Available (was: Open) Move all protocol classes used by ClientProtocol to hdfs-client

[jira] [Commented] (HDFS-8228) TestDFSStripedInputStream#testFileSmallerThanOneStripe2 failed

2015-04-23 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510184#comment-14510184 ] Kai Zheng commented on HDFS-8228: - I reassigned to Jing. Thanks Jing for the taking.

[jira] [Commented] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-23 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510191#comment-14510191 ] Kai Zheng commented on HDFS-8033: - Good work here. Looks like the Jenkins building works

[jira] [Commented] (HDFS-7995) Implement chmod in the HDFS Web UI

2015-04-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510206#comment-14510206 ] Haohui Mai commented on HDFS-7995: -- Sorry for the delay. It looks to me that it is

[jira] [Commented] (HDFS-8217) During block recovery for truncate Log new Block Id in case of copy-on-truncate is true.

2015-04-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510219#comment-14510219 ] Konstantin Shvachko commented on HDFS-8217: --- I think it is fine to ignore

[jira] [Commented] (HDFS-8213) DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510323#comment-14510323 ] Hadoop QA commented on HDFS-8213: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8228) TestDFSStripedInputStream#testFileSmallerThanOneStripe2 failed

2015-04-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510063#comment-14510063 ] Jing Zhao commented on HDFS-8228: - bq. It did not fail in my machine. My bad. I thought

[jira] [Updated] (HDFS-8052) Move WebHdfsFileSystem into hadoop-hdfs-client

2015-04-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8052: -- Hadoop Flags: Reviewed +1 patch looks good. Move WebHdfsFileSystem into

[jira] [Updated] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-23 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8033: Status: Open (was: Patch Available) Erasure coding: stateful (non-positional) read from files in striped

[jira] [Created] (HDFS-8238) Move ClientProtocol to the hdfs-client

2015-04-23 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8238: Summary: Move ClientProtocol to the hdfs-client Key: HDFS-8238 URL: https://issues.apache.org/jira/browse/HDFS-8238 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-8019) Erasure Coding: erasure coding chunk buffer allocation and management

2015-04-23 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8019: Description: As a task of HDFS-7344, this is to come up a chunk buffer pool allocating and managing coding

[jira] [Commented] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510210#comment-14510210 ] Hadoop QA commented on HDFS-6763: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508544#comment-14508544 ] Brahma Reddy Battula commented on HDFS-8213: Thanks [~billie.rinaldi] for

[jira] [Updated] (HDFS-8223) Should calculate checksum for parity blocks in DFSStripedOutputStream

2015-04-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8223: - Attachment: HDFS-8223.001.patch Upload the patch. The idea is to calculate the checksums for a parity cell once,

[jira] [Commented] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508511#comment-14508511 ] Hadoop QA commented on HDFS-8033: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8217) During block recovery for truncate Log new Block Id in case of copy-on-truncate is true.

2015-04-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508512#comment-14508512 ] Vinayakumar B commented on HDFS-8217: - Thanks [~zero45] for taking a look at the patch.

[jira] [Commented] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-23 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508580#comment-14508580 ] Walter Su commented on HDFS-8033: - ... ByteBufferStrategy.doRead() ignores len argument. It

[jira] [Updated] (HDFS-8201) Add an end to end test for stripping file writing and reading

2015-04-23 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin updated HDFS-8201: -- Attachment: HDFS-8201.001.patch Add an end to end test for stripping file writing and reading

[jira] [Commented] (HDFS-8231) StackTrace displayed at client while QuotaByStorageType exceeds

2015-04-23 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508993#comment-14508993 ] J.Andreina commented on HDFS-8231: -- Observation: == Following exception is thrown

[jira] [Created] (HDFS-8231) StackTrace displayed at client while QuotaByStorageType exceeds

2015-04-23 Thread J.Andreina (JIRA)
J.Andreina created HDFS-8231: Summary: StackTrace displayed at client while QuotaByStorageType exceeds Key: HDFS-8231 URL: https://issues.apache.org/jira/browse/HDFS-8231 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8202) Improve end to end stirpping file test to add erasure recovering test

2015-04-23 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin updated HDFS-8202: -- Description: This to follow on HDFS-8201 to add erasure recovering test in the end to end stripping

[jira] [Commented] (HDFS-8200) Refactor FSDirStatAndListingOp

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508610#comment-14508610 ] Hadoop QA commented on HDFS-8200: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-4448) HA NN does not start with wildcard address configured for other NN when security is enabled

2015-04-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508674#comment-14508674 ] Arun Suresh commented on HDFS-4448: --- No tests were included since as [~atm] had

[jira] [Updated] (HDFS-4448) Allow HA NN to start in secure mode with wildcard address configured

2015-04-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-4448: -- Summary: Allow HA NN to start in secure mode with wildcard address configured (was: Allow HA NN to

[jira] [Created] (HDFS-8230) Erasure Coding: Ignore DatanodeProtocol#DNA_ERASURE_CODING_RECOVERY commands from standbynode if any

2015-04-23 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-8230: - Summary: Erasure Coding: Ignore DatanodeProtocol#DNA_ERASURE_CODING_RECOVERY commands from standbynode if any Key: HDFS-8230 URL:

[jira] [Work started] (HDFS-8203) Erasure Coding: Seek and other Ops in DFSStripedInputStream.

2015-04-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8203 started by Yi Liu. Erasure Coding: Seek and other Ops in DFSStripedInputStream.

[jira] [Created] (HDFS-8229) LAZY_PERSIST be deleted after restart hdfs

2015-04-23 Thread surendra singh lilhore (JIRA)
surendra singh lilhore created HDFS-8229: Summary: LAZY_PERSIST be deleted after restart hdfs Key: HDFS-8229 URL: https://issues.apache.org/jira/browse/HDFS-8229 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8227) BlockCollection should return Block instead of BlockInfoContiguous in the interfaces

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508695#comment-14508695 ] Hadoop QA commented on HDFS-8227: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-4448) Allow HA NN to start in secure mode with wildcard address configured

2015-04-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508715#comment-14508715 ] Hudson commented on HDFS-4448: -- FAILURE: Integrated in Hadoop-trunk-Commit #7645 (See

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2015-04-23 Thread jack liuquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508740#comment-14508740 ] jack liuquan commented on HDFS-7337: Hi Kai, As I know, Hitchhiker code can be

[jira] [Created] (HDFS-8228) testFileSmallerThanOneStripe2 failed

2015-04-23 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-8228: --- Summary: testFileSmallerThanOneStripe2 failed Key: HDFS-8228 URL: https://issues.apache.org/jira/browse/HDFS-8228 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-8136) Client gets and uses EC schema when reads and writes a stripping file

2015-04-23 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng resolved HDFS-8136. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Client gets and uses EC

[jira] [Updated] (HDFS-8229) LAZY_PERSIST file gets deleted after restart hdfs

2015-04-23 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8229: - Summary: LAZY_PERSIST file gets deleted after restart hdfs (was: LAZY_PERSIST be

[jira] [Updated] (HDFS-4448) Allow HA NN to start in secure mode with wildcard address configured

2015-04-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-4448: -- Resolution: Fixed Status: Resolved (was: Patch Available) Allow HA NN to start in secure mode

[jira] [Commented] (HDFS-4448) Allow HA NN to start in secure mode with wildcard address configured

2015-04-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508684#comment-14508684 ] Arun Suresh commented on HDFS-4448: --- +1 Committed to trunk and branch-2. Thanks [~atm]

[jira] [Updated] (HDFS-8228) TestDFSStripedInputStream#testFileSmallerThanOneStripe2 failed

2015-04-23 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8228: Summary: TestDFSStripedInputStream#testFileSmallerThanOneStripe2 failed (was: testFileSmallerThanOneStripe2

[jira] [Commented] (HDFS-8136) Client gets and uses EC schema when reads and writes a stripping file

2015-04-23 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508647#comment-14508647 ] Kai Zheng commented on HDFS-8136: - The latest patch looks great! Thanks [~kaisasak]. I will

[jira] [Updated] (HDFS-4448) Allow HA NN to start with wildcard address configured.

2015-04-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-4448: -- Summary: Allow HA NN to start with wildcard address configured. (was: HA NN does not start with

[jira] [Updated] (HDFS-4448) Allow HA NN to start with wildcard address configured

2015-04-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-4448: -- Summary: Allow HA NN to start with wildcard address configured (was: Allow HA NN to start with wildcard

[jira] [Updated] (HDFS-8215) Refactor NamenodeFsck#check method

2015-04-23 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-8215: --- Description: This method is very long, approximately 230 lines. Splitting this method into

  1   2   >