[jira] [Commented] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

2015-06-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573714#comment-14573714 ] Arpit Agarwal commented on HDFS-8522: - +1 to Andrew's comment. Also does stateChangeLog

[jira] [Commented] (HDFS-7240) Object store in HDFS

2015-06-04 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573748#comment-14573748 ] Lars Francke commented on HDFS-7240: Would anyone mind - for documentation and those of

[jira] [Updated] (HDFS-8541) Mover should exit with NO_MOVE_PROGRESS if there is no move progress

2015-06-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8541: -- Component/s: balancer mover Mover should exit with NO_MOVE_PROGRESS if there is no

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs

2015-06-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573947#comment-14573947 ] Colin Patrick McCabe commented on HDFS-8480: Maybe I can take a look in a

[jira] [Commented] (HDFS-8538) Change the default volume choosing policy to AvailableSpaceVolumeChoosingPolicy

2015-06-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573975#comment-14573975 ] Tsz Wo Nicholas Sze commented on HDFS-8538: --- ... they almost always want the

[jira] [Commented] (HDFS-8541) Mover should exit with NO_MOVE_PROGRESS if there is no move progress

2015-06-04 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573877#comment-14573877 ] surendra singh lilhore commented on HDFS-8541: -- Thanks [~szetszwo] for

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs

2015-06-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573881#comment-14573881 ] Andrew Wang commented on HDFS-8480: --- If we don't get this in, we should probably revert

[jira] [Commented] (HDFS-8541) Mover should exit with NO_MOVE_PROGRESS if there is no move progress

2015-06-04 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573882#comment-14573882 ] surendra singh lilhore commented on HDFS-8541: -- I will attach the patch*

[jira] [Commented] (HDFS-5931) Potential bugs and improvements for exception handlers

2015-06-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573883#comment-14573883 ] Tsz Wo Nicholas Sze commented on HDFS-5931: --- Please add tests for the FSEditLog

[jira] [Assigned] (HDFS-8540) Mover should exit with NO_MOVE_BLOCK if no block can be moved

2015-06-04 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore reassigned HDFS-8540: Assignee: surendra singh lilhore Mover should exit with NO_MOVE_BLOCK if

[jira] [Created] (HDFS-8542) WebHDFS getHomeDirectory behavior does not match specification

2015-06-04 Thread Jakob Homan (JIRA)
Jakob Homan created HDFS-8542: - Summary: WebHDFS getHomeDirectory behavior does not match specification Key: HDFS-8542 URL: https://issues.apache.org/jira/browse/HDFS-8542 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8505) Truncate should not be success when Truncate Size and Current Size are equal.

2015-06-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573955#comment-14573955 ] Tsz Wo Nicholas Sze commented on HDFS-8505: --- ... Cannot truncate to a larger

[jira] [Commented] (HDFS-8535) Clarify that dfs usage in dfsadmin -report output includes all block replicas.

2015-06-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573861#comment-14573861 ] Hadoop QA commented on HDFS-8535: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Resolved] (HDFS-8528) Erasure Coding: optimize client writing by making the writing of data and parity concurrently

2015-06-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8528. --- Resolution: Duplicate This duplicates HDFS-8287. Let's resolve it. Erasure Coding:

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-06-04 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573971#comment-14573971 ] Li Bo commented on HDFS-8287: - hi, Nicholas, have you started this sub task?

[jira] [Assigned] (HDFS-8541) Mover should exit with NO_MOVE_PROGRESS if there is no move progress

2015-06-04 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore reassigned HDFS-8541: Assignee: surendra singh lilhore Mover should exit with NO_MOVE_PROGRESS

[jira] [Resolved] (HDFS-8319) Erasure Coding: support decoding for stateful read

2015-06-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8319. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I just committed the patch.

[jira] [Commented] (HDFS-5189) Rename the CorruptBlocks metric to CorruptReplicas

2015-06-04 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573943#comment-14573943 ] J.Andreina commented on HDFS-5189: -- Checkstyle error is due to file length exceeding 2000

[jira] [Commented] (HDFS-8538) Change the default volume choosing policy to AvailableSpaceVolumeChoosingPolicy

2015-06-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573867#comment-14573867 ] Andrew Wang commented on HDFS-8538: --- Hey Arpit, thanks for taking a look. In the case of

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

2015-06-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573902#comment-14573902 ] Zhe Zhang commented on HDFS-8319: - I see, basically with the current algorithm, the {{if

[jira] [Commented] (HDFS-8399) Erasure Coding: BlockManager is unnecessarily computing recovery work for the deleted blocks

2015-06-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573979#comment-14573979 ] Rakesh R commented on HDFS-8399: As per the previous discussion, I have labelled this as

[jira] [Commented] (HDFS-8535) Clarify that dfs usage in dfsadmin -report output includes all block replicas.

2015-06-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573704#comment-14573704 ] Andrew Wang commented on HDFS-8535: --- +1 LGTM thanks Ed, I'll commit this shortly.

[jira] [Commented] (HDFS-8535) Clarify that dfs usage in dfsadmin -report output includes all block replicas.

2015-06-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573726#comment-14573726 ] Hudson commented on HDFS-8535: -- FAILURE: Integrated in Hadoop-trunk-Commit #7972 (See

[jira] [Updated] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8522: - Attachment: HDFS-8522.01.patch Thanks [~andrew.wang] and [~arpitagarwal] for the review. I've updated the

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs

2015-06-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573818#comment-14573818 ] Vinod Kumar Vavilapalli commented on HDFS-8480: --- [~zhz]/[~andrew.wang], The

[jira] [Updated] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8522: - Status: Patch Available (was: Open) Change heavily recorded NN logs from INFO level to DEBUG level

[jira] [Commented] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

2015-06-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573720#comment-14573720 ] Andrew Wang commented on HDFS-8522: --- It's using {{LoggerFactory.getLogger}} which is from

[jira] [Created] (HDFS-8540) Mover should exit with NO_MOVE_BLOCK if no block can be moved

2015-06-04 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8540: - Summary: Mover should exit with NO_MOVE_BLOCK if no block can be moved Key: HDFS-8540 URL: https://issues.apache.org/jira/browse/HDFS-8540 Project: Hadoop

[jira] [Assigned] (HDFS-8537) Fix hdfs debug command document in HDFSCommands.md

2015-06-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-8537: -- Assignee: Anu Engineer (was: Xiaoyu Yao) Fix hdfs debug command document in HDFSCommands.md

[jira] [Commented] (HDFS-8538) Change the default volume choosing policy to AvailableSpaceVolumeChoosingPolicy

2015-06-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573775#comment-14573775 ] Arpit Agarwal commented on HDFS-8538: - Hi Andrew, I'd prefer not to change the default

[jira] [Commented] (HDFS-8143) HDFS Mover tool should exit after some retry when failed to move blocks.

2015-06-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573774#comment-14573774 ] Tsz Wo Nicholas Sze commented on HDFS-8143: --- [~surendrasingh], just have created

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

2015-06-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573800#comment-14573800 ] Zhe Zhang commented on HDFS-8319: - The rest of the patch looks good except the 2 nits

[jira] [Commented] (HDFS-7240) Object store in HDFS

2015-06-04 Thread Thomas Demoor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573635#comment-14573635 ] Thomas Demoor commented on HDFS-7240: - Very interesting call yesterday. Might be

[jira] [Created] (HDFS-8538) Change the default volume choosing policy to AvailableSpaceVolumeChoosingPolicy

2015-06-04 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-8538: - Summary: Change the default volume choosing policy to AvailableSpaceVolumeChoosingPolicy Key: HDFS-8538 URL: https://issues.apache.org/jira/browse/HDFS-8538 Project:

[jira] [Commented] (HDFS-8386) Improve synchronization of 'streamer' reference in DFSOutputStream

2015-06-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573846#comment-14573846 ] Tsz Wo Nicholas Sze commented on HDFS-8386: --- In trunk, the streamer

[jira] [Updated] (HDFS-8531) Append failed due to unreleased lease from previous appender with quota exceeded exception

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8531: - Status: Open (was: Patch Available) Append failed due to unreleased lease from previous appender with

[jira] [Commented] (HDFS-8535) Clarify that dfs usage in dfsadmin -report output includes all block replicas.

2015-06-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573684#comment-14573684 ] Hadoop QA commented on HDFS-8535: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

2015-06-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573711#comment-14573711 ] Andrew Wang commented on HDFS-8522: --- Thanks Xiaoyu for doing the cleanup. Overall LGTM,

[jira] [Assigned] (HDFS-8536) HDFS debug command is missed from top level help message

2015-06-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-8536: -- Assignee: Anu Engineer (was: Xiaoyu Yao) HDFS debug command is missed from top level help

[jira] [Work started] (HDFS-8538) Change the default volume choosing policy to AvailableSpaceVolumeChoosingPolicy

2015-06-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8538 started by Andrew Wang. - Change the default volume choosing policy to AvailableSpaceVolumeChoosingPolicy

[jira] [Updated] (HDFS-8538) Change the default volume choosing policy to AvailableSpaceVolumeChoosingPolicy

2015-06-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8538: -- Status: Patch Available (was: In Progress) Change the default volume choosing policy to

[jira] [Updated] (HDFS-8538) Change the default volume choosing policy to AvailableSpaceVolumeChoosingPolicy

2015-06-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8538: -- Attachment: hdfs-8538.001.patch Patch attached, [~atm] would you like to review? I also added the

[jira] [Commented] (HDFS-8498) Blocks can be committed with wrong size

2015-06-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573809#comment-14573809 ] Vinod Kumar Vavilapalli commented on HDFS-8498: --- [~daryn], is this a

[jira] [Resolved] (HDFS-8531) Append failed due to unreleased lease from previous appender with quota exceeded exception

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDFS-8531. -- Resolution: Not A Problem Append failed due to unreleased lease from previous appender with quota

[jira] [Created] (HDFS-8541) Mover should exit with NO_MOVE_PROGRESS if there is no move progress

2015-06-04 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8541: - Summary: Mover should exit with NO_MOVE_PROGRESS if there is no move progress Key: HDFS-8541 URL: https://issues.apache.org/jira/browse/HDFS-8541 Project:

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

2015-06-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573821#comment-14573821 ] Jing Zhao commented on HDFS-8319: - Thanks a lot for the review, Zhe! bq. Is it possible

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

2015-06-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573843#comment-14573843 ] Jing Zhao commented on HDFS-8319: - but we only read one more parity block each time we hit

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

2015-06-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573626#comment-14573626 ] Zhe Zhang commented on HDFS-8319: - bq. Yeah, actually stateful read shares the same logic.

[jira] [Updated] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8522: - Attachment: HDFS-8522.00.patch Attach a patch that change the listCorruptFileBlocks log to DEBUG level and

[jira] [Updated] (HDFS-8535) Clarify that dfs usage in dfsadmin -report output includes all block replicas.

2015-06-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8535: -- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0 (was: 3.0.0, 2.8.0)

[jira] [Updated] (HDFS-8535) Clarify that dfs usage in dfsadmin -report output includes all block replicas.

2015-06-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8535: Attachment: HDFS-8535.001.patch Yeah, [~andrew.wang], users got confused {{du}} and {{report}}. I

[jira] [Commented] (HDFS-8535) Clarify that dfs usage in dfsadmin -report output includes all block replicas.

2015-06-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573701#comment-14573701 ] Lei (Eddy) Xu commented on HDFS-8535: - Hi, Andrew This patch is modifying comments,

[jira] [Updated] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8522: - Description: More specifically, the default namenode log settings have its log flooded with the following

[jira] [Commented] (HDFS-7240) Object store in HDFS

2015-06-04 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573795#comment-14573795 ] Jitendra Nath Pandey commented on HDFS-7240: I will post a summary shortly.

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

2015-06-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573832#comment-14573832 ] Zhe Zhang commented on HDFS-8319: - Thx Jing for clarifying. What about cancelled requests?

[jira] [Updated] (HDFS-8432) Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases.

2015-06-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8432: Attachment: HDFS-8432-branch-2.002.patch [~arpitagarwal], thank you for your review! We'll need a

[jira] [Commented] (HDFS-8531) Append failed due to unreleased lease from previous appender with quota exceeded exception

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573683#comment-14573683 ] Xiaoyu Yao commented on HDFS-8531: -- After compare the pros and cons of the existing lease

[jira] [Assigned] (HDFS-8539) Hdfs doesnt have class 'debug' in windows

2015-06-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-8539: -- Assignee: Anu Engineer Hdfs doesnt have class 'debug' in windows

[jira] [Created] (HDFS-8539) Hdfs doesnt have class 'debug' in windows

2015-06-04 Thread Sumana Sathish (JIRA)
Sumana Sathish created HDFS-8539: Summary: Hdfs doesnt have class 'debug' in windows Key: HDFS-8539 URL: https://issues.apache.org/jira/browse/HDFS-8539 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

2015-06-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573776#comment-14573776 ] Zhe Zhang commented on HDFS-8319: - # Follow-on: {{divideOneStripe}} can be further

[jira] [Updated] (HDFS-8319) Erasure Coding: support decoding for stateful read

2015-06-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8319: Attachment: HDFS-8319.005.patch Update the patch to address Zhe's comments. Erasure Coding: support

[jira] [Commented] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

2015-06-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573847#comment-14573847 ] Andrew Wang commented on HDFS-8522: --- Some of those lines look a bit long, but checkstyle

[jira] [Commented] (HDFS-8463) Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException

2015-06-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573250#comment-14573250 ] Kihwal Lee commented on HDFS-8463: -- I've committed this to trunk and branch-2. Thanks for

[jira] [Updated] (HDFS-8499) Merge BlockInfoUnderConstruction into trunk

2015-06-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8499: Attachment: HDFS-8499.01.patch Updating the patch to move {{addStorage}}, {{removeStorage}}, {{numNodes}},

[jira] [Created] (HDFS-8535) Clarify that dfs usage in dfsadmin -report output includes all block replicas.

2015-06-04 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-8535: --- Summary: Clarify that dfs usage in dfsadmin -report output includes all block replicas. Key: HDFS-8535 URL: https://issues.apache.org/jira/browse/HDFS-8535 Project:

[jira] [Updated] (HDFS-8535) Clarify that dfs usage in dfsadmin -report output includes all block replicas.

2015-06-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8535: Status: Patch Available (was: Open) Clarify that dfs usage in dfsadmin -report output includes all

[jira] [Updated] (HDFS-8535) Clarify that dfs usage in dfsadmin -report output includes all block replicas.

2015-06-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8535: Attachment: HDFS-8535.000.patch The patch add clarification message into {{dfsadmin -report}} help

[jira] [Commented] (HDFS-8535) Clarify that dfs usage in dfsadmin -report output includes all block replicas.

2015-06-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573360#comment-14573360 ] Andrew Wang commented on HDFS-8535: --- Hmm, so it seems like the main clarification we want

[jira] [Commented] (HDFS-8499) Merge BlockInfoUnderConstruction into trunk

2015-06-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573187#comment-14573187 ] Zhe Zhang commented on HDFS-8499: - Many thanks for Yi and Vinay for the reviews! bq. In

[jira] [Commented] (HDFS-8463) Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException

2015-06-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573242#comment-14573242 ] Kihwal Lee commented on HDFS-8463: -- +1 the latest patch looks good. Calling

[jira] [Commented] (HDFS-8463) Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException

2015-06-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573277#comment-14573277 ] Hudson commented on HDFS-8463: -- FAILURE: Integrated in Hadoop-trunk-Commit #7966 (See

[jira] [Commented] (HDFS-8532) Make the visibility of DFSOutputStream#streamer member variable to private

2015-06-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573300#comment-14573300 ] Hudson commented on HDFS-8532: -- FAILURE: Integrated in Hadoop-trunk-Commit #7967 (See

[jira] [Updated] (HDFS-8463) Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException

2015-06-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8463: - Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-8532) Make the visibility of DFSOutputStream#streamer member variable to private

2015-06-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8532: -- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0 Status:

[jira] [Updated] (HDFS-8532) Make the visibility of DFSOutputStream#streamer member variable to private

2015-06-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8532: -- Affects Version/s: 2.8.0 Make the visibility of DFSOutputStream#streamer member variable to private

[jira] [Assigned] (HDFS-8534) kms configuration hadoop.security.keystore.JavaKeyStoreProvider.password need update in apache KMS index WEBUI

2015-06-04 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore reassigned HDFS-8534: Assignee: surendra singh lilhore kms configuration

[jira] [Commented] (HDFS-8531) Append failed due to unreleased lease from previous appender with quota exceeded exception

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573127#comment-14573127 ] Xiaoyu Yao commented on HDFS-8531: -- TestFileAppend#testAppendTwice and

[jira] [Commented] (HDFS-3618) SSH fencing option may incorrectly succeed if nc (netcat) command not present

2015-06-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572962#comment-14572962 ] Hadoop QA commented on HDFS-3618: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Created] (HDFS-8534) kms configuration hadoop.security.keystore.JavaKeyStoreProvider.password need update in apache KMS index WEBUI

2015-06-04 Thread huangyitian (JIRA)
huangyitian created HDFS-8534: - Summary: kms configuration hadoop.security.keystore.JavaKeyStoreProvider.password need update in apache KMS index WEBUI Key: HDFS-8534 URL:

[jira] [Updated] (HDFS-8531) Append failed due to unreleased lease from previous appender with quota exceeded exception

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8531: - Attachment: HDFS-8531.00.patch Attach an initial patch that handles lease recovery upon append failure

[jira] [Commented] (HDFS-8499) Merge BlockInfoUnderConstruction into trunk

2015-06-04 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572262#comment-14572262 ] Vinayakumar B commented on HDFS-8499: - Thanks [~zhz] for the work. I hope this will

[jira] [Commented] (HDFS-8466) Refactor BlockInfoContiguous and fix NPE in TestBlockInfo#testCopyConstructor()

2015-06-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572307#comment-14572307 ] Hadoop QA commented on HDFS-8466: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8531) Append failed due to unreleased lease from previous appender with quota exceeded exception

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8531: - Attachment: (was: HDFS-8531.00.patch) Append failed due to unreleased lease from previous appender

[jira] [Updated] (HDFS-8328) Follow-on to update decode for DataNode striped blocks reconstruction

2015-06-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8328: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Thanks Zhe, Kai

[jira] [Updated] (HDFS-8531) Append failed due to unreleased lease from previous appender with quota exceeded exception

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8531: - Attachment: HDFS-8531.00.patch Append failed due to unreleased lease from previous appender with quota

[jira] [Updated] (HDFS-8531) Append failed due to unreleased lease from previous appender with quota exceeded exception

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8531: - Status: Patch Available (was: Open) Append failed due to unreleased lease from previous appender with

[jira] [Updated] (HDFS-5189) Rename the CorruptBlocks metric to CorruptReplicas

2015-06-04 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-5189: - Attachment: HDFS-5189.1.patch Attached an initial patch. Please review. Rename the CorruptBlocks metric

[jira] [Created] (HDFS-8533) Mismatch in displaying the MissingBlock count in fsck and in other metric reports

2015-06-04 Thread J.Andreina (JIRA)
J.Andreina created HDFS-8533: Summary: Mismatch in displaying the MissingBlock count in fsck and in other metric reports Key: HDFS-8533 URL: https://issues.apache.org/jira/browse/HDFS-8533 Project:

[jira] [Updated] (HDFS-8533) Mismatch in displaying the MissingBlock count in fsck and in other metric reports

2015-06-04 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8533: - Description: Number of DN = 2 Step 1: Write a file with replication factor - 3 . Step 2: Corrupt a replica

[jira] [Updated] (HDFS-8537) Fix hdfs debug command document in HDFSCommands.md

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8537: - Description: From The *dfs* should be *debug* {code} Usage: `hdfs dfs verify [-meta metadata-file]

[jira] [Updated] (HDFS-8537) Fix hdfs debug command document in HDFSCommands.md

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8537: - Description: From HDFSCommands.md, the *dfs* should be *debug* {code} Usage: `hdfs dfs verify [-meta

[jira] [Commented] (HDFS-8537) Fix hdfs debug command document in HDFSCommands.md

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573412#comment-14573412 ] Xiaoyu Yao commented on HDFS-8537: -- The command line hdfs debug shows the correct usage

[jira] [Created] (HDFS-8536) HDFS debug command is missed from top level help message

2015-06-04 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-8536: Summary: HDFS debug command is missed from top level help message Key: HDFS-8536 URL: https://issues.apache.org/jira/browse/HDFS-8536 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-8537) Fix hdfs debug command document in HDFSCommands.md

2015-06-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8537: - Affects Version/s: 2.7.0 Fix hdfs debug command document in HDFSCommands.md

[jira] [Created] (HDFS-8537) Fix hdfs debug command document in HDFSCommands.md

2015-06-04 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-8537: Summary: Fix hdfs debug command document in HDFSCommands.md Key: HDFS-8537 URL: https://issues.apache.org/jira/browse/HDFS-8537 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-8341) (Summary Description may be invalid) HDFS mover stuck in loop after failing to move block, doesn't move rest of blocks, can't get data back off decommissioning external

2015-06-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8341: -- Priority: Minor (was: Blocker) Summary: (Summary Description may be invalid) HDFS

[jira] [Updated] (HDFS-8388) Time and Date format need to be in sync in Namenode UI page

2015-06-04 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8388: - Status: Patch Available (was: Open) Time and Date format need to be in sync in

[jira] [Updated] (HDFS-7398) Reset cached thread-local FSEditLogOp's on every FSEditLog#logEdit

2015-06-04 Thread Hui Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Zheng updated HDFS-7398: Fix Version/s: (was: 2.7.0) Reset cached thread-local FSEditLogOp's on every FSEditLog#logEdit

[jira] [Commented] (HDFS-8463) Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException

2015-06-04 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572375#comment-14572375 ] Masatake Iwasaki commented on HDFS-8463: TestBackupNode and TestFsck succeeded on

[jira] [Commented] (HDFS-8457) Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

2015-06-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572343#comment-14572343 ] Hadoop QA commented on HDFS-8457: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

  1   2   >