[jira] [Commented] (HDFS-9734) Refactoring of checksum failure report related codes

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127850#comment-15127850 ] Hadoop QA commented on HDFS-9734: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127851#comment-15127851 ] Tsz Wo Nicholas Sze commented on HDFS-9730: --- [~kihwal], could you see if the patc

[jira] [Updated] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9730: -- Status: Patch Available (was: Open) > Storage ID update does not happen when there is a

[jira] [Updated] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9730: -- Attachment: h9730_20160202.patch h9730_20160202.patch: createStorageID before set layoutV

[jira] [Updated] (HDFS-9244) Support nested encryption zones

2016-02-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9244: Attachment: HDFS-9244.04.patch Thanks [~andrew.wang]! Very helpful reviews. Attaching new patch to address th

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127845#comment-15127845 ] Tsz Wo Nicholas Sze commented on HDFS-9730: --- [~vinayrpet], thanks for hints. I u

[jira] [Commented] (HDFS-9718) HAUtil#getConfForOtherNodes should unset independent generic keys before initialize

2016-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127831#comment-15127831 ] Hudson commented on HDFS-9718: -- FAILURE: Integrated in Hadoop-trunk-Commit #9223 (See [https:

[jira] [Updated] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-02-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8905: Attachment: HDFS-8905-v8.patch Rebased and re-sorted the patch out avoiding not-so-relevant changes to be sa

[jira] [Updated] (HDFS-9718) HAUtil#getConfForOtherNodes should unset independent generic keys before initialize

2016-02-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9718: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-9718) HAUtil#getConfForOtherNodes should unset independent generic keys before initialize

2016-02-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9718: Summary: HAUtil#getConfForOtherNodes should unset independent generic keys before initialize (was: H

[jira] [Commented] (HDFS-9718) HAUtil#getConfForOtherNodes don't unset the independent property while it is not assign on others nnId

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127803#comment-15127803 ] Hadoop QA commented on HDFS-9718: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9395) getContentSummary is audit logged as success even if failed

2016-02-01 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9395: -- Attachment: HDFS-9395.001.patch Thank you [~cmccabe] for your comments. I am uploading a preliminary patc

[jira] [Commented] (HDFS-9724) WebHDFS listing is too slow after HDFS-6565

2016-02-01 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127744#comment-15127744 ] Akira AJISAKA commented on HDFS-9724: - [~wheat9], could you review the patch? > WebHDF

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127725#comment-15127725 ] Konstantin Shvachko commented on HDFS-9503: --- Hey Vinayakumar. The patch will inde

[jira] [Commented] (HDFS-9724) WebHDFS listing is too slow after HDFS-6565

2016-02-01 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127721#comment-15127721 ] Akira AJISAKA commented on HDFS-9724: - Thanks [~alexxz] for reporting this issue and ve

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-02-01 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127710#comment-15127710 ] Akira AJISAKA commented on HDFS-9629: - +1 for adding another step to https://wiki.apach

[jira] [Commented] (HDFS-9718) HAUtil#getConfForOtherNodes don't unset the independent property while it is not assign on others nnId

2016-02-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127686#comment-15127686 ] Vinayakumar B commented on HDFS-9718: - branch-2 patch also looks good. +1, pending jenk

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127677#comment-15127677 ] Vinayakumar B commented on HDFS-9503: - This is incompatible change, not because of rep

[jira] [Commented] (HDFS-9659) EditLogTailerThread to Active Namenode RPC should timeout

2016-02-01 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127667#comment-15127667 ] Surendra Singh Lilhore commented on HDFS-9659: -- Thanks [~vinayrpet] for review

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127650#comment-15127650 ] Hadoop QA commented on HDFS-9503: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2016-02-01 Thread Liu Junhong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127616#comment-15127616 ] Liu Junhong commented on HDFS-2139: --- How the fastcopy work with 2 different NNs (assume

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127613#comment-15127613 ] Vinayakumar B commented on HDFS-9730: - Thanks [~kihwal] for reporting this. Yes, indeed

[jira] [Updated] (HDFS-9734) Refactoring of checksum failure report related codes

2016-02-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9734: Attachment: HDFS-9734-v4.patch The Jenkins building looks messy as not clean as the one before. Changed minor

[jira] [Updated] (HDFS-9718) HAUtil#getConfForOtherNodes don't unset the independent property while it is not assign on others nnId

2016-02-01 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DENG FEI updated HDFS-9718: --- Attachment: HDFS-9718.branch-2.001.patch for branch-2 > HAUtil#getConfForOtherNodes don't unset the independen

[jira] [Commented] (HDFS-9244) Support nested encryption zones

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127599#comment-15127599 ] Hadoop QA commented on HDFS-9244: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2016-02-01 Thread Liu Junhong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127592#comment-15127592 ] Liu Junhong commented on HDFS-2139: --- I think it's useful when copy files between two name

[jira] [Commented] (HDFS-9698) Long running Balancer should renew TGT

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127545#comment-15127545 ] Junping Du commented on HDFS-9698: -- Move non-critical issue out of 2.6.4 to 2.6.5. > Long

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127547#comment-15127547 ] Junping Du commented on HDFS-9688: -- Move non-critical issue out of 2.6.4 to 2.6.5. > Test

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2016-02-01 Thread Liu Junhong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127584#comment-15127584 ] Liu Junhong commented on HDFS-2139: --- We will begin to use federation and need to copy fil

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127576#comment-15127576 ] Hadoop QA commented on HDFS-9263: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9415) Document dfs.cluster.administrators and dfs.permissions.superusergroup

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9415: - Target Version/s: 2.6.4 > Document dfs.cluster.administrators and dfs.permissions.superusergroup >

[jira] [Updated] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8791: - Target Version/s: 2.8.0, 2.7.3, 2.6.5 (was: 2.8.0, 2.7.3, 2.6.4) > block ID-based DN storage layout can be

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127566#comment-15127566 ] Junping Du commented on HDFS-8791: -- Move this out of 2.6.4 to 2.6.5 as haven't updated for

[jira] [Commented] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127560#comment-15127560 ] Junping Du commented on HDFS-8995: -- Move it out of 2.6.4 to 2.6.5 as haven't updated for a

[jira] [Commented] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration and write failures

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127552#comment-15127552 ] Junping Du commented on HDFS-8676: -- Move it out of 2.6.4 to 2.6.5 as this jira haven't upd

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2016-02-01 Thread M. C. Srivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127543#comment-15127543 ] M. C. Srivas commented on HDFS-2139: Just a curiosity ... why was this method chosen? W

[jira] [Updated] (HDFS-9106) Transfer failure during pipeline recovery causes permanent write failures

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9106: - Target Version/s: 2.8.0, 2.6.5 (was: 2.8.0, 2.6.4) > Transfer failure during pipeline recovery causes perm

[jira] [Updated] (HDFS-9698) Long running Balancer should renew TGT

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9698: - Target Version/s: 2.6.5 (was: 2.6.4) > Long running Balancer should renew TGT > --

[jira] [Updated] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9263: - Target Version/s: 3.0.0, 2.7.3, 2.6.5 (was: 3.0.0, 2.7.3, 2.6.4) > tests are using /test/build/data; break

[jira] [Updated] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration and write failures

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8676: - Target Version/s: 2.7.2, 2.6.5 (was: 2.7.2, 2.6.4) > Delayed rolling upgrade finalization can cause heartb

[jira] [Commented] (HDFS-9106) Transfer failure during pipeline recovery causes permanent write failures

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127557#comment-15127557 ] Junping Du commented on HDFS-9106: -- Move it out of 2.6.4 to 2.6.5 as this JIRA haven't bei

[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9688: - Target Version/s: 2.8.0, 2.7.3, 2.6.5 (was: 2.8.0, 2.7.3, 2.6.4) > Test the effect of nested encryption zo

[jira] [Commented] (HDFS-9727) Improve the exception's log output in DataXceiver

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127501#comment-15127501 ] Mingliang Liu commented on HDFS-9727: - Specifically, {{hadoop.hdfs.TestRecoverStripedFi

[jira] [Commented] (HDFS-9721) Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127502#comment-15127502 ] Hadoop QA commented on HDFS-9721: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127498#comment-15127498 ] Mingliang Liu commented on HDFS-9716: - Sample *Error Message* is like: {code} expected:

[jira] [Commented] (HDFS-9715) Check storage ID uniqueness on datanode startup

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127484#comment-15127484 ] Hadoop QA commented on HDFS-9715: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127435#comment-15127435 ] Hadoop QA commented on HDFS-9260: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9658) Erasure Coding: allow to use multiple EC policies in striping related tests

2016-02-01 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127428#comment-15127428 ] Rui Li commented on HDFS-9658: -- Hi [~zhz], thanks for the review! I kept {{dnIndexSuite}} so t

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2016-02-01 Thread cuixin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127423#comment-15127423 ] cuixin commented on HDFS-2139: -- Thanks your code diff. Do we have a plan to release this patch

[jira] [Commented] (HDFS-9244) Support nested encryption zones

2016-02-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127413#comment-15127413 ] Andrew Wang commented on HDFS-9244: --- Thanks for working on this Zhe, some code review com

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Attachment: HDFS-9053.005.patch Nice catch, [~shv]. The v5 patch is to address your latest two commen

[jira] [Commented] (HDFS-9727) Improve the exception's log output in DataXceiver

2016-02-01 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127405#comment-15127405 ] Lin Yiqun commented on HDFS-9727: - The failed test looks not related, thanks reviewing! >

[jira] [Updated] (HDFS-9244) Support nested encryption zones

2016-02-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9244: Attachment: HDFS-9244.03.patch Updating the patch per comments from Xiaoyu and Andrew under HDFS-9688. I thi

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127378#comment-15127378 ] Mingliang Liu commented on HDFS-9503: - s/desirable/not desirable/ Sorry about this. >

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127376#comment-15127376 ] Konstantin Shvachko commented on HDFS-9503: --- Sorry, it was my fault, I used some

[jira] [Commented] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127322#comment-15127322 ] Hadoop QA commented on HDFS-9406: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9734) Refactoring of checksum failure report related codes

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127310#comment-15127310 ] Hadoop QA commented on HDFS-9734: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9715) Check storage ID uniqueness on datanode startup

2016-02-01 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9715: Attachment: HDFS-9715.02.patch Thanks for the reviews, [~andrew.wang] Updated the patch to address y

[jira] [Commented] (HDFS-9715) Check storage ID uniqueness on datanode startup

2016-02-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127293#comment-15127293 ] Andrew Wang commented on HDFS-9715: --- Smallest nit ever, the javadoc for the activateVolum

[jira] [Updated] (HDFS-9715) Check storage ID uniqueness on datanode startup

2016-02-01 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9715: Attachment: HDFS-9715.01.patch Hey, [~vinayrpet] Thanks a lot for the review. I updated to patch to

[jira] [Updated] (HDFS-9736) Fix typo in defaultFS warning message

2016-02-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9736: -- Priority: Trivial (was: Major) > Fix typo in defaultFS warning message > ---

[jira] [Created] (HDFS-9736) Fix typo in defaultFS warning message

2016-02-01 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-9736: - Summary: Fix typo in defaultFS warning message Key: HDFS-9736 URL: https://issues.apache.org/jira/browse/HDFS-9736 Project: Hadoop HDFS Issue Type: Bug Affects

[jira] [Commented] (HDFS-9733) Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127273#comment-15127273 ] Hadoop QA commented on HDFS-9733: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9406: Fix Version/s: 2.8.0 > FSImage may get corrupted after deleting snapshot > --

[jira] [Resolved] (HDFS-9696) Garbage snapshot records lingering forever

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-9696. - Resolution: Duplicate Hi [~kihwal], Thanks a lot for reporting the issue here. Upon investigation,

[jira] [Commented] (HDFS-9697) NN fails to restart due to corrupt fsimage caused by snapshot handling

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127263#comment-15127263 ] Yongjun Zhang commented on HDFS-9697: - Resolved as duplicate of HDFS-9406. Thanks. >

[jira] [Resolved] (HDFS-9697) NN fails to restart due to corrupt fsimage caused by snapshot handling

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-9697. - Resolution: Duplicate > NN fails to restart due to corrupt fsimage caused by snapshot handling > --

[jira] [Updated] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9406: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved

[jira] [Commented] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127249#comment-15127249 ] Yongjun Zhang commented on HDFS-9406: - Thanks Jing! Yes, I planned to do so after commi

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127243#comment-15127243 ] Andrew Wang commented on HDFS-9688: --- IIUC for trash support, we need to be able to rename

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2016-02-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127238#comment-15127238 ] Colin Patrick McCabe commented on HDFS-9260: Thanks, [~sfriberg]. The unit tes

[jira] [Updated] (HDFS-9735) DiskBalancer : Refactor moveBlockAcrossStorage to be used by disk balancer

2016-02-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9735: --- Attachment: HDFS-9735-HDFS-1312.001.patch This patch depends on HDFS-9720. Uploading for early code rev

[jira] [Created] (HDFS-9735) DiskBalancer : Refactor moveBlockAcrossStorage to be used by disk balancer

2016-02-01 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9735: -- Summary: DiskBalancer : Refactor moveBlockAcrossStorage to be used by disk balancer Key: HDFS-9735 URL: https://issues.apache.org/jira/browse/HDFS-9735 Project: Hadoop HD

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127235#comment-15127235 ] Tsz Wo Nicholas Sze commented on HDFS-9730: --- Hi [~kihwal], thanks for reporting t

[jira] [Commented] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127232#comment-15127232 ] Jing Zhao commented on HDFS-9406: - Thanks a lot Yongjun! The 2.7 patch looks good to me. +1

[jira] [Commented] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127226#comment-15127226 ] Hudson commented on HDFS-9406: -- FAILURE: Integrated in Hadoop-trunk-Commit #9218 (See [https:

[jira] [Assigned] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reassigned HDFS-9730: - Assignee: Tsz Wo Nicholas Sze > Storage ID update does not happen when there is a

[jira] [Commented] (HDFS-9731) Erasure Coding: Rename BlockECRecoveryCommand to BlockECReconstructionCommand

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127211#comment-15127211 ] Hadoop QA commented on HDFS-9731: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127197#comment-15127197 ] Yongjun Zhang commented on HDFS-9406: - Hi [~jingzhao], I committed to trunk, branch-2,

[jira] [Updated] (HDFS-9734) Refactoring of checksum failure report related codes

2016-02-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9734: Attachment: HDFS-9734-v3.patch Renamed the patch to reflect the issue ID change. > Refactoring of checksum f

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127193#comment-15127193 ] Kihwal Lee commented on HDFS-9730: -- bq. I am not quite sure I understand why the current u

[jira] [Commented] (HDFS-9734) Refactoring of checksum failure report related codes

2016-02-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127192#comment-15127192 ] Kai Zheng commented on HDFS-9734: - Thanks [~jingzhao] for the help with the converting! Wil

[jira] [Updated] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9406: Attachment: HDFS-9406.branch-2.7.patch > FSImage may get corrupted after deleting snapshot >

[jira] [Commented] (HDFS-9719) Refactoring ErasureCodingWorker into smaller reusable constructs

2016-02-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127187#comment-15127187 ] Kai Zheng commented on HDFS-9719: - When HADOOP-12744 is resolved and this is rebased, the p

[jira] [Moved] (HDFS-9734) Refactoring of checksum failure report related codes

2016-02-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao moved HADOOP-12744 to HDFS-9734: -- Key: HDFS-9734 (was: HADOOP-12744) Project: Hadoop HDFS (was: Hadoop Co

[jira] [Updated] (HDFS-9072) Fix random failures in TestJMXGet

2016-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9072: - Attachment: HDFS-9072-br27.patch The two test cases are also failing in branch-2.7. The trunk patch applies

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-02-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127149#comment-15127149 ] Zhe Zhang commented on HDFS-7866: - Thanks Rui for the work. I think HDFS-9658 is almost rea

[jira] [Updated] (HDFS-9733) Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum

2016-02-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9733: Status: Patch Available (was: Open) > Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum > ---

[jira] [Updated] (HDFS-9733) Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum

2016-02-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9733: Attachment: HDFS-9733-v1.patch Uploaded the patch to do the refactoring. > Refactor DFSClient#getFileChecksu

[jira] [Commented] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

2016-02-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127141#comment-15127141 ] Kai Zheng commented on HDFS-9694: - As the patch is too large, opened HDFS-9733 to do the re

[jira] [Created] (HDFS-9733) Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum

2016-02-01 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-9733: --- Summary: Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum Key: HDFS-9733 URL: https://issues.apache.org/jira/browse/HDFS-9733 Project: Hadoop HDFS Iss

[jira] [Commented] (HDFS-9721) Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference

2016-02-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127121#comment-15127121 ] Xiao Chen commented on HDFS-9721: - Hm, BTW, should we mark this as incompatible change, due

[jira] [Commented] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-02-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127117#comment-15127117 ] Xiao Chen commented on HDFS-9701: - Thanks for the review and commit Eddy, and thanks Vinay

[jira] [Commented] (HDFS-8829) Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning

2016-02-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127097#comment-15127097 ] Colin Patrick McCabe commented on HDFS-8829: bq. There is one corner cases: Old

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-01 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127089#comment-15127089 ] Chris Trezzo commented on HDFS-9730: (As well as 2.7.3) > Storage ID update does not h

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-01 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127085#comment-15127085 ] Chris Trezzo commented on HDFS-9730: Thanks [~kihwal] for the catch. I am not quite sur

[jira] [Updated] (HDFS-9721) Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference

2016-02-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9721: Attachment: HDFS-9721.05.patch Thanks for the review Eddy! Patch 5 addresses all comments above. {{MetadataMa

[jira] [Commented] (HDFS-9637) Add test for HADOOP-12702

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127079#comment-15127079 ] Hadoop QA commented on HDFS-9637: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127069#comment-15127069 ] Hudson commented on HDFS-9701: -- FAILURE: Integrated in Hadoop-trunk-Commit #9217 (See [https:

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

2016-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127070#comment-15127070 ] Hudson commented on HDFS-9494: -- FAILURE: Integrated in Hadoop-trunk-Commit #9217 (See [https:

  1   2   >