[jira] [Resolved] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

2015-06-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-7621. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed +1 on the latest patch.

[jira] [Updated] (HDFS-8432) Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases.

2015-06-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8432: Attachment: HDFS-8432.002.patch [~arpitagarwal] pointed out to me that I had set some wrong values

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

2015-06-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571877#comment-14571877 ] Kai Zheng commented on HDFS-8319: - Thanks Jing for the update. bq. We use a direct

[jira] [Comment Edited] (HDFS-8319) Erasure Coding: support decoding for stateful read

2015-06-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571900#comment-14571900 ] Jing Zhao edited comment on HDFS-8319 at 6/4/15 12:36 AM: -- bq.

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

2015-06-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571900#comment-14571900 ] Jing Zhao commented on HDFS-8319: - bq. Using the same buffer type (no mixing) will also

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

2015-06-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571918#comment-14571918 ] Kai Zheng commented on HDFS-8319: - bq. there is no API level restriction to prevent the

[jira] [Commented] (HDFS-8432) Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases.

2015-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571927#comment-14571927 ] Hadoop QA commented on HDFS-8432: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8319) Erasure Coding: support decoding for stateful read

2015-06-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8319: Attachment: HDFS-8319.003.patch Thanks a lot for the review, guys! Update the patch to address comments. I

[jira] [Commented] (HDFS-8319) Erasure Coding: support decoding for stateful read

2015-06-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571929#comment-14571929 ] Jing Zhao commented on HDFS-8319: - bq. So looks like the inputOffsets doesn't work? The

[jira] [Updated] (HDFS-3716) Purger should remove stale fsimage ckpt files

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-3716: Issue Type: Bug (was: Improvement) Purger should remove stale fsimage ckpt files

[jira] [Updated] (HDFS-8525) API getUsed() returns the file lengh only from root /

2015-06-03 Thread tongshiquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tongshiquan updated HDFS-8525: -- Assignee: J.Andreina API getUsed() returns the file lengh only from root /

[jira] [Commented] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress from branch-2

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570636#comment-14570636 ] Hudson commented on HDFS-8523: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #217 (See

[jira] [Commented] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570628#comment-14570628 ] Hudson commented on HDFS-8470: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #217 (See

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570632#comment-14570632 ] Hudson commented on HDFS-8486: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #217 (See

[jira] [Commented] (HDFS-8513) Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570631#comment-14570631 ] Hudson commented on HDFS-8513: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #217 (See

[jira] [Commented] (HDFS-8521) Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570637#comment-14570637 ] Hudson commented on HDFS-8521: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #217 (See

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570633#comment-14570633 ] Hudson commented on HDFS-8270: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #217 (See

[jira] [Commented] (HDFS-8386) Improve synchronization of 'streamer' reference in DFSOutputStream

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570630#comment-14570630 ] Hudson commented on HDFS-8386: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #217 (See

[jira] [Commented] (HDFS-8256) -storagepolicies , -blockId ,-replicaDetails options are missed out in usage and from documentation

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570634#comment-14570634 ] Hudson commented on HDFS-8256: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #217 (See

[jira] [Commented] (HDFS-3716) Purger should remove stale fsimage ckpt files

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570635#comment-14570635 ] Hudson commented on HDFS-3716: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #217 (See

[jira] [Updated] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress from branch-2

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8523: Resolution: Fixed Fix Version/s: 2.7.1 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress from branch-2

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570557#comment-14570557 ] Vinayakumar B commented on HDFS-8523: - +1 for latest patch. Remove usage information

[jira] [Created] (HDFS-8525) API getUsed() returns the file lengh only from root /

2015-06-03 Thread tongshiquan (JIRA)
tongshiquan created HDFS-8525: - Summary: API getUsed() returns the file lengh only from root / Key: HDFS-8525 URL: https://issues.apache.org/jira/browse/HDFS-8525 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8494) Remove hard-coded chunk size in favor of ECZone

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570638#comment-14570638 ] Vinayakumar B commented on HDFS-8494: - bq. I just modified the description as it's

[jira] [Updated] (HDFS-3716) Purger should remove stale fsimage ckpt files

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-3716: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

2015-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570345#comment-14570345 ] Hadoop QA commented on HDFS-8270: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

2015-06-03 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570491#comment-14570491 ] J.Andreina commented on HDFS-8270: -- Thanks all for the review comments. Thanks

[jira] [Commented] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570496#comment-14570496 ] Vinayakumar B commented on HDFS-8470: - +1 for latest patch. Regarding test, currently

[jira] [Commented] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress from branch-2

2015-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570505#comment-14570505 ] Hadoop QA commented on HDFS-8523: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8411) Add to Datanode the amount of data that is read and transfered during EC reconstruction

2015-06-03 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8411: Attachment: HDFS-8411-001.patch Add to Datanode the amount of data that is read and transfered during EC

[jira] [Created] (HDFS-8524) Add tests for StartupProgress with using MiniDFSCluster

2015-06-03 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-8524: --- Summary: Add tests for StartupProgress with using MiniDFSCluster Key: HDFS-8524 URL: https://issues.apache.org/jira/browse/HDFS-8524 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress from branch-2

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570562#comment-14570562 ] Vinayakumar B commented on HDFS-8523: - Thanks [~andreina] for the issue and

[jira] [Commented] (HDFS-3716) Purger should remove stale fsimage ckpt files

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570591#comment-14570591 ] Hudson commented on HDFS-3716: -- FAILURE: Integrated in Hadoop-trunk-Commit #7951 (See

[jira] [Commented] (HDFS-3716) Purger should remove stale fsimage ckpt files

2015-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570627#comment-14570627 ] Hadoop QA commented on HDFS-3716: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8476) quota can't limit the file which put before setting the storage policy

2015-06-03 Thread tongshiquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tongshiquan updated HDFS-8476: -- Assignee: (was: kanaka kumar avvaru) quota can't limit the file which put before setting the

[jira] [Commented] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress from branch-2

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570576#comment-14570576 ] Hudson commented on HDFS-8523: -- FAILURE: Integrated in Hadoop-trunk-Commit #7950 (See

[jira] [Commented] (HDFS-8513) Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570643#comment-14570643 ] Hudson commented on HDFS-8513: -- FAILURE: Integrated in Hadoop-Yarn-trunk #947 (See

[jira] [Commented] (HDFS-8521) Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570649#comment-14570649 ] Hudson commented on HDFS-8521: -- FAILURE: Integrated in Hadoop-Yarn-trunk #947 (See

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570644#comment-14570644 ] Hudson commented on HDFS-8486: -- FAILURE: Integrated in Hadoop-Yarn-trunk #947 (See

[jira] [Commented] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress from branch-2

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570648#comment-14570648 ] Hudson commented on HDFS-8523: -- FAILURE: Integrated in Hadoop-Yarn-trunk #947 (See

[jira] [Commented] (HDFS-3716) Purger should remove stale fsimage ckpt files

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570647#comment-14570647 ] Hudson commented on HDFS-3716: -- FAILURE: Integrated in Hadoop-Yarn-trunk #947 (See

[jira] [Commented] (HDFS-8256) -storagepolicies , -blockId ,-replicaDetails options are missed out in usage and from documentation

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570646#comment-14570646 ] Hudson commented on HDFS-8256: -- FAILURE: Integrated in Hadoop-Yarn-trunk #947 (See

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

2015-06-03 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570445#comment-14570445 ] GAO Rui commented on HDFS-7661: --- Hi [~zhz]. I try to read a EC file which is being written,

[jira] [Commented] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

2015-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570446#comment-14570446 ] Hadoop QA commented on HDFS-8470: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

2015-06-03 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570449#comment-14570449 ] GAO Rui commented on HDFS-7661: --- I think [~zhz] had finished support read a being written EC

[jira] [Commented] (HDFS-3716) Purger should remove stale fsimage ckpt files

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570333#comment-14570333 ] Vinayakumar B commented on HDFS-3716: - Latest patch and test looks fine. Just small

[jira] [Updated] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8523: Target Version/s: 2.7.1 (was: 2.8.0) Remove usage information on unsupported operation fsck

[jira] [Commented] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress from branch-2

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570405#comment-14570405 ] Vinayakumar B commented on HDFS-8523: - Update looks good. Patch seems to be generated

[jira] [Commented] (HDFS-3716) Purger should remove stale fsimage ckpt files

2015-06-03 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570483#comment-14570483 ] J.Andreina commented on HDFS-3716: -- Testcase failures are not related to this issues's

[jira] [Updated] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

2015-06-03 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8470: - Attachment: HDFS-8470_3.patch Thanks [~vinayrpet] for review comments. Attached

[jira] [Commented] (HDFS-8494) Remove hard-coded chunk size in favor of ECZone

2015-06-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570552#comment-14570552 ] Kai Zheng commented on HDFS-8494: - bq. as mentioned in description, why ecZone itself not

[jira] [Updated] (HDFS-3716) Purger should remove stale fsimage ckpt files

2015-06-03 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-3716: - Attachment: HDFS-3716.3.patch Thanks [~vinayrpet] for the review comments. Attached an updated patch .

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570365#comment-14570365 ] Vinayakumar B commented on HDFS-8270: - Latest patch looks good to me. Checkstyle is

[jira] [Updated] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8270: Resolution: Fixed Fix Version/s: 2.7.1 Release Note: Proxy level retries will not be done

[jira] [Updated] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8270: Attachment: HDFS-8270-branch-2.7-03.patch create() always retried with hardcoded timeout when file

[jira] [Updated] (HDFS-8410) Add to Datanode the time taken for computations during EC reconstruction

2015-06-03 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8410: Attachment: HDFS-8410-001.patch Add to Datanode the time taken for computations during EC reconstruction

[jira] [Commented] (HDFS-8328) Follow-on to update decode for DataNode striped blocks reconstruction

2015-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570459#comment-14570459 ] Hadoop QA commented on HDFS-8328: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress from branch-2

2015-06-03 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8523: - Attachment: HDFS-8523.2-branch-2.patch Thanks [~vinayrpet] for reviewing . I have attached the patch for

[jira] [Commented] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress from branch-2

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570534#comment-14570534 ] Vinayakumar B commented on HDFS-8523: - I think for the latest patch, jenkins verified

[jira] [Commented] (HDFS-8410) Add to Datanode the time taken for computations during EC reconstruction

2015-06-03 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570331#comment-14570331 ] Li Bo commented on HDFS-8410: - The patch is based on HDFS-8449 Add to Datanode the time taken

[jira] [Updated] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress

2015-06-03 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8523: - Attachment: HDFS-8523.1-branch-2.7.0.patch Attached an initial patch. Please review. Remove usage

[jira] [Updated] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress

2015-06-03 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8523: - Status: Patch Available (was: Open) Remove usage information on unsupported operation fsck -showprogress

[jira] [Updated] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8523: Target Version/s: 2.8.0 (was: 2.7.0) Remove usage information on unsupported operation fsck

[jira] [Commented] (HDFS-8516) The 'hdfs crypto -listZones' should not print an extra newline at end of output

2015-06-03 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570433#comment-14570433 ] Harsh J commented on HDFS-8516: --- I wasn't worried of the usage ones as I'd never parse them

[jira] [Commented] (HDFS-8493) Consolidate truncate() related implementation in a single class

2015-06-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570464#comment-14570464 ] Rakesh R commented on HDFS-8493: The test case {{TestEncryptedTransfer}} is passing locally

[jira] [Created] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress

2015-06-03 Thread J.Andreina (JIRA)
J.Andreina created HDFS-8523: Summary: Remove usage information on unsupported operation fsck -showprogress Key: HDFS-8523 URL: https://issues.apache.org/jira/browse/HDFS-8523 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570343#comment-14570343 ] Vinayakumar B commented on HDFS-8470: - {{prog.getCounter(Phase.LOADING_FSIMAGE,

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570366#comment-14570366 ] Vinayakumar B commented on HDFS-8270: - Thanks [~jingzhao] for the confirmation.

[jira] [Updated] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8470: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570514#comment-14570514 ] Hudson commented on HDFS-8470: -- FAILURE: Integrated in Hadoop-trunk-Commit #7949 (See

[jira] [Commented] (HDFS-8494) Remove hard-coded chunk size in favor of ECZone

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570544#comment-14570544 ] Vinayakumar B commented on HDFS-8494: - I didnt review the patch fully, but based on

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

2015-06-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570362#comment-14570362 ] Jing Zhao commented on HDFS-8270: - bq. In that case I don't think removing would be problem

[jira] [Updated] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8523: Fix Version/s: (was: 2.7.0) Remove usage information on unsupported operation fsck

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570420#comment-14570420 ] Hudson commented on HDFS-8270: -- FAILURE: Integrated in Hadoop-trunk-Commit #7948 (See

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

2015-06-03 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570422#comment-14570422 ] Tsz Wo Nicholas Sze commented on HDFS-7661: --- Yes, that's correct. Without

[jira] [Commented] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570510#comment-14570510 ] Vinayakumar B commented on HDFS-8470: - Raised followup HDFS-8524 for adding tests.

[jira] [Updated] (HDFS-8494) Remove hard-coded chunk size in favor of ECZone

2015-06-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8494: Description: It is necessary to remove hard-coded values inside NameNode configured in {{HdfsConstants}}.

[jira] [Updated] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8270: Summary: create() always retried with hardcoded timeout when file already exists with open lease

[jira] [Updated] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress from branch-2

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8523: Summary: Remove usage information on unsupported operation fsck -showprogress from branch-2 (was:

[jira] [Commented] (HDFS-3716) Purger should remove stale fsimage ckpt files

2015-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570411#comment-14570411 ] Vinayakumar B commented on HDFS-3716: - +1 for latest patch. Waiting for jenkins

[jira] [Commented] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress from branch-2

2015-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570410#comment-14570410 ] Hadoop QA commented on HDFS-8523: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-3716) Purger should remove stale fsimage ckpt files

2015-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570478#comment-14570478 ] Hadoop QA commented on HDFS-3716: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8494) Remove hard-coded chunk size in favor of ECZone

2015-06-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570548#comment-14570548 ] Kai Zheng commented on HDFS-8494: - Just had an off-line discussion with Vinay about the

[jira] [Commented] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570640#comment-14570640 ] Hudson commented on HDFS-8470: -- FAILURE: Integrated in Hadoop-Yarn-trunk #947 (See

[jira] [Commented] (HDFS-8386) Improve synchronization of 'streamer' reference in DFSOutputStream

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570642#comment-14570642 ] Hudson commented on HDFS-8386: -- FAILURE: Integrated in Hadoop-Yarn-trunk #947 (See

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570645#comment-14570645 ] Hudson commented on HDFS-8270: -- FAILURE: Integrated in Hadoop-Yarn-trunk #947 (See

[jira] [Updated] (HDFS-8520) Patch for PPC64 block size

2015-06-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-8520: - Summary: Patch for PPC64 block size (was: Patch for PPC64) Patch for PPC64 block size

[jira] [Commented] (HDFS-8520) Patch for PPC64 block size

2015-06-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570666#comment-14570666 ] Steve Loughran commented on HDFS-8520: -- What happens on Windows when you try to run

[jira] [Commented] (HDFS-3716) Purger should remove stale fsimage ckpt files

2015-06-03 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570678#comment-14570678 ] J.Andreina commented on HDFS-3716: -- Thanks [~vinayrpet] for the commit Purger should

[jira] [Updated] (HDFS-8476) quota can't limit the file which put before setting the storage policy

2015-06-03 Thread tongshiquan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tongshiquan updated HDFS-8476: -- Assignee: kanaka kumar avvaru quota can't limit the file which put before setting the storage policy

[jira] [Commented] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress from branch-2

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570865#comment-14570865 ] Hudson commented on HDFS-8523: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2145 (See

[jira] [Commented] (HDFS-8386) Improve synchronization of 'streamer' reference in DFSOutputStream

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570860#comment-14570860 ] Hudson commented on HDFS-8386: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2145 (See

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570863#comment-14570863 ] Hudson commented on HDFS-8270: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2145 (See

[jira] [Commented] (HDFS-8520) Patch for PPC64 block size

2015-06-03 Thread Tony Reix (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570870#comment-14570870 ] Tony Reix commented on HDFS-8520: - I have just rechecked that the patch does not break

[jira] [Commented] (HDFS-3716) Purger should remove stale fsimage ckpt files

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570911#comment-14570911 ] Hudson commented on HDFS-3716: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #206 (See

[jira] [Commented] (HDFS-8470) fsimage loading progress should update inode, delegation token and cache pool count.

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570905#comment-14570905 ] Hudson commented on HDFS-8470: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #206 (See

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570909#comment-14570909 ] Hudson commented on HDFS-8486: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #206 (See

[jira] [Commented] (HDFS-8513) Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570908#comment-14570908 ] Hudson commented on HDFS-8513: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #206 (See

[jira] [Commented] (HDFS-8386) Improve synchronization of 'streamer' reference in DFSOutputStream

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570907#comment-14570907 ] Hudson commented on HDFS-8386: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #206 (See

[jira] [Commented] (HDFS-8523) Remove usage information on unsupported operation fsck -showprogress from branch-2

2015-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570912#comment-14570912 ] Hudson commented on HDFS-8523: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #206 (See

  1   2   >