[jira] [Commented] (HDFS-8201) Add an end to end test for stripping file writing and reading

2015-04-20 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504451#comment-14504451 ] Kai Sasaki commented on HDFS-8201: -- [~drankye] I wonder this JIRA might be duplicate to [

[jira] [Commented] (HDFS-8182) Implement topology-aware CDN-style caching

2015-04-20 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1450#comment-1450 ] Gera Shegalov commented on HDFS-8182: - Hi Andrew, I think the said block placement pol

[jira] [Comment Edited] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504428#comment-14504428 ] Yi Liu edited comment on HDFS-8033 at 4/21/15 6:33 AM: --- Thanks [~zhz]

[jira] [Commented] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-04-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504436#comment-14504436 ] Vinayakumar B commented on HDFS-7993: - Thanks [~andreina] for the latest patch. +1. Wai

[jira] [Comment Edited] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504428#comment-14504428 ] Yi Liu edited comment on HDFS-8033 at 4/21/15 6:25 AM: --- Thanks [~zhz]

[jira] [Commented] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504428#comment-14504428 ] Yi Liu commented on HDFS-8033: -- Thanks [~zhz] for working on this. The patch is good, my comm

[jira] [Updated] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

2015-04-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8191: Attachment: HDFS-8191.001.patch Thanks Andrew for the review! Yes a unit test is a good idea. It turns out I

[jira] [Updated] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-04-20 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-7993: - Attachment: HDFS-7993.6.patch > Incorrect descriptions in fsck when nodes are decommissioned >

[jira] [Commented] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-04-20 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504404#comment-14504404 ] J.Andreina commented on HDFS-7993: -- Thanks [~mingma] and [~vinayrpet] for reviewing and co

[jira] [Updated] (HDFS-7281) Missing block is marked as corrupted block

2015-04-20 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7281: -- Attachment: HDFS-7281-4.patch Yongjun, that makes sense. Here is the updated patch. > Missing block is marked as

[jira] [Commented] (HDFS-8157) Writes to RAM DISK reserve locked memory for block files

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504338#comment-14504338 ] Hadoop QA commented on HDFS-8157: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-04-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504323#comment-14504323 ] Vinayakumar B commented on HDFS-7993: - Hi andreina, Patch looks almost good with the up

[jira] [Comment Edited] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-04-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504300#comment-14504300 ] Vinayakumar B edited comment on HDFS-7993 at 4/21/15 4:30 AM: --

[jira] [Commented] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-04-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504300#comment-14504300 ] Vinayakumar B commented on HDFS-7993: - In the latest patch attached, the output will ch

[jira] [Updated] (HDFS-8176) Provide information about the snapshots compared in audit log

2015-04-20 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8176: - Status: Patch Available (was: Open) > Provide information about the snapshots compared in audit log >

[jira] [Commented] (HDFS-8201) Add an end to end test for stripping file writing and reading

2015-04-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504273#comment-14504273 ] Kai Zheng commented on HDFS-8201: - HDFS-8202 was also opened to improve the test for erasur

[jira] [Created] (HDFS-8202) Improve end to end stirpping file test to add erasure recovering test

2015-04-20 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-8202: --- Summary: Improve end to end stirpping file test to add erasure recovering test Key: HDFS-8202 URL: https://issues.apache.org/jira/browse/HDFS-8202 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8193) Add the ability to delay replica deletion for a period of time

2015-04-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504269#comment-14504269 ] Chris Nauroth commented on HDFS-8193: - Hello [~atm] and [~zhz]. HDFS-6186 added the {

[jira] [Commented] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504258#comment-14504258 ] Hadoop QA commented on HDFS-8191: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-8201) Add an end to end test for stripping file writing and reading

2015-04-20 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-8201: --- Summary: Add an end to end test for stripping file writing and reading Key: HDFS-8201 URL: https://issues.apache.org/jira/browse/HDFS-8201 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-8200) Refactor FSDirStatAndListingOp

2015-04-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8200: - Status: Patch Available (was: Open) > Refactor FSDirStatAndListingOp > -- > >

[jira] [Updated] (HDFS-8200) Refactor FSDirStatAndListingOp

2015-04-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8200: - Attachment: HDFS-8200.000.patch > Refactor FSDirStatAndListingOp > -- > >

[jira] [Created] (HDFS-8200) Refactor FSDirStatAndListingOp

2015-04-20 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8200: Summary: Refactor FSDirStatAndListingOp Key: HDFS-8200 URL: https://issues.apache.org/jira/browse/HDFS-8200 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-8194) Add administrative tool to be able to examine the NN's view of DN storages

2015-04-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504246#comment-14504246 ] Haohui Mai commented on HDFS-8194: -- What about making the information available through JM

[jira] [Updated] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

2015-04-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8156: Attachment: HDFS-8156-v6.patch Updated the patch: 1. Removed initWith method, adding extractChunkSize method

[jira] [Created] (HDFS-8199) Erasure Coding: System test of creating ECZone and EC files.

2015-04-20 Thread Kai Sasaki (JIRA)
Kai Sasaki created HDFS-8199: Summary: Erasure Coding: System test of creating ECZone and EC files. Key: HDFS-8199 URL: https://issues.apache.org/jira/browse/HDFS-8199 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-8198) Erasure Coding: system test of TeraSort

2015-04-20 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8198: - Issue Type: Test (was: Bug) > Erasure Coding: system test of TeraSort > --

[jira] [Created] (HDFS-8198) Erasure Coding: system test of TeraSort

2015-04-20 Thread Kai Sasaki (JIRA)
Kai Sasaki created HDFS-8198: Summary: Erasure Coding: system test of TeraSort Key: HDFS-8198 URL: https://issues.apache.org/jira/browse/HDFS-8198 Project: Hadoop HDFS Issue Type: Bug Affects

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-04-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504191#comment-14504191 ] Hudson commented on HDFS-7916: -- FAILURE: Integrated in Hadoop-trunk-Commit #7621 (See [https:

[jira] [Updated] (HDFS-8197) [umbrella] System tests for EC feature

2015-04-20 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8197: - Summary: [umbrella] System tests for EC feature (was: System tests for EC feature) > [umbrella] System te

[jira] [Created] (HDFS-8197) System tests for EC feature

2015-04-20 Thread Kai Sasaki (JIRA)
Kai Sasaki created HDFS-8197: Summary: System tests for EC feature Key: HDFS-8197 URL: https://issues.apache.org/jira/browse/HDFS-8197 Project: Hadoop HDFS Issue Type: Sub-task Affects Versio

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504187#comment-14504187 ] Hadoop QA commented on HDFS-8078: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6600) fsck -move fails in secured clusters.

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504186#comment-14504186 ] Hadoop QA commented on HDFS-6600: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-8196) Erasure Coding related information on NameNode UI

2015-04-20 Thread Kai Sasaki (JIRA)
Kai Sasaki created HDFS-8196: Summary: Erasure Coding related information on NameNode UI Key: HDFS-8196 URL: https://issues.apache.org/jira/browse/HDFS-8196 Project: Hadoop HDFS Issue Type: Sub-t

[jira] [Updated] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-04-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7916: Fix Version/s: (was: 2.8.0) 2.7.1 > 'reportBadBlocks' from datanodes to standb

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-04-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504177#comment-14504177 ] Vinayakumar B commented on HDFS-7916: - Merged to 2.7.1. > 'reportBadBlocks' from datan

[jira] [Created] (HDFS-8195) Erasure coding: Fix file quota change when we complete/commit the striped blocks

2015-04-20 Thread Takuya Fukudome (JIRA)
Takuya Fukudome created HDFS-8195: - Summary: Erasure coding: Fix file quota change when we complete/commit the striped blocks Key: HDFS-8195 URL: https://issues.apache.org/jira/browse/HDFS-8195 Projec

[jira] [Commented] (HDFS-8015) Erasure Coding: local and remote block writer for coding work in DataNode

2015-04-20 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504163#comment-14504163 ] Li Bo commented on HDFS-8015: - hi, Nichilas I am now working on this subtask to support erasure

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-04-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504160#comment-14504160 ] Vinayakumar B commented on HDFS-7916: - Thanks [~kihwal] for the reminder. I will merge

[jira] [Commented] (HDFS-8160) Long delays when calling hdfsOpenFile()

2015-04-20 Thread Rod (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504154#comment-14504154 ] Rod commented on HDFS-8160: --- I wish the answer were that simple, here's some cluster status taken

[jira] [Created] (HDFS-8194) Add administrative tool to be able to examine the NN's view of DN storages

2015-04-20 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-8194: Summary: Add administrative tool to be able to examine the NN's view of DN storages Key: HDFS-8194 URL: https://issues.apache.org/jira/browse/HDFS-8194 Project: Hadoo

[jira] [Commented] (HDFS-8186) Erasure coding: Make block placement policy for EC file configurable

2015-04-20 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504135#comment-14504135 ] Walter Su commented on HDFS-8186: - As discussed in HDFS-7068, trunk don't need support mult

[jira] [Created] (HDFS-8193) Add the ability to delay replica deletion for a period of time

2015-04-20 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-8193: Summary: Add the ability to delay replica deletion for a period of time Key: HDFS-8193 URL: https://issues.apache.org/jira/browse/HDFS-8193 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8182) Implement topology-aware CDN-style caching

2015-04-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504105#comment-14504105 ] Andrew Wang commented on HDFS-8182: --- Hi Gera, just for my own edification, given the "spr

[jira] [Comment Edited] (HDFS-8157) Writes to RAM DISK reserve locked memory for block files

2015-04-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504089#comment-14504089 ] Arpit Agarwal edited comment on HDFS-8157 at 4/21/15 1:12 AM: --

[jira] [Commented] (HDFS-6919) Enforce a single limit for RAM disk usage and replicas cached via locking

2015-04-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504097#comment-14504097 ] Arpit Agarwal commented on HDFS-6919: - I've posted a patch to HDFS-8157 which implement

[jira] [Updated] (HDFS-8157) Writes to RAM DISK reserve locked memory for block files

2015-04-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8157: Status: Patch Available (was: Open) > Writes to RAM DISK reserve locked memory for block files > ---

[jira] [Updated] (HDFS-8157) Writes to RAM DISK reserve locked memory for block files

2015-04-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8157: Attachment: HDFS-8157.01.patch Initial patch to reserve memory with cacheManager when writing replica

[jira] [Created] (HDFS-8192) Eviction should key off used locked memory instead of ram disk free space

2015-04-20 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-8192: --- Summary: Eviction should key off used locked memory instead of ram disk free space Key: HDFS-8192 URL: https://issues.apache.org/jira/browse/HDFS-8192 Project: Hadoop H

[jira] [Commented] (HDFS-8172) Failure handling: DFSStripedOutputStream continues writing with enough remaining datanodes

2015-04-20 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504075#comment-14504075 ] Li Bo commented on HDFS-8172: - hi, Nicholas Sorry for the late reply. At first I think we can c

[jira] [Commented] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

2015-04-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504056#comment-14504056 ] Kai Zheng commented on HDFS-8156: - I would appreciate if you could illustrate the idea with

[jira] [Resolved] (HDFS-8190) StripedBlockUtil.getInternalBlockLength may have overflow error

2015-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8190. --- Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Thanks Ji

[jira] [Commented] (HDFS-8190) StripedBlockUtil.getInternalBlockLength may have overflow error

2015-04-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504052#comment-14504052 ] Jing Zhao commented on HDFS-8190: - +1 for the new patch as well. > StripedBlockUtil.getInt

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-04-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504048#comment-14504048 ] Haohui Mai commented on HDFS-7285: -- bq. If necessary we can try to push our changes in DF

[jira] [Updated] (HDFS-8190) StripedBlockUtil.getInternalBlockLength may have overflow error

2015-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8190: -- Attachment: h8190_20150420b.patch h8190_20150420b.patch: revises a java comment as below.

[jira] [Commented] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

2015-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504037#comment-14504037 ] Tsz Wo Nicholas Sze commented on HDFS-8156: --- > Doing so we have to duplicate code

[jira] [Commented] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

2015-04-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504029#comment-14504029 ] Andrew Wang commented on HDFS-8191: --- Thanks Zhe, this looks good, explanation makes sense

[jira] [Commented] (HDFS-8190) StripedBlockUtil.getInternalBlockLength may have overflow error

2015-04-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504026#comment-14504026 ] Jing Zhao commented on HDFS-8190: - Thanks for the fix, Nicholas. The patch looks pretty goo

[jira] [Commented] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

2015-04-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504023#comment-14504023 ] Kai Zheng commented on HDFS-8156: - bq.It seems not hard to do it. Just need to move the cod

[jira] [Updated] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

2015-04-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8191: Status: Patch Available (was: Open) The default upcasting from byte to integer will result in negative integ

[jira] [Commented] (HDFS-8185) Separate client related routines in HAUtil into a new class

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504020#comment-14504020 ] Hadoop QA commented on HDFS-8185: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

2015-04-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8191: Attachment: HDFS-8191.000.patch > Fix byte to integer casting in SimulatedFSDataset#simulatedByte > -

[jira] [Created] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

2015-04-20 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-8191: --- Summary: Fix byte to integer casting in SimulatedFSDataset#simulatedByte Key: HDFS-8191 URL: https://issues.apache.org/jira/browse/HDFS-8191 Project: Hadoop HDFS Issu

[jira] [Updated] (HDFS-8190) StripedBlockUtil.getInternalBlockLength may have overflow error

2015-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8190: -- Attachment: (was: h8190_20150420.patch) > StripedBlockUtil.getInternalBlockLength may

[jira] [Updated] (HDFS-8190) StripedBlockUtil.getInternalBlockLength may have overflow error

2015-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8190: -- Attachment: h8190_20150420.patch > StripedBlockUtil.getInternalBlockLength may have overf

[jira] [Updated] (HDFS-6600) fsck -move fails in secured clusters.

2015-04-20 Thread Krish Dey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krish Dey updated HDFS-6600: Attachment: HDFS-6600.1.PATCH {color:green}+1 overall{color}. {color:green}+1 @author{color}. The pat

[jira] [Updated] (HDFS-6600) fsck -move fails in secured clusters.

2015-04-20 Thread Krish Dey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krish Dey updated HDFS-6600: Status: Patch Available (was: Open) Please review the patch {color:green}+1 overall{color}. {color:gr

[jira] [Updated] (HDFS-8190) StripedBlockUtil.getInternalBlockLength may have overflow error

2015-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8190: -- Attachment: h8190_20150420.patch h8190_20150420.patch: fix the bug and cleanup getInterna

[jira] [Created] (HDFS-8190) StripedBlockUtil.getInternalBlockLength may have overflow error

2015-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8190: - Summary: StripedBlockUtil.getInternalBlockLength may have overflow error Key: HDFS-8190 URL: https://issues.apache.org/jira/browse/HDFS-8190 Project: Hadoop

[jira] [Assigned] (HDFS-8190) StripedBlockUtil.getInternalBlockLength may have overflow error

2015-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reassigned HDFS-8190: - Assignee: Tsz Wo Nicholas Sze > StripedBlockUtil.getInternalBlockLength may have o

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-04-20 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Attachment: (was: HDFS-8078.4.patch) > HDFS client gets errors trying to to connect to IPv6 DataNode > --

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-04-20 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Attachment: HDFS-8078.4.patch Test appears to be ND... > HDFS client gets errors trying to to connect to IPv

[jira] [Commented] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

2015-04-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503905#comment-14503905 ] Hudson commented on HDFS-8179: -- FAILURE: Integrated in Hadoop-trunk-Commit #7619 (See [https:

[jira] [Commented] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

2015-04-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503900#comment-14503900 ] Arpit Agarwal commented on HDFS-8179: - I just realized I committed the v01 patch before

[jira] [Commented] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503894#comment-14503894 ] Hadoop QA commented on HDFS-8179: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

2015-04-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8179: Resolution: Fixed Fix Version/s: 2.7.1 Target Version/s: (was: 2.7.1) Hadoo

[jira] [Commented] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

2015-04-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503842#comment-14503842 ] Zhe Zhang commented on HDFS-7678: - Thanks Kai, I will review HADOOP-11847 first. > Erasur

[jira] [Updated] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

2015-04-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8179: - Attachment: (was: HDFS-8179.dal.patch) > DFSClient#getServerDefaults returns null within 1 hour of syst

[jira] [Updated] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

2015-04-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8179: - Attachment: HDFS-8179.dal.patch > DFSClient#getServerDefaults returns null within 1 hour of system start >

[jira] [Issue Comment Deleted] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

2015-04-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8179: Comment: was deleted (was: Attach the Dal patch.) > DFSClient#getServerDefaults returns null within

[jira] [Updated] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

2015-04-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8179: - Attachment: (was: HDFS-9179.dal.patch) > DFSClient#getServerDefaults returns null within 1 hour of syst

[jira] [Updated] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

2015-04-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8179: - Attachment: HDFS-9179.dal.patch Attach the Dal patch. > DFSClient#getServerDefaults returns null within 1

[jira] [Commented] (HDFS-8005) Erasure Coding: simplify striped block recovery work computation and add tests

2015-04-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503759#comment-14503759 ] Zhe Zhang commented on HDFS-8005: - Good thoughts Walter. This is an important aspect we sho

[jira] [Commented] (HDFS-8014) Erasure Coding: local and remote block reader for coding work in DataNode

2015-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503756#comment-14503756 ] Tsz Wo Nicholas Sze commented on HDFS-8014: --- I actually mean using BlockReader wh

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503737#comment-14503737 ] Hadoop QA commented on HDFS-8078: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-8146) Protobuf changes for BlockECRecoveryCommand and its fields for making it ready for transfer to DN

2015-04-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503738#comment-14503738 ] Zhe Zhang commented on HDFS-8146: - Looks great! Thanks Uma for the work and Vinay for the r

[jira] [Commented] (HDFS-8014) Erasure Coding: local and remote block reader for coding work in DataNode

2015-04-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503731#comment-14503731 ] Zhe Zhang commented on HDFS-8014: - bq. what is the reason not to simply use DFSInputStream?

[jira] [Commented] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

2015-04-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503710#comment-14503710 ] Arpit Agarwal commented on HDFS-8179: - Thanks [~jnp]. Looked at the original change and

[jira] [Commented] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

2015-04-20 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503697#comment-14503697 ] Jitendra Nath Pandey commented on HDFS-8179: [~arpitagarwal], HDFS-6841 chang

[jira] [Updated] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

2015-04-20 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-8179: --- Status: Patch Available (was: Open) > DFSClient#getServerDefaults returns null within

[jira] [Commented] (HDFS-8014) Erasure Coding: local and remote block reader for coding work in DataNode

2015-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503689#comment-14503689 ] Tsz Wo Nicholas Sze commented on HDFS-8014: --- > ... In that case it'd be nice to a

[jira] [Commented] (HDFS-8014) Erasure Coding: local and remote block reader for coding work in DataNode

2015-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503681#comment-14503681 ] Tsz Wo Nicholas Sze commented on HDFS-8014: --- BTW, what is the reason not to simpl

[jira] [Commented] (HDFS-8129) Maintain consistent naming for Erasure Coding related classes - EC/ErasureCode

2015-04-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503685#comment-14503685 ] Zhe Zhang commented on HDFS-8129: - {{ErasureCoding*}} sounds good to me. > Maintain consis

[jira] [Commented] (HDFS-8014) Erasure Coding: local and remote block reader for coding work in DataNode

2015-04-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503679#comment-14503679 ] Zhe Zhang commented on HDFS-8014: - Depending on our algorithm of selecting EC reconstructio

[jira] [Commented] (HDFS-4448) HA NN does not start with wildcard address configured for other NN when security is enabled

2015-04-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503673#comment-14503673 ] Arun Suresh commented on HDFS-4448: --- [~daryn], [~atm] It looks like after HADOOP-9789 , c

[jira] [Commented] (HDFS-8014) Erasure Coding: local and remote block reader for coding work in DataNode

2015-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503661#comment-14503661 ] Tsz Wo Nicholas Sze commented on HDFS-8014: --- Then why there is a difference betwe

[jira] [Resolved] (HDFS-8188) Erasure coding: refactor client-related code to sync with HDFS-8082 and HDFS-8169

2015-04-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8188. - Resolution: Fixed Fix Version/s: HDFS-7285 Thanks Nicholas for the prompt feedback! I've committed t

[jira] [Updated] (HDFS-8188) Erasure coding: refactor client-related code to sync with HDFS-8082 and HDFS-8169

2015-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8188: -- Hadoop Flags: Reviewed +1 the new patch looks good. Thanks Zhe. > Erasure coding: refact

[jira] [Commented] (HDFS-8014) Erasure Coding: local and remote block reader for coding work in DataNode

2015-04-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503657#comment-14503657 ] Zhe Zhang commented on HDFS-8014: - Thanks for checking Nicholas. _Block reader_ here actual

[jira] [Updated] (HDFS-8188) Erasure coding: refactor client-related code to sync with HDFS-8082 and HDFS-8169

2015-04-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8188: Attachment: HDFS-8188.001.patch Thanks Nicholas for the review! The new patch addresses the comments. > Era

  1   2   >