[jira] [Assigned] (HDFS-7335) Redundant checkOperation() in FSN.analyzeFileState()

2014-11-04 Thread Milan Desai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai reassigned HDFS-7335: - Assignee: Milan Desai Redundant checkOperation() in FSN.analyzeFileState()

[jira] [Assigned] (HDFS-7338) Reed-Solomon codec library support

2014-11-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng reassigned HDFS-7338: --- Assignee: Kai Zheng (was: Li Bo) Reed-Solomon codec library support

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

2014-11-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7285: Fix Version/s: HDFS-EC Erasure Coding Support inside HDFS --

[jira] [Commented] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2014-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195968#comment-14195968 ] Hadoop QA commented on HDFS-7314: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6803) Documenting DFSClient#DFSInputStream expectations reading and preading in concurrent context

2014-11-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195980#comment-14195980 ] Steve Loughran commented on HDFS-6803: -- maybe we should say MUST be consistent with

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-11-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195981#comment-14195981 ] Steve Loughran commented on HDFS-6698: -- bq. it's just so easy to write incorrect code

[jira] [Updated] (HDFS-7017) Implement OutputStream for libhdfs3

2014-11-04 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7017: --- Attachment: HDFS-7017-pnative.003.patch Implement OutputStream for libhdfs3

[jira] [Updated] (HDFS-7017) Implement OutputStream for libhdfs3

2014-11-04 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7017: --- Attachment: (was: HDFS-7017-pnative.003.patch) Implement OutputStream for libhdfs3

[jira] [Updated] (HDFS-7017) Implement OutputStream for libhdfs3

2014-11-04 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7017: --- Attachment: HDFS-7017-pnative.003.patch Implement OutputStream for libhdfs3

[jira] [Updated] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2014-11-04 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7337: Fix Version/s: (was: HDFS-EC) Configurable and pluggable Erasure Codec and schema

[jira] [Updated] (HDFS-7339) Create block groups for initial block encoding

2014-11-04 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7339: Fix Version/s: (was: HDFS-EC) Create block groups for initial block encoding

[jira] [Commented] (HDFS-7324) haadmin command usage prints incorrect command name

2014-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196025#comment-14196025 ] Hudson commented on HDFS-7324: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #733 (See

[jira] [Commented] (HDFS-7147) Update archival storage user documentation

2014-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196017#comment-14196017 ] Hudson commented on HDFS-7147: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #733 (See

[jira] [Commented] (HDFS-7328) TestTraceAdmin assumes Unix line endings.

2014-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196024#comment-14196024 ] Hudson commented on HDFS-7328: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #733 (See

[jira] [Commented] (HDFS-7017) Implement OutputStream for libhdfs3

2014-11-04 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196027#comment-14196027 ] Zhanwei Wang commented on HDFS-7017: Add log when fail to close file, remove

[jira] [Updated] (HDFS-7344) Erasure Coding worker and support in DataNode

2014-11-04 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7344: Target Version/s: HDFS-EC Affects Version/s: (was: HDFS-EC) Erasure Coding worker and

[jira] [Updated] (HDFS-7345) Local Reconstruction Codes (LRC)

2014-11-04 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7345: Target Version/s: HDFS-EC Affects Version/s: (was: HDFS-EC) Local Reconstruction Codes

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

2014-11-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7285: - Target Version/s: HDFS-EC Fix Version/s: (was: HDFS-EC) Erasure Coding Support inside HDFS

[jira] [Updated] (HDFS-7343) A comprehensive and flexible storage policy engine

2014-11-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7343: - Target Version/s: HDFS-EC A comprehensive and flexible storage policy engine

[jira] [Updated] (HDFS-7347) Configurable erasure coding policy for individual files and directories

2014-11-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7347: - Fix Version/s: (was: HDFS-EC) Configurable erasure coding policy for individual files and directories

[jira] [Created] (HDFS-7349) Support DFS command for the EC encoding

2014-11-04 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-7349: --- Summary: Support DFS command for the EC encoding Key: HDFS-7349 URL: https://issues.apache.org/jira/browse/HDFS-7349 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7350) WebHDFS: Support EC commands through webhdfs

2014-11-04 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-7350: - Summary: WebHDFS: Support EC commands through webhdfs Key: HDFS-7350 URL: https://issues.apache.org/jira/browse/HDFS-7350 Project: Hadoop HDFS

[jira] [Created] (HDFS-7351) Document the HDFS Erasure Coding feature

2014-11-04 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-7351: - Summary: Document the HDFS Erasure Coding feature Key: HDFS-7351 URL: https://issues.apache.org/jira/browse/HDFS-7351 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-7352) Common side changes for HDFS Erasure coding support

2014-11-04 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-7352: - Summary: Common side changes for HDFS Erasure coding support Key: HDFS-7352 URL: https://issues.apache.org/jira/browse/HDFS-7352 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7352) Common side changes for HDFS Erasure coding support

2014-11-04 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-7352: -- Issue Type: New Feature (was: Bug) Common side changes for HDFS Erasure coding support

[jira] [Created] (HDFS-7353) Common Erasure Codec API and plugin support

2014-11-04 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-7353: --- Summary: Common Erasure Codec API and plugin support Key: HDFS-7353 URL: https://issues.apache.org/jira/browse/HDFS-7353 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-7324) haadmin command usage prints incorrect command name

2014-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196137#comment-14196137 ] Hudson commented on HDFS-7324: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1922 (See

[jira] [Commented] (HDFS-7147) Update archival storage user documentation

2014-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196129#comment-14196129 ] Hudson commented on HDFS-7147: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1922 (See

[jira] [Assigned] (HDFS-7353) Common Erasure Codec API and plugin support

2014-11-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng reassigned HDFS-7353: --- Assignee: Kai Zheng Common Erasure Codec API and plugin support

[jira] [Commented] (HDFS-7328) TestTraceAdmin assumes Unix line endings.

2014-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196136#comment-14196136 ] Hudson commented on HDFS-7328: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1922 (See

[jira] [Commented] (HDFS-7338) Reed-Solomon codec library support

2014-11-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196142#comment-14196142 ] Kai Zheng commented on HDFS-7338: - This will follow the common codec API and plugin support

[jira] [Updated] (HDFS-7338) Reed-Solomon codec library support

2014-11-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7338: Description: This is to provide RS codec implementation for encoding and decoding. Reed-Solomon codec

[jira] [Updated] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2014-11-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7337: Description: According to HDFS-7285 and the design, this considers to support multiple Erasure Codecs via

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2014-11-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196154#comment-14196154 ] Kai Zheng commented on HDFS-7337: - Also opened HDFS-7353 to focus on the very low level

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2014-11-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196163#comment-14196163 ] Kai Zheng commented on HDFS-7337: - Zhe, let me consider these issues together and think

[jira] [Assigned] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2014-11-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng reassigned HDFS-7337: --- Assignee: Kai Zheng Configurable and pluggable Erasure Codec and schema

[jira] [Updated] (HDFS-7353) Common Erasure Codec API and plugin support

2014-11-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7353: Fix Version/s: HDFS-EC Common Erasure Codec API and plugin support

[jira] [Commented] (HDFS-7147) Update archival storage user documentation

2014-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196198#comment-14196198 ] Hudson commented on HDFS-7147: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1947 (See

[jira] [Commented] (HDFS-7324) haadmin command usage prints incorrect command name

2014-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196206#comment-14196206 ] Hudson commented on HDFS-7324: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1947 (See

[jira] [Commented] (HDFS-7328) TestTraceAdmin assumes Unix line endings.

2014-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196205#comment-14196205 ] Hudson commented on HDFS-7328: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1947 (See

[jira] [Commented] (HDFS-7340) make rollingUpgrade start/finalize idempotent

2014-11-04 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196334#comment-14196334 ] Suresh Srinivas commented on HDFS-7340: --- +1 for the patch. Couple of comments: bq.

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-11-04 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196336#comment-14196336 ] Plamen Jeliazkov commented on HDFS-3107: [~cmccabe], At the time [~shv] talked

[jira] [Commented] (HDFS-7340) make rollingUpgrade start/finalize idempotent

2014-11-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196355#comment-14196355 ] Tsz Wo Nicholas Sze commented on HDFS-7340: --- +1 patch looks good. No additional

[jira] [Updated] (HDFS-7218) FSNamesystem ACL operations should write to audit log on failure

2014-11-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7218: Hadoop Flags: Reviewed +1 from me too. Thank you, Charles. FSNamesystem ACL operations should

[jira] [Updated] (HDFS-7339) Create block groups for initial block encoding

2014-11-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7339: Description: All erasure codec operations center around the concept of _block groups_, which are formed in

[jira] [Updated] (HDFS-7339) Create block groups for initial block encoding

2014-11-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7339: Attachment: Encoding-design-NN.jpg Architecture of NameNode extensions Create block groups for initial

[jira] [Commented] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-11-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196496#comment-14196496 ] Colin Patrick McCabe commented on HDFS-7199: Can you post a new patch with the

[jira] [Updated] (HDFS-7340) make rollingUpgrade start/finalize idempotent

2014-11-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7340: Attachment: HDFS-7340.001.patch Thanks Suresh and Nicholas for the review. Update the patch to address

[jira] [Updated] (HDFS-6803) Documenting DFSClient#DFSInputStream expectations reading and preading in concurrent context

2014-11-04 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HDFS-6803: Attachment: HDFS-6803v2.txt Thanks [~ste...@apache.org]. Here is v2. Documenting DFSClient#DFSInputStream

[jira] [Commented] (HDFS-7340) make rollingUpgrade start/finalize idempotent

2014-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196511#comment-14196511 ] Hadoop QA commented on HDFS-7340: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7340) make rollingUpgrade start/finalize idempotent

2014-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196514#comment-14196514 ] Hudson commented on HDFS-7340: -- FAILURE: Integrated in Hadoop-trunk-Commit #6434 (See

[jira] [Updated] (HDFS-7340) make rollingUpgrade start/finalize idempotent

2014-11-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7340: Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-7334) Fix periodic failures of TestCheckpoint#testTooManyEditReplayFailures

2014-11-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196576#comment-14196576 ] Haohui Mai commented on HDFS-7334: -- Looks good to me. {code}

[jira] [Commented] (HDFS-7017) Implement OutputStream for libhdfs3

2014-11-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196585#comment-14196585 ] Colin Patrick McCabe commented on HDFS-7017: Thanks, this looks better. bq. I

[jira] [Commented] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2014-11-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196603#comment-14196603 ] Colin Patrick McCabe commented on HDFS-7314: Thanks, [~mingma]. It's

[jira] [Created] (HDFS-7354) Support parity blocks in block management

2014-11-04 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-7354: --- Summary: Support parity blocks in block management Key: HDFS-7354 URL: https://issues.apache.org/jira/browse/HDFS-7354 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-11-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196619#comment-14196619 ] Colin Patrick McCabe commented on HDFS-3107: bq. There is the option to treat

[jira] [Commented] (HDFS-6982) nntop: top­-like tool for name node users

2014-11-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196620#comment-14196620 ] Haohui Mai commented on HDFS-6982: -- {code} +if (bucket.isStaleNow(time)) { +

[jira] [Updated] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-11-04 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7199: - Status: Open (was: Patch Available) Need to address Collins comments. DFSOutputStream can

[jira] [Updated] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-11-04 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7199: - Status: Patch Available (was: Open) DFSOutputStream can silently drop data if DataStreamer

[jira] [Updated] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-11-04 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7199: - Attachment: HDFS-7199-1.patch Updated patch with addressing Collins comment. DFSOutputStream can

[jira] [Commented] (HDFS-6982) nntop: top­-like tool for name node users

2014-11-04 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196632#comment-14196632 ] Maysam Yabandeh commented on HDFS-6982: --- Thanks [~wheat9] for the comment. Let me

[jira] [Updated] (HDFS-7334) Fix periodic failures of TestCheckpoint#testTooManyEditReplayFailures

2014-11-04 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7334: --- Attachment: HDFS-7334.002.patch [~wheat9], Thanks for the review! The .002 patch changes the set to

[jira] [Commented] (HDFS-6982) nntop: top­-like tool for name node users

2014-11-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196644#comment-14196644 ] Haohui Mai commented on HDFS-6982: -- bq. Before we start adding events to that (which will

[jira] [Commented] (HDFS-7334) Fix periodic failures of TestCheckpoint#testTooManyEditReplayFailures

2014-11-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196649#comment-14196649 ] Haohui Mai commented on HDFS-7334: -- +1 pending jenkins. Fix periodic failures of

[jira] [Commented] (HDFS-7056) Snapshot support for truncate

2014-11-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196655#comment-14196655 ] Jing Zhao commented on HDFS-7056: - Thanks for working on this, [~shv] and [~zero45]. So far

[jira] [Commented] (HDFS-6982) nntop: top­-like tool for name node users

2014-11-04 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196664#comment-14196664 ] Maysam Yabandeh commented on HDFS-6982: --- Let me take an example. Time period: 60

[jira] [Commented] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-11-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1419#comment-1419 ] Colin Patrick McCabe commented on HDFS-7199: +1 pending jenkins

[jira] [Updated] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2014-11-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7314: -- Attachment: HDFS-7314-2.patch Thanks, [~cmccabe]. I have updated the patch based on your suggestion. Aborted

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-11-04 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196716#comment-14196716 ] Plamen Jeliazkov commented on HDFS-3107: I will attach it to HDFS-7056 since it has

[jira] [Updated] (HDFS-7056) Snapshot support for truncate

2014-11-04 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-7056: --- Attachment: HDFS-3107-HDFS-7056-combined.patch Attaching combined patch here as well.

[jira] [Commented] (HDFS-7343) A comprehensive and flexible storage policy engine

2014-11-04 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196759#comment-14196759 ] Andrew Purtell commented on HDFS-7343: -- Most of the ideas mentioned in the description

[jira] [Updated] (HDFS-7335) Redundant checkOperation() in FSN.analyzeFileState()

2014-11-04 Thread Milan Desai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai updated HDFS-7335: -- Status: Patch Available (was: Open) Redundant checkOperation() in FSN.analyzeFileState()

[jira] [Updated] (HDFS-7355) TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails on Windows, because we cannot deny access to the file owner.

2014-11-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7355: Status: Patch Available (was: Open) TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure

[jira] [Updated] (HDFS-7355) TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails on Windows, because we cannot deny access to the file owner.

2014-11-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7355: Attachment: HDFS-7355.1.patch The attached patch skips the test.

[jira] [Created] (HDFS-7355) TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails on Windows, because we cannot deny access to the file owner.

2014-11-04 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-7355: --- Summary: TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails on Windows, because we cannot deny access to the file owner. Key: HDFS-7355 URL:

[jira] [Updated] (HDFS-7335) Redundant checkOperation() in FSN.analyzeFileState()

2014-11-04 Thread Milan Desai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai updated HDFS-7335: -- Attachment: HDFS-7335.patch Attaching a patch that removes the checkOperation call in

[jira] [Commented] (HDFS-7355) TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails on Windows, because we cannot deny access to the file owner.

2014-11-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196734#comment-14196734 ] Chris Nauroth commented on HDFS-7355: -

[jira] [Commented] (HDFS-7208) NN doesn't schedule replication when a DN storage fails

2014-11-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196752#comment-14196752 ] Chris Nauroth commented on HDFS-7208: - The new test cannot work correctly on Windows.

[jira] [Commented] (HDFS-7335) Redundant checkOperation() in FSN.analyzeFileState()

2014-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196781#comment-14196781 ] Hadoop QA commented on HDFS-7335: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-7356) Use DirectoryListing.hasMore() directly in nfs

2014-11-04 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-7356: Summary: Use DirectoryListing.hasMore() directly in nfs Key: HDFS-7356 URL: https://issues.apache.org/jira/browse/HDFS-7356 Project: Hadoop HDFS Issue Type: Bug

[jira] [Assigned] (HDFS-7356) Use DirectoryListing.hasMore() directly in nfs

2014-11-04 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned HDFS-7356: --- Assignee: Li Lu Use DirectoryListing.hasMore() directly in nfs

[jira] [Commented] (HDFS-7233) NN logs unnecessary org.apache.hadoop.hdfs.protocol.UnresolvedPathException

2014-11-04 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196806#comment-14196806 ] Rushabh S Shah commented on HDFS-7233: -- All the tests passing on my local setup. NN

[jira] [Created] (HDFS-7357) FSNamesystem.checkFileProgress should log file path

2014-11-04 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7357: - Summary: FSNamesystem.checkFileProgress should log file path Key: HDFS-7357 URL: https://issues.apache.org/jira/browse/HDFS-7357 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7356) Use DirectoryListing.hasMore() directly in nfs

2014-11-04 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated HDFS-7356: Attachment: HDFS-7356-110414.patch Hi [~wheat9], I've fixed this in my patch. If you have time please feel free to

[jira] [Updated] (HDFS-7356) Use DirectoryListing.hasMore() directly in nfs

2014-11-04 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated HDFS-7356: Status: Patch Available (was: Open) Use DirectoryListing.hasMore() directly in nfs

[jira] [Commented] (HDFS-7356) Use DirectoryListing.hasMore() directly in nfs

2014-11-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196821#comment-14196821 ] Jing Zhao commented on HDFS-7356: - +1 pending Jenkins Use DirectoryListing.hasMore()

[jira] [Updated] (HDFS-7357) FSNamesystem.checkFileProgress should log file path

2014-11-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7357: -- Status: Patch Available (was: Open) FSNamesystem.checkFileProgress should log file

[jira] [Updated] (HDFS-7357) FSNamesystem.checkFileProgress should log file path

2014-11-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7357: -- Attachment: h7357_20141104.patch h7357_20141104.patch: - add path and other info to the

[jira] [Commented] (HDFS-7357) FSNamesystem.checkFileProgress should log file path

2014-11-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196834#comment-14196834 ] Haohui Mai commented on HDFS-7357: -- +1 pending jenkins. FSNamesystem.checkFileProgress

[jira] [Commented] (HDFS-7355) TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails on Windows, because we cannot deny access to the file owner.

2014-11-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196849#comment-14196849 ] Ming Ma commented on HDFS-7355: --- Thanks, [~cnauroth]. The patch looks good. BTW, it seems

[jira] [Commented] (HDFS-7355) TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails on Windows, because we cannot deny access to the file owner.

2014-11-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196855#comment-14196855 ] Haohui Mai commented on HDFS-7355: -- +1 pending jenkins.

[jira] [Commented] (HDFS-7056) Snapshot support for truncate

2014-11-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196891#comment-14196891 ] Konstantin Shvachko commented on HDFS-7056: --- Actually Guo and I have finished

[jira] [Commented] (HDFS-7295) Support arbitrary max expiration times for delegation token

2014-11-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196896#comment-14196896 ] Allen Wittenauer commented on HDFS-7295: FWIW, I *do* think the max lifespan should

[jira] [Updated] (HDFS-7231) rollingupgrade needs some guard rails

2014-11-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7231: --- Target Version/s: 2.6.0 rollingupgrade needs some guard rails

[jira] [Updated] (HDFS-7335) Redundant checkOperation() in FSN.analyzeFileState()

2014-11-04 Thread Milan Desai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Desai updated HDFS-7335: -- Attachment: HDFS-7335.patch New patch removes git diff prefix Redundant checkOperation() in

[jira] [Updated] (HDFS-7279) Use netty to implement DatanodeWebHdfsMethods

2014-11-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7279: - Attachment: HDFS-7279.004.patch Use netty to implement DatanodeWebHdfsMethods

[jira] [Commented] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196933#comment-14196933 ] Hadoop QA commented on HDFS-7199: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7334) Fix periodic failures of TestCheckpoint#testTooManyEditReplayFailures

2014-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196934#comment-14196934 ] Hadoop QA commented on HDFS-7334: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7334) Fix periodic failures of TestCheckpoint#testTooManyEditReplayFailures

2014-11-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196944#comment-14196944 ] Haohui Mai commented on HDFS-7334: -- The test report does not have the failure. I'll commit

  1   2   >