[jira] [Updated] (HDFS-7408) Add a counter in the log that shows the number of block reports processed

[ https://issues.apache.org/jira/browse/HDFS-7408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-7408: - Attachment: HDFS-7408.001.patch > Add a counter in the log that shows the number

[jira] [Updated] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Tianyi updated HDFS-8829: Attachment: HDFS-8829.0005.patch Fix codestyle. > DataNode sets SO_RCVBUF explicitly is disabling tcp

[jira] [Updated] (HDFS-8968) New benchmark throughput tool for striping erasure coding

[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HDFS-8968: - Attachment: HDFS-8968-HDFS-7285.2.patch Rebase my patch and address comments. Thanks [~drankye] for your inputs.

[jira] [Commented] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740302#comment-14740302 ] Hudson commented on HDFS-7314: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2295 (See

[jira] [Commented] (HDFS-7408) Add a counter in the log that shows the number of block reports processed

[ https://issues.apache.org/jira/browse/HDFS-7408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740303#comment-14740303 ] Surendra Singh Lilhore commented on HDFS-7408: -- Attached initial patch based on [~atm]

[jira] [Commented] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740319#comment-14740319 ] Hadoop QA commented on HDFS-8829: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740264#comment-14740264 ] Hudson commented on HDFS-7314: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #356 (See

[jira] [Updated] (HDFS-7408) Add a counter in the log that shows the number of block reports processed

[ https://issues.apache.org/jira/browse/HDFS-7408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-7408: - Status: Patch Available (was: Open) > Add a counter in the log that shows the

[jira] [Commented] (HDFS-5795) RemoteBlockReader2#checkSuccess() shoud print error status

[ https://issues.apache.org/jira/browse/HDFS-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741076#comment-14741076 ] Xiao Chen commented on HDFS-5795: - Hi Brandon, Thank you for reporting this issue. I'll working on it

[jira] [Updated] (HDFS-9064) NN old UI (block_info_xml) not available in 2.7.x

[ https://issues.apache.org/jira/browse/HDFS-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-9064: - Description: In 2.6.x hadoop deploys, given a blockId it was very easy to find out the file name

[jira] [Updated] (HDFS-9022) Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9022: Status: Patch Available (was: Open) > Move NameNode.getAddress() and NameNode.getUri() to

[jira] [Commented] (HDFS-8953) DataNode Metrics logging

[ https://issues.apache.org/jira/browse/HDFS-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741110#comment-14741110 ] Hadoop QA commented on HDFS-8953: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-7986) Allow files / directories to be deleted from the NameNode UI

[ https://issues.apache.org/jira/browse/HDFS-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7986: --- Status: Patch Available (was: Open) > Allow files / directories to be deleted from the NameNode UI >

[jira] [Updated] (HDFS-7986) Allow files / directories to be deleted from the NameNode UI

[ https://issues.apache.org/jira/browse/HDFS-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7986: --- Attachment: HDFS-7986.01.patch Here's a patch which allows deleting of files and directories via the

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741329#comment-14741329 ] Vinayakumar B commented on HDFS-9038: - Thanks brahma for the options. #1 would be better IMO. >

[jira] [Commented] (HDFS-9008) Balancer#Parameters class could use a builder pattern

[ https://issues.apache.org/jira/browse/HDFS-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741262#comment-14741262 ] Chris Trezzo commented on HDFS-9008: Test failures are unrelated. The patch should be good to go. >

[jira] [Updated] (HDFS-9010) Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key

[ https://issues.apache.org/jira/browse/HDFS-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9010: Status: Patch Available (was: Open) > Replace NameNode.DEFAULT_PORT with >

[jira] [Updated] (HDFS-9010) Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key

[ https://issues.apache.org/jira/browse/HDFS-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9010: Status: Open (was: Patch Available) > Replace NameNode.DEFAULT_PORT with >

[jira] [Updated] (HDFS-9022) Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9022: Status: Open (was: Patch Available) > Move NameNode.getAddress() and NameNode.getUri() to

[jira] [Commented] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

[ https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741118#comment-14741118 ] Chris Nauroth commented on HDFS-9062: - Hi [~James Clampffer]. I'm curious if you've tried to get a

[jira] [Commented] (HDFS-9056) add set/remove quota capability to webhdfs

[ https://issues.apache.org/jira/browse/HDFS-9056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741228#comment-14741228 ] Surendra Singh Lilhore commented on HDFS-9056: -- Duplicate of HDFS-8631. > add set/remove

[jira] [Commented] (HDFS-9064) NN old UI (block_info_xml) not available in 2.7.x

[ https://issues.apache.org/jira/browse/HDFS-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741258#comment-14741258 ] Ravi Prakash commented on HDFS-9064: Thanks for reporting the issue Rushabh! Is this related to

[jira] [Commented] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

[ https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741286#comment-14741286 ] James Clampffer commented on HDFS-9062: --- Hi Chris, Thanks for the suggestions and usage examples.

[jira] [Updated] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9027: Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: (was: 2.8.0)

[jira] [Commented] (HDFS-9055) WebHDFS REST v2

[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741210#comment-14741210 ] Allen Wittenauer commented on HDFS-9055: bq. I would like work on this, please feel free to

[jira] [Assigned] (HDFS-9060) expose snapshotdiff via WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanaka Kumar Avvaru reassigned HDFS-9060: - Assignee: Kanaka Kumar Avvaru > expose snapshotdiff via WebHDFS >

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741256#comment-14741256 ] Arpit Agarwal commented on HDFS-6955: - Thanks for updating the patch. A few comments. # Nitpick: Please

[jira] [Commented] (HDFS-9055) WebHDFS REST v2

[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741088#comment-14741088 ] Chris Nauroth commented on HDFS-9055: - Hi [~aw]. AFAIK, the only proposed backwards-incompatible

[jira] [Created] (HDFS-9063) Correctly handle snapshot path for getContentSummary

Jing Zhao created HDFS-9063: --- Summary: Correctly handle snapshot path for getContentSummary Key: HDFS-9063 URL: https://issues.apache.org/jira/browse/HDFS-9063 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-9064) NN old UI (block_info_xml) not available in 2.7.x

Rushabh S Shah created HDFS-9064: Summary: NN old UI (block_info_xml) not available in 2.7.x Key: HDFS-9064 URL: https://issues.apache.org/jira/browse/HDFS-9064 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9043) Doc updation for commands in HDFS Federation

[ https://issues.apache.org/jira/browse/HDFS-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740451#comment-14740451 ] Hadoop QA commented on HDFS-9043: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9041) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740483#comment-14740483 ] Hadoop QA commented on HDFS-9041: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740370#comment-14740370 ] Yi Liu commented on HDFS-9053: -- Current patch only includes my implementation of B-Tree, I will post the patch

[jira] [Commented] (HDFS-7174) Support for more efficient large directories

[ https://issues.apache.org/jira/browse/HDFS-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740400#comment-14740400 ] Hadoop QA commented on HDFS-7174: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9042) Update document for the Storage policy name

[ https://issues.apache.org/jira/browse/HDFS-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-9042: - Attachment: HDFS-9042.1.patch Attached an initial patch. Please review. > Update document for the

[jira] [Updated] (HDFS-9042) Update document for the Storage policy name

[ https://issues.apache.org/jira/browse/HDFS-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-9042: - Status: Patch Available (was: Open) > Update document for the Storage policy name >

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740408#comment-14740408 ] Kai Sasaki commented on HDFS-8287: -- [~szetszwo] I cannot say thank you enough! I checked patch and passed

[jira] [Commented] (HDFS-8975) Erasure coding : Fix random failure in TestSafeModeWithStripedFile

[ https://issues.apache.org/jira/browse/HDFS-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740430#comment-14740430 ] J.Andreina commented on HDFS-8975: -- Failures are unrelated Please review. > Erasure coding : Fix random

[jira] [Updated] (HDFS-9054) Race condition on yieldCount in FSDirectory.java

[ https://issues.apache.org/jira/browse/HDFS-9054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-9054: --- Attachment: HDFS-9054.patch This patch use AtomicLong to prevent race condition. > Race condition on

[jira] [Commented] (HDFS-7408) Add a counter in the log that shows the number of block reports processed

[ https://issues.apache.org/jira/browse/HDFS-7408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740505#comment-14740505 ] Hadoop QA commented on HDFS-7408: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9053) Support large directories efficiently using B-Tree

[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9053: - Priority: Critical (was: Major) > Support large directories efficiently using B-Tree >

[jira] [Updated] (HDFS-9053) Support large directories efficiently using B-Tree

[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9053: - Attachment: HDFS-9053 (BTree).patch > Support large directories efficiently using B-Tree >

[jira] [Updated] (HDFS-9054) Race condition on yieldCount in FSDirectory.java

[ https://issues.apache.org/jira/browse/HDFS-9054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-9054: --- Affects Version/s: 2.7.0 Status: Patch Available (was: Open) > Race condition on

[jira] [Commented] (HDFS-8968) New benchmark throughput tool for striping erasure coding

[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740413#comment-14740413 ] Hadoop QA commented on HDFS-8968: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9042) Update document for the Storage policy name

[ https://issues.apache.org/jira/browse/HDFS-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740446#comment-14740446 ] Hadoop QA commented on HDFS-9042: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-9053) Support large directories efficiently using B-Tree

Yi Liu created HDFS-9053: Summary: Support large directories efficiently using B-Tree Key: HDFS-9053 URL: https://issues.apache.org/jira/browse/HDFS-9053 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-9054) Race condition on yieldCount in FSDirectory.java

zhaoyunjiong created HDFS-9054: -- Summary: Race condition on yieldCount in FSDirectory.java Key: HDFS-9054 URL: https://issues.apache.org/jira/browse/HDFS-9054 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8287: - Attachment: HDFS-8287-HDFS-7285.09.patch > DFSStripedOutputStream.writeChunk should not wait for writing

[jira] [Updated] (HDFS-9043) Doc updation for commands in HDFS Federation

[ https://issues.apache.org/jira/browse/HDFS-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-9043: - Attachment: HDFS-9043-branch-2-1.patch HDFS-9043-branch-2.7.0-1.patch

[jira] [Updated] (HDFS-9043) Doc updation for commands in HDFS Federation

[ https://issues.apache.org/jira/browse/HDFS-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-9043: - Status: Patch Available (was: Open) > Doc updation for commands in HDFS Federation >

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741365#comment-14741365 ] Kanaka Kumar Avvaru commented on HDFS-6955: --- Thanks for the review [~arpitagarwal] 1. Ok. fine

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741374#comment-14741374 ] Kanaka Kumar Avvaru commented on HDFS-6955: --- patch v8 address {{TestSpaceReservation}} test

[jira] [Updated] (HDFS-8873) throttle directoryScanner

[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Status: Patch Available (was: Open) > throttle directoryScanner > - >

[jira] [Updated] (HDFS-8099) Change "DFSInputStream has been closed already" message to debug log level

[ https://issues.apache.org/jira/browse/HDFS-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8099: - Fix Version/s: (was: 2.8.0) 2.7.2 > Change "DFSInputStream has been closed already"

[jira] [Commented] (HDFS-9055) WebHDFS REST v2

[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741337#comment-14741337 ] Haohui Mai commented on HDFS-9055: -- bq. Adding a third protocol which nothing really supports yet doesn't

[jira] [Commented] (HDFS-7986) Allow files / directories to be deleted from the NameNode UI

[ https://issues.apache.org/jira/browse/HDFS-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741350#comment-14741350 ] Hadoop QA commented on HDFS-7986: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8953) DataNode Metrics logging

[ https://issues.apache.org/jira/browse/HDFS-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741380#comment-14741380 ] Kanaka Kumar Avvaru commented on HDFS-8953: --- test failures doesn't seem to be related and check

[jira] [Commented] (HDFS-9040) Erasure coding: A BlockGroupDataStreamer to rule all internal blocks streamers

[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741388#comment-14741388 ] Jing Zhao commented on HDFS-9040: - Thanks for the patch, Walter! I think this looks much clearer compared

[jira] [Updated] (HDFS-8873) throttle directoryScanner

[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: HDFS-8873.001.patch Here's a patch to add a time-based throttle. The changes are

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741391#comment-14741391 ] Hudson commented on HDFS-9027: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #379 (See

[jira] [Updated] (HDFS-7767) Use the noredirect flag in WebHDFS to allow web browsers to upload files via the NN UI

[ https://issues.apache.org/jira/browse/HDFS-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7767: --- Attachment: HDFS-7767.01.patch Here's a patch which DOESN'T use the noredirect flag. I'm uploading it

[jira] [Comment Edited] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741447#comment-14741447 ] Colin Patrick McCabe edited comment on HDFS-8829 at 9/11/15 7:47 PM: -

[jira] [Commented] (HDFS-9008) Balancer#Parameters class could use a builder pattern

[ https://issues.apache.org/jira/browse/HDFS-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741460#comment-14741460 ] Ming Ma commented on HDFS-9008: --- +1 for the latest patch. [~szetszwo] do you have additional comments? >

[jira] [Commented] (HDFS-8099) Change "DFSInputStream has been closed already" message to debug log level

[ https://issues.apache.org/jira/browse/HDFS-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741528#comment-14741528 ] Kihwal Lee commented on HDFS-8099: -- The bug was introduced in 2.7.0. Cherry-picking this to 2.7.2. >

[jira] [Updated] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanaka Kumar Avvaru updated HDFS-6955: -- Attachment: HDFS-6955-08.patch > DN should reserve disk space for a full block when

[jira] [Commented] (HDFS-9055) WebHDFS REST v2

[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741427#comment-14741427 ] Allen Wittenauer commented on HDFS-9055: Also: https://github.com/grpc/grpc-common/issues/158

[jira] [Resolved] (HDFS-8952) InputStream.PositionRead() should be aware of available DNs

[ https://issues.apache.org/jira/browse/HDFS-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-8952. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-8707 Committed to the HDFS-8707

[jira] [Commented] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

[ https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741424#comment-14741424 ] Chris Nauroth commented on HDFS-9062: - Thanks for the additional details, James. I hadn't made the

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741436#comment-14741436 ] Hudson commented on HDFS-9027: -- FAILURE: Integrated in Hadoop-Yarn-trunk # (See

[jira] [Commented] (HDFS-9055) WebHDFS REST v2

[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741421#comment-14741421 ] Allen Wittenauer commented on HDFS-9055: bq. Can you show some numbers on what are the latencies on

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741443#comment-14741443 ] Hudson commented on HDFS-9027: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #373 (See

[jira] [Commented] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741447#comment-14741447 ] Colin Patrick McCabe commented on HDFS-8829: Thanks for working on this, [~He Tianyi]. +1. >

[jira] [Commented] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

[ https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741481#comment-14741481 ] James Clampffer commented on HDFS-9062: --- That's correct. Glad it sounds like a reasonable change. >

[jira] [Updated] (HDFS-9025) Fix compilation issues on arch linux

[ https://issues.apache.org/jira/browse/HDFS-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9025: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-8707 Target

[jira] [Created] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

Daniel Templeton created HDFS-9065: -- Summary: Include commas on # of files, blocks, total filesystem objects in NN Web UI Key: HDFS-9065 URL: https://issues.apache.org/jira/browse/HDFS-9065 Project:

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7285: Attachment: HDFS-7285-Consolidated-20150911.patch With HDFS-8833 committed, all remaining subtasks are about

[jira] [Updated] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9065: --- Attachment: HDFS-9065.001.patch > Include commas on # of files, blocks, total filesystem

[jira] [Updated] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9065: --- Status: Patch Available (was: Open) > Include commas on # of files, blocks, total filesystem

[jira] [Updated] (HDFS-8873) throttle directoryScanner

[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: HDFS-8873.001.patch Resolved some of the checkstyle issues. On the line too long

[jira] [Commented] (HDFS-8873) throttle directoryScanner

[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741591#comment-14741591 ] Hadoop QA commented on HDFS-8873: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8873) throttle directoryScanner

[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: (was: HDFS-8873.001.patch) > throttle directoryScanner >

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741539#comment-14741539 ] Hudson commented on HDFS-9027: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2298 (See

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741552#comment-14741552 ] Hudson commented on HDFS-9027: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2321 (See

[jira] [Commented] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741670#comment-14741670 ] Hadoop QA commented on HDFS-9065: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741694#comment-14741694 ] Hadoop QA commented on HDFS-6955: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8873) throttle directoryScanner

[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741622#comment-14741622 ] Colin Patrick McCabe commented on HDFS-8873: Good work, [~templedf]. {code} public static

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

Parser.py, > HDFS-7285-Consolidated-20150911.patch, HDFS-7285-initial-PoC.patch, > HDFS-7285-merge-consolidated-01.patch, > HDFS-7285-merge-consolidated-trunk-01.patch, > HDFS-7285-merge-consolidated.trunk.03.patch, > HDFS-7285-merge-consolidated.trunk.04.patch, > HDFS-EC-M

[jira] [Updated] (HDFS-8996) Consolidate validateLog and scanLog in FJM#EditLogFile

[ https://issues.apache.org/jira/browse/HDFS-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8996: Attachment: HDFS-8996.01.patch Thanks Colin. Updating the patch to eliminate {{validateLog}} and

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741571#comment-14741571 ] Hudson commented on HDFS-9027: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #359 (See

[jira] [Commented] (HDFS-8898) Create API and command-line argument to get quota without need to get file and directory counts

[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741632#comment-14741632 ] Joep Rottinghuis commented on HDFS-8898: So it sounds like we're discussing two things here: 1)

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

atch, Consolidated-20150806.patch, > Consolidated-20150810.patch, ECAnalyzer.py, ECParser.py, > HDFS-7285-Consolidated-20150911.patch, HDFS-7285-initial-PoC.patch, > HDFS-7285-merge-consolidated-01.patch, > HDFS-7285-merge-consolidated-trunk-01.patch, > HDFS-7285-merge-consolidated.trunk.03

[jira] [Commented] (HDFS-8874) Add DN metrics for balancer and other block movement scenarios

[ https://issues.apache.org/jira/browse/HDFS-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741711#comment-14741711 ] Ming Ma commented on HDFS-8874: --- Thanks [~ctrezzo]. * If the new {{receiveBlock}} returns false due to

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740524#comment-14740524 ] Hadoop QA commented on HDFS-8287: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9040) Erasure coding: A BlockGroupDataStreamer to rule all internal blocks streamers

[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9040: Attachment: HDFS-9040.00.patch DFSStripedOutputStream will get exception only when BGDataStreamer fails,

[jira] [Updated] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanaka Kumar Avvaru updated HDFS-6955: -- Attachment: HDFS-6955-07.patch > DN should reserve disk space for a full block when

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740814#comment-14740814 ] Yi Liu commented on HDFS-9053: -- *1. Performance* I choose 1024 as the B-Tree degree. For ArrayList in tests,

[jira] [Commented] (HDFS-8976) Create HTML5 cluster webconsole for federated cluster

[ https://issues.apache.org/jira/browse/HDFS-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740828#comment-14740828 ] Hadoop QA commented on HDFS-8976: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-8976) Create HTML5 cluster webconsole for federated cluster

[ https://issues.apache.org/jira/browse/HDFS-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8976: Attachment: HDFS-8976-03.patch Attaching the updated and complete patch. 1. Will use HTTPS urls if

[jira] [Commented] (HDFS-9042) Update document for the Storage policy name

[ https://issues.apache.org/jira/browse/HDFS-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740820#comment-14740820 ] Daniel Templeton commented on HDFS-9042: I don't see anywhere else where that typo pops up. Looks

[jira] [Updated] (HDFS-9053) Support large directories efficiently using B-Tree

[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9053: - Attachment: HDFS-9053 (BTree with simple benchmark).patch > Support large directories efficiently using B-Tree >

  1   2   >