[jira] [Commented] (HDFS-8836) Skip newline on empty files with getMerge -nl

[ https://issues.apache.org/jira/browse/HDFS-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900303#comment-14900303 ] Jan Filipiak commented on HDFS-8836: [~ajisakaa] Your approach is quite similliar to the one followed

[jira] [Commented] (HDFS-9107) Prevent NN's unrecoverable death spiral after full GC

[ https://issues.apache.org/jira/browse/HDFS-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900335#comment-14900335 ] Yi Liu commented on HDFS-9107: -- Thanks [~daryn], the issue seems critical. I have few comments: *1.* the

[jira] [Updated] (HDFS-9071) chooseTargets in ReplicationWork may pass incomplete srcPath

[ https://issues.apache.org/jira/browse/HDFS-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Tianyi updated HDFS-9071: Attachment: HDFS-9071.0001.patch Adds precondition to make sure {{chooseTargets}} receives either complete

[jira] [Commented] (HDFS-9107) Prevent NN's unrecoverable death spiral after full GC

[ https://issues.apache.org/jira/browse/HDFS-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900352#comment-14900352 ] Yi Liu commented on HDFS-9107: -- Sorry I just see Steve's comments. {quote} cores on different sockets may

[jira] [Comment Edited] (HDFS-9107) Prevent NN's unrecoverable death spiral after full GC

[ https://issues.apache.org/jira/browse/HDFS-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900352#comment-14900352 ] Yi Liu edited comment on HDFS-9107 at 9/21/15 8:08 AM: --- Sorry I just see Steve's

[jira] [Updated] (HDFS-9071) chooseTargets in ReplicationWork may pass incomplete srcPath

[ https://issues.apache.org/jira/browse/HDFS-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Tianyi updated HDFS-9071: Status: Patch Available (was: Open) > chooseTargets in ReplicationWork may pass incomplete srcPath >

[jira] [Commented] (HDFS-8920) Erasure Coding: when recovering lost blocks, logs can be too verbose and hurt performance

[ https://issues.apache.org/jira/browse/HDFS-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901975#comment-14901975 ] Kai Zheng commented on HDFS-8920: - Thanks Rui for the update. The new patch LGTM. +1 and will commit it

[jira] [Commented] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901597#comment-14901597 ] Haohui Mai commented on HDFS-9108: -- The root cause is that {{ReadBlockContinuation}} making a copy of a

[jira] [Commented] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901599#comment-14901599 ] Hadoop QA commented on HDFS-9108: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9112) Haadmin fails if multiple name service IDs are configured

[ https://issues.apache.org/jira/browse/HDFS-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901600#comment-14901600 ] Anu Engineer commented on HDFS-9112: [~jingzhao] Thanks for the pointer to the [~dlmarion] 's comments.

[jira] [Commented] (HDFS-9112) Haadmin fails if multiple name service IDs are configured

[ https://issues.apache.org/jira/browse/HDFS-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901613#comment-14901613 ] Jing Zhao commented on HDFS-9112: - Thanks for the clarification, [~anu]! I think for admin or other clients

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901614#comment-14901614 ] Haohui Mai commented on HDFS-9103: -- There are definitely use cases that need full flexible APIs (rigorous

[jira] [Updated] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9111: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9112) Haadmin fails if multiple name service IDs are configured

[ https://issues.apache.org/jira/browse/HDFS-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901935#comment-14901935 ] Anu Engineer commented on HDFS-9112: test failure is not related to the patch > Haadmin fails if

[jira] [Commented] (HDFS-8920) Erasure Coding: when recovering lost blocks, logs can be too verbose and hurt performance

[ https://issues.apache.org/jira/browse/HDFS-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901945#comment-14901945 ] Hadoop QA commented on HDFS-8920: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901886#comment-14901886 ] Hudson commented on HDFS-9111: -- FAILURE: Integrated in Hadoop-trunk-Commit #8497 (See

[jira] [Commented] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901928#comment-14901928 ] Hudson commented on HDFS-9111: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #421 (See

[jira] [Assigned] (HDFS-9064) NN old UI (block_info_xml) not available in 2.7.x

[ https://issues.apache.org/jira/browse/HDFS-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanaka Kumar Avvaru reassigned HDFS-9064: - Assignee: Kanaka Kumar Avvaru > NN old UI (block_info_xml) not available in 2.7.x

[jira] [Updated] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9108: - Summary: InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers (was: Pointer to read

[jira] [Commented] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901601#comment-14901601 ] Haohui Mai commented on HDFS-9108: -- I didn't check the assembly, but I'm surprised that running the

[jira] [Commented] (HDFS-9107) Prevent NN's unrecoverable death spiral after full GC

[ https://issues.apache.org/jira/browse/HDFS-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901673#comment-14901673 ] Hadoop QA commented on HDFS-9107: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9044) Give Priority to FavouredNodes , before selecting nodes from FavouredNode's Node Group

[ https://issues.apache.org/jira/browse/HDFS-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-9044: - Attachment: HDFS-9044.2.patch Updated the patch fixing the checkstyle and javadoc warnings. Testcase

[jira] [Commented] (HDFS-9046) Any Error during BPOfferService run can leads to Missing DN.

[ https://issues.apache.org/jira/browse/HDFS-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900496#comment-14900496 ] nijel commented on HDFS-9046: - bq.-1 hdfs tests 186m 23sTests failed in hadoop-hdfs. as per my

[jira] [Commented] (HDFS-9106) Transfer failure during pipeline recovery causes permanent write failures

[ https://issues.apache.org/jira/browse/HDFS-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900647#comment-14900647 ] Yi Liu commented on HDFS-9106: -- Thanks [~kihwal] for working on this. I have few comments: *1.* {code} +

[jira] [Commented] (HDFS-9071) chooseTargets in ReplicationWork may pass incomplete srcPath

[ https://issues.apache.org/jira/browse/HDFS-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900556#comment-14900556 ] Hadoop QA commented on HDFS-9071: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9109) dfs.datanode.dns.interface does not work with hosts file based setups

[ https://issues.apache.org/jira/browse/HDFS-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9109: Attachment: HDFS-9109.02.patch > dfs.datanode.dns.interface does not work with hosts file based

[jira] [Updated] (HDFS-9039) Split o.a.h.hdfs.NameNodeProxies class into two classes in hadoop-hdfs-client and hadoop-hdfs modules respectively

[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9039: Attachment: HDFS-9039.001.patch The v1 patch rebases from {{trunk}} branch. As we moved the

[jira] [Commented] (HDFS-9112) Haadmin fails if multiple name service IDs are configured

[ https://issues.apache.org/jira/browse/HDFS-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901549#comment-14901549 ] Jing Zhao commented on HDFS-9112: - We had a discussion in HDFS-6376 about this and [~dlmarion]'s point is

[jira] [Commented] (HDFS-8882) Use datablocks, parityblocks and cell size from ErasureCodingPolicy

[ https://issues.apache.org/jira/browse/HDFS-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901545#comment-14901545 ] Hadoop QA commented on HDFS-8882: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901630#comment-14901630 ] Haohui Mai commented on HDFS-9118: -- The interfaces of logging class are quite closed to the one used in

[jira] [Commented] (HDFS-9112) Haadmin fails if multiple name service IDs are configured

[ https://issues.apache.org/jira/browse/HDFS-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901650#comment-14901650 ] Hadoop QA commented on HDFS-9112: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8733) Keep server related definition in hdfs.proto on server side

[ https://issues.apache.org/jira/browse/HDFS-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8733: Component/s: (was: build) > Keep server related definition in hdfs.proto on server side >

[jira] [Updated] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9108: - Attachment: HDFS-9108.000.patch > InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901678#comment-14901678 ] Tsz Wo Nicholas Sze commented on HDFS-8287: --- > ... moving DoubleCellBuffer and CellBuffers out of

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901761#comment-14901761 ] Jing Zhao commented on HDFS-9053: - Thanks for the great work, Yi! So far I just reviewed the B-Tree

[jira] [Assigned] (HDFS-9108) Pointer to read buffer isn't being passed to recvmsg syscall

[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reassigned HDFS-9108: Assignee: Haohui Mai (was: James Clampffer) > Pointer to read buffer isn't being passed to recvmsg

[jira] [Assigned] (HDFS-8663) sys cpu usage high on namenode server

[ https://issues.apache.org/jira/browse/HDFS-8663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tangjunjie reassigned HDFS-8663: Assignee: Eugene Koifman > sys cpu usage high on namenode server >

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901722#comment-14901722 ] Haohui Mai commented on HDFS-9117: -- I suggest bringing in RapidXML (http://rapidxml.sourceforge.net/) to

[jira] [Commented] (HDFS-9109) dfs.datanode.dns.interface does not work with hosts file based setups

[ https://issues.apache.org/jira/browse/HDFS-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901799#comment-14901799 ] Hadoop QA commented on HDFS-9109: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9119) Discrepancy between edit log tailing interval and RPC timeout for transitionToActive

[ https://issues.apache.org/jira/browse/HDFS-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901534#comment-14901534 ] Zhe Zhang commented on HDFS-9119: - We have a few options to fix the discrepancy: # Shorten the edit log

[jira] [Updated] (HDFS-9116) Suppress false positives from Valgrind on uninitialized variables in tests

[ https://issues.apache.org/jira/browse/HDFS-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9116: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-8707 Target

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client

[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901642#comment-14901642 ] Tsz Wo Nicholas Sze commented on HDFS-7858: --- > ... then those clients might not get a response

[jira] [Updated] (HDFS-8920) Erasure Coding: when recovering lost blocks, logs can be too verbose and hurt performance

[ https://issues.apache.org/jira/browse/HDFS-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HDFS-8920: - Attachment: HDFS-8920-HDFS-7285.2.patch Address Kai's comments offline. > Erasure Coding: when recovering lost

[jira] [Updated] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9108: - Attachment: (was: HDFS-9108.000.patch) > InputStreamImpl::ReadBlockContinuation stores wrong pointers

[jira] [Updated] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9108: - Status: Patch Available (was: In Progress) > InputStreamImpl::ReadBlockContinuation stores wrong pointers

[jira] [Updated] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9108: - Attachment: HDFS-9108.000.patch > InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

[jira] [Commented] (HDFS-9026) Support for include/exclude lists on IPv6 setup

[ https://issues.apache.org/jira/browse/HDFS-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901745#comment-14901745 ] Hadoop QA commented on HDFS-9026: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8733) Keep server related definition in hdfs.proto on server side

[ https://issues.apache.org/jira/browse/HDFS-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8733: Status: Patch Available (was: Open) > Keep server related definition in hdfs.proto on server side >

[jira] [Updated] (HDFS-8733) Keep server related definition in hdfs.proto on server side

[ https://issues.apache.org/jira/browse/HDFS-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8733: Attachment: HFDS-8733.000.patch > Keep server related definition in hdfs.proto on server side >

[jira] [Updated] (HDFS-9112) Haadmin fails if multiple name service IDs are configured

[ https://issues.apache.org/jira/browse/HDFS-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9112: --- Attachment: HDFS-9112.002.patch Based on [~jingzhao] comments, this change makes the error message

[jira] [Updated] (HDFS-8663) sys cpu usage high on namenode server

[ https://issues.apache.org/jira/browse/HDFS-8663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HDFS-8663: - Assignee: (was: Eugene Koifman) > sys cpu usage high on namenode server >

[jira] [Commented] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901756#comment-14901756 ] Hadoop QA commented on HDFS-9111: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901808#comment-14901808 ] Yi Liu commented on HDFS-9053: -- Thanks a lot for your review and spend lots of time on this, Jing! I will

[jira] [Assigned] (HDFS-9119) Discrepancy between edit log tailing interval and RPC timeout for transitionToActive

[ https://issues.apache.org/jira/browse/HDFS-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reassigned HDFS-9119: --- Assignee: Zhe Zhang > Discrepancy between edit log tailing interval and RPC timeout for >

[jira] [Created] (HDFS-9119) Discrepancy between edit log tailing interval and RPC timeout for transitionToActive

Zhe Zhang created HDFS-9119: --- Summary: Discrepancy between edit log tailing interval and RPC timeout for transitionToActive Key: HDFS-9119 URL: https://issues.apache.org/jira/browse/HDFS-9119 Project:

[jira] [Commented] (HDFS-9112) Haadmin fails if multiple name service IDs are configured

[ https://issues.apache.org/jira/browse/HDFS-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901910#comment-14901910 ] Hadoop QA commented on HDFS-9112: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9108) Pointer to read buffer isn't being passed to recvmsg syscall

[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9108: -- Summary: Pointer to read buffer isn't being passed to recvmsg syscall (was: Pointer to read

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900739#comment-14900739 ] Bob Hansen commented on HDFS-9103: -- I think it is important to have a high-level C++ "go read this data"

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900775#comment-14900775 ] Bob Hansen commented on HDFS-9103: -- Submitted a new patch restoring the excluded_datanodes to the

[jira] [Commented] (HDFS-9107) Prevent NN's unrecoverable death spiral after full GC

[ https://issues.apache.org/jira/browse/HDFS-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900820#comment-14900820 ] Daryn Sharp commented on HDFS-9107: --- [~hitliuyi], good points. # Trust me, it's more than possible for a

[jira] [Updated] (HDFS-9108) Pointer to read buffer isn't being passed to recvmsg syscall

[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9108: -- Attachment: 9108-async-repro.patch1 Attached a reproducer with a temporary bandaid fix for the

[jira] [Commented] (HDFS-8880) NameNode metrics logging

[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900911#comment-14900911 ] Allen Wittenauer commented on HDFS-8880: Isn't this effectively the same as using the file-based

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900978#comment-14900978 ] Brahma Reddy Battula commented on HDFS-8647: [~mingma] any thoughts on this issue..? >

[jira] [Commented] (HDFS-9093) Initialize protobuf fields in RemoteBlockReaderTest

[ https://issues.apache.org/jira/browse/HDFS-9093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900983#comment-14900983 ] Bob Hansen commented on HDFS-9093: -- Looks good. +1 > Initialize protobuf fields in RemoteBlockReaderTest

[jira] [Commented] (HDFS-9095) RPC client should fail gracefully when the connection is timed out or reset

[ https://issues.apache.org/jira/browse/HDFS-9095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901053#comment-14901053 ] Haohui Mai commented on HDFS-9095: -- bq. You may want to use CMAKE_CURRENT_LIST_DIR rather than

[jira] [Updated] (HDFS-9093) Initialize protobuf fields in RemoteBlockReaderTest

[ https://issues.apache.org/jira/browse/HDFS-9093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9093: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-8707 Target

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901077#comment-14901077 ] Haohui Mai commented on HDFS-9103: -- bq. I think it is important to have a high-level C++ "go read this

[jira] [Updated] (HDFS-9109) dfs.datanode.dns.interface does not work with hosts file based setups

[ https://issues.apache.org/jira/browse/HDFS-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9109: Attachment: (was: HDFS-9109.01.patch) > dfs.datanode.dns.interface does not work with hosts file

[jira] [Commented] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901118#comment-14901118 ] Haohui Mai commented on HDFS-9111: -- +1. I'll commit it shortly. > Move hdfs-client protobuf convert

[jira] [Commented] (HDFS-9040) Erasure coding: Refactor DFSStripedOutputStream (Move Namenode RPC Requests to Coordinator)

[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901080#comment-14901080 ] Zhe Zhang commented on HDFS-9040: - bq. but we dont know if idx 6~8 are permanent lost or delayed.

[jira] [Created] (HDFS-9115) Create documentation to describe the overall architecture and rationales of the library

Haohui Mai created HDFS-9115: Summary: Create documentation to describe the overall architecture and rationales of the library Key: HDFS-9115 URL: https://issues.apache.org/jira/browse/HDFS-9115 Project:

[jira] [Updated] (HDFS-9109) dfs.datanode.dns.interface does not work with hosts file based setups

[ https://issues.apache.org/jira/browse/HDFS-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9109: Attachment: HDFS-9109.01.patch > dfs.datanode.dns.interface does not work with hosts file based

[jira] [Commented] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901121#comment-14901121 ] Haohui Mai commented on HDFS-9111: -- Turns out it's needs to be rebased to trunk. [~liuml07] can you please

[jira] [Commented] (HDFS-9095) RPC client should fail gracefully when the connection is timed out or reset

[ https://issues.apache.org/jira/browse/HDFS-9095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900971#comment-14900971 ] Bob Hansen commented on HDFS-9095: -- You may want to use CMAKE_CURRENT_LIST_DIR rather than

[jira] [Commented] (HDFS-9040) Erasure coding: Refactor DFSStripedOutputStream (Move Namenode RPC Requests to Coordinator)

[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900536#comment-14900536 ] Walter Su commented on HDFS-9040: - bq. 5. Another issue is, when NN restarts and receives block reports

[jira] [Commented] (HDFS-9040) Erasure coding: Refactor DFSStripedOutputStream (Move Namenode RPC Requests to Coordinator)

[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900554#comment-14900554 ] Walter Su commented on HDFS-9040: - If it's a "append()" recovery, of course we should NOT truncate any

[jira] [Updated] (HDFS-9110) Improve upon HDFS-8480

[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charlie Helin updated HDFS-9110: Status: Patch Available (was: In Progress) > Improve upon HDFS-8480 > -- > >

[jira] [Updated] (HDFS-9110) Improve upon HDFS-8480

[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charlie Helin updated HDFS-9110: Attachment: HDFS-9110.02.patch No changes, but prior build seems off. > Improve upon HDFS-8480 >

[jira] [Updated] (HDFS-9110) Improve upon HDFS-8480

[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charlie Helin updated HDFS-9110: Status: In Progress (was: Patch Available) > Improve upon HDFS-8480 > -- > >

[jira] [Updated] (HDFS-9103) Retry reads on DN failure

[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9103: - Attachment: HDFS-9103.2.patch > Retry reads on DN failure > - > >

[jira] [Updated] (HDFS-9103) Retry reads on DN failure

[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9103: - Fix Version/s: HDFS-8707 > Retry reads on DN failure > - > > Key:

[jira] [Commented] (HDFS-9044) Give Priority to FavouredNodes , before selecting nodes from FavouredNode's Node Group

[ https://issues.apache.org/jira/browse/HDFS-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900780#comment-14900780 ] Hadoop QA commented on HDFS-9044: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900786#comment-14900786 ] Hadoop QA commented on HDFS-9103: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8882) Use datablocks, parityblocks and cell size from ErasureCodingPolicy

[ https://issues.apache.org/jira/browse/HDFS-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901306#comment-14901306 ] Zhe Zhang commented on HDFS-8882: - Thanks Vinay for the patch. It looks good overall. A couple of comments:

[jira] [Created] (HDFS-9118) Add logging system for libdhfs++

Bob Hansen created HDFS-9118: Summary: Add logging system for libdhfs++ Key: HDFS-9118 URL: https://issues.apache.org/jira/browse/HDFS-9118 Project: Hadoop HDFS Issue Type: Sub-task Affects

[jira] [Updated] (HDFS-9107) Prevent NN's unrecoverable death spiral after full GC

[ https://issues.apache.org/jira/browse/HDFS-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-9107: -- Attachment: HDFS-9107.patch Use a stopwatch to abort processing in the inner heartbeat checking loop,

[jira] [Updated] (HDFS-9091) Erasure Coding: Provide DistributedFilesystem API to getAllErasureCodingPolicies

[ https://issues.apache.org/jira/browse/HDFS-9091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9091: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Status: Resolved

[jira] [Commented] (HDFS-8632) Erasure Coding: Add InterfaceAudience annotation to the erasure coding classes

[ https://issues.apache.org/jira/browse/HDFS-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901250#comment-14901250 ] Andrew Wang commented on HDFS-8632: --- Private APIs don't need stability annotations, we're free to change

[jira] [Commented] (HDFS-9095) RPC client should fail gracefully when the connection is timed out or reset

[ https://issues.apache.org/jira/browse/HDFS-9095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901293#comment-14901293 ] James Clampffer commented on HDFS-9095: --- Agree with bob about making the CMakeLists as robust as

[jira] [Created] (HDFS-9117) Config file reader / options classes for libhdfs++

Bob Hansen created HDFS-9117: Summary: Config file reader / options classes for libhdfs++ Key: HDFS-9117 URL: https://issues.apache.org/jira/browse/HDFS-9117 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9095) RPC client should fail gracefully when the connection is timed out or reset

[ https://issues.apache.org/jira/browse/HDFS-9095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901244#comment-14901244 ] Bob Hansen commented on HDFS-9095: -- Re: CMAKE_CURRENT_LIST_DIR vs. CMAKE_CURRENT_SRC_DIR: According to ye

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901284#comment-14901284 ] Bob Hansen commented on HDFS-8855: -- There are two separable issues; this is a performance bug in existing

[jira] [Commented] (HDFS-8873) throttle directoryScanner

[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901285#comment-14901285 ] Colin Patrick McCabe commented on HDFS-8873: [~nroberts], I agree that it might be better to

[jira] [Updated] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9111: Attachment: HDFS-9111.002.patch Thank you [~wheat9]. The v2 patch rebases from {{trunk}} branch

[jira] [Resolved] (HDFS-5897) TestNNWithQJM#testNewNamenodeTakesOverWriter occasionally fails in trunk

[ https://issues.apache.org/jira/browse/HDFS-5897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-5897. -- Resolution: Cannot Reproduce > TestNNWithQJM#testNewNamenodeTakesOverWriter occasionally fails in trunk >

[jira] [Commented] (HDFS-9110) Improve upon HDFS-8480

[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901175#comment-14901175 ] Hadoop QA commented on HDFS-9110: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9108) Pointer to read buffer isn't being passed to recvmsg syscall

[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9108: -- Priority: Blocker (was: Major) > Pointer to read buffer isn't being passed to recvmsg syscall >

[jira] [Updated] (HDFS-9112) Haadmin fails if multiple name service IDs are configured

[ https://issues.apache.org/jira/browse/HDFS-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9112: --- Status: Patch Available (was: Open) > Haadmin fails if multiple name service IDs are configured >

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901200#comment-14901200 ] Haohui Mai commented on HDFS-8855: -- Revisiting the use case -- how much benefits are we getting from the

[jira] [Updated] (HDFS-9112) Haadmin fails if multiple name service IDs are configured

[ https://issues.apache.org/jira/browse/HDFS-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9112: --- Attachment: HDFS-9112.001.patch [~atm] Thanks for letting me know. [~templedf] I would appreciate if

  1   2   >