[jira] [Commented] (HDFS-6475) WebHdfs clients fail without retry because incorrect handling of StandbyException

[ https://issues.apache.org/jira/browse/HDFS-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039327#comment-14039327 ] Daryn Sharp commented on HDFS-6475: --- What I'm saying is I think the patch adds too much

[jira] [Commented] (HDFS-6475) WebHdfs clients fail without retry because incorrect handling of StandbyException

[ https://issues.apache.org/jira/browse/HDFS-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039330#comment-14039330 ] Daryn Sharp commented on HDFS-6475: --- I'm +0 and defer to atm if the fix is harder than

[jira] [Commented] (HDFS-6562) Refactor rename() in FSDirectory

[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039426#comment-14039426 ] Daryn Sharp commented on HDFS-6562: --- Are you sure this can't be a

[jira] [Commented] (HDFS-6475) WebHdfs clients fail without retry because incorrect handling of StandbyException

[ https://issues.apache.org/jira/browse/HDFS-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040790#comment-14040790 ] Daryn Sharp commented on HDFS-6475: --- bq. Your earlier suggestion indicated that we should

[jira] [Commented] (HDFS-6585) INodesInPath.resolve is called multiple times in FSNamesystem.setPermission

[ https://issues.apache.org/jira/browse/HDFS-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040823#comment-14040823 ] Daryn Sharp commented on HDFS-6585: --- I've been working on the exact same change! Just to

[jira] [Commented] (HDFS-6525) FsShell supports HDFS TTL

[ https://issues.apache.org/jira/browse/HDFS-6525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040828#comment-14040828 ] Daryn Sharp commented on HDFS-6525: --- The test cases should verify that the inherited path

[jira] [Assigned] (HDFS-6599) 2.4 addBlock is 10 to 20 times slower compared to 0.23

[ https://issues.apache.org/jira/browse/HDFS-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp reassigned HDFS-6599: - Assignee: Daryn Sharp 2.4 addBlock is 10 to 20 times slower compared to 0.23

[jira] [Updated] (HDFS-6599) 2.4 addBlock is 10 to 20 times slower compared to 0.23

[ https://issues.apache.org/jira/browse/HDFS-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-6599: -- Status: Patch Available (was: Open) 2.4 addBlock is 10 to 20 times slower compared to 0.23

[jira] [Updated] (HDFS-6599) 2.4 addBlock is 10 to 20 times slower compared to 0.23

[ https://issues.apache.org/jira/browse/HDFS-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-6599: -- Attachment: HDFS-6599.patch The problem is that calls to {{DataNodeManager#getDatanodeListForReport}}

[jira] [Commented] (HDFS-6667) In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error

[ https://issues.apache.org/jira/browse/HDFS-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066385#comment-14066385 ] Daryn Sharp commented on HDFS-6667: --- [~jingzhao], I'm glancing at the patch. My time is

[jira] [Commented] (HDFS-6599) 2.4 addBlock is 10 to 20 times slower compared to 0.23

[ https://issues.apache.org/jira/browse/HDFS-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066610#comment-14066610 ] Daryn Sharp commented on HDFS-6599: --- Thanks Aaron, I'll check in shortly. Vinayakumar,

[jira] [Updated] (HDFS-6599) 2.4 addBlock is 10 to 20 times slower compared to 0.23

[ https://issues.apache.org/jira/browse/HDFS-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-6599: -- Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-6709) Implement off-heap data structures for NameNode and other HDFS memory optimization

[ https://issues.apache.org/jira/browse/HDFS-6709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071964#comment-14071964 ] Daryn Sharp commented on HDFS-6709: --- If {{Unsafe}} is being removed then I don't think we

[jira] [Commented] (HDFS-6709) Implement off-heap data structures for NameNode and other HDFS memory optimization

[ https://issues.apache.org/jira/browse/HDFS-6709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073404#comment-14073404 ] Daryn Sharp commented on HDFS-6709: --- Questions/comments on the advantages: * I thought

[jira] [Commented] (HDFS-6526) Implement HDFS TtlManager

[ https://issues.apache.org/jira/browse/HDFS-6526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073551#comment-14073551 ] Daryn Sharp commented on HDFS-6526: --- I see scalability and performance issues (maybe a

[jira] [Commented] (HDFS-6709) Implement off-heap data structures for NameNode and other HDFS memory optimization

[ https://issues.apache.org/jira/browse/HDFS-6709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075157#comment-14075157 ] Daryn Sharp commented on HDFS-6709: --- I sense a bit of condescension. We're all friends

[jira] [Commented] (HDFS-6709) Implement off-heap data structures for NameNode and other HDFS memory optimization

[ https://issues.apache.org/jira/browse/HDFS-6709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14076272#comment-14076272 ] Daryn Sharp commented on HDFS-6709: --- Yes, we definitely generate a lot of garbage per

[jira] [Created] (HDFS-6763) Standby NN stalls after processing edits

Daryn Sharp created HDFS-6763: - Summary: Standby NN stalls after processing edits Key: HDFS-6763 URL: https://issues.apache.org/jira/browse/HDFS-6763 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-6763) Standby NN stalls after processing edits

[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14076294#comment-14076294 ] Daryn Sharp commented on HDFS-6763: --- We're already seeing at least 6s hangs on some

[jira] [Created] (HDFS-6764) DN heartbeats may become clumped together

Daryn Sharp created HDFS-6764: - Summary: DN heartbeats may become clumped together Key: HDFS-6764 URL: https://issues.apache.org/jira/browse/HDFS-6764 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-6764) DN heartbeats may become clumped together

[ https://issues.apache.org/jira/browse/HDFS-6764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14076339#comment-14076339 ] Daryn Sharp commented on HDFS-6764: --- This was prominently observed on a HA standby due to

[jira] [Updated] (HDFS-6764) DN heartbeats may become clumped together

[ https://issues.apache.org/jira/browse/HDFS-6764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-6764: -- Attachment: Screen Shot 2014-07-28 at 11.12.06 AM.png Darker colors are the raw data of heartbeats per

[jira] [Commented] (HDFS-6754) TestNamenodeCapacityReport.testXceiverCount may sometimes fail due to lack of retry

[ https://issues.apache.org/jira/browse/HDFS-6754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14076795#comment-14076795 ] Daryn Sharp commented on HDFS-6754: --- +1 Will check in later this afternoon

[jira] [Commented] (HDFS-6765) Log INodeID instead of full path in edit log when closing a file

[ https://issues.apache.org/jira/browse/HDFS-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077708#comment-14077708 ] Daryn Sharp commented on HDFS-6765: --- Other than the inconsistency with other edit ops, is

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077726#comment-14077726 ] Daryn Sharp commented on HDFS-6757: --- I'm currently reviewing. Simplify lease manager

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077857#comment-14077857 ] Daryn Sharp commented on HDFS-6757: --- I like {{LeaseManager}} tracking inodes rather than

[jira] [Commented] (HDFS-6764) DN heartbeats may become clumped together

[ https://issues.apache.org/jira/browse/HDFS-6764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077877#comment-14077877 ] Daryn Sharp commented on HDFS-6764: --- Great minds think alike. Skipping missed intervals

[jira] [Commented] (HDFS-6763) Standby NN stalls after processing edits

[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077908#comment-14077908 ] Daryn Sharp commented on HDFS-6763: --- It appears to be an attempt to self-correct

[jira] [Commented] (HDFS-6765) Log INodeID instead of full path in edit log when closing a file

[ https://issues.apache.org/jira/browse/HDFS-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078277#comment-14078277 ] Daryn Sharp commented on HDFS-6765: --- My bad, I forgot 2.x was more FD-ish. I actually

[jira] [Created] (HDFS-6773) MiniDFSCluster can run dramatically faster

Daryn Sharp created HDFS-6773: - Summary: MiniDFSCluster can run dramatically faster Key: HDFS-6773 URL: https://issues.apache.org/jira/browse/HDFS-6773 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-6773) MiniDFSCluster can run dramatically faster

[ https://issues.apache.org/jira/browse/HDFS-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078460#comment-14078460 ] Daryn Sharp commented on HDFS-6773: --- The reason is every NN operation currently takes the

[jira] [Commented] (HDFS-6773) MiniDFSCluster can run dramatically faster

[ https://issues.apache.org/jira/browse/HDFS-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079327#comment-14079327 ] Daryn Sharp commented on HDFS-6773: --- Go right ahead! My cycles are extremely limited so

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083157#comment-14083157 ] Daryn Sharp commented on HDFS-6757: --- Trying to catch up... bq. I think it's fine to use

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084900#comment-14084900 ] Daryn Sharp commented on HDFS-6757: --- bq. Should successfully replaying OP_CLOSE require

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089247#comment-14089247 ] Daryn Sharp commented on HDFS-6776: --- Sorry, but this patch is completely wrong. # If

[jira] [Commented] (HDFS-6782) Improve FS editlog logSync

[ https://issues.apache.org/jira/browse/HDFS-6782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089402#comment-14089402 ] Daryn Sharp commented on HDFS-6782: --- Edit logging is pretty tricky. I need to think

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090740#comment-14090740 ] Daryn Sharp commented on HDFS-6826: --- I'm curious why standard permissions + ACLs are

[jira] [Commented] (HDFS-6659) Create a Block List

[ https://issues.apache.org/jira/browse/HDFS-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092871#comment-14092871 ] Daryn Sharp commented on HDFS-6659: --- I'd suggest trying to create a subclass of

[jira] [Commented] (HDFS-6660) Use int instead of object reference to DatanodeStorageInfo in BlockInfo triplets,

[ https://issues.apache.org/jira/browse/HDFS-6660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092874#comment-14092874 ] Daryn Sharp commented on HDFS-6660: --- As a safety precaution, is it possible to add at

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093045#comment-14093045 ] Daryn Sharp commented on HDFS-6826: --- I understand the motivation but there has to be a

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093239#comment-14093239 ] Daryn Sharp commented on HDFS-6826: --- It doesn't matter which or how many paths go through

[jira] [Commented] (HDFS-6840) Clients are always sent to the same datanode when read is off rack

[ https://issues.apache.org/jira/browse/HDFS-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094111#comment-14094111 ] Daryn Sharp commented on HDFS-6840: --- bq. My impression of the old pseudo-sort was that

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094130#comment-14094130 ] Daryn Sharp commented on HDFS-6826: --- The critical question is whether a NN backend should

[jira] [Commented] (HDFS-6840) Clients are always sent to the same datanode when read is off rack

[ https://issues.apache.org/jira/browse/HDFS-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095499#comment-14095499 ] Daryn Sharp commented on HDFS-6840: --- I'd like complete removal of the random seed. Why

[jira] [Commented] (HDFS-6840) Clients are always sent to the same datanode when read is off rack

[ https://issues.apache.org/jira/browse/HDFS-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095763#comment-14095763 ] Daryn Sharp commented on HDFS-6840: --- We believe but haven't proven that this

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095880#comment-14095880 ] Daryn Sharp commented on HDFS-6826: --- Arg, yesterday's jira issues apparently caused my

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096346#comment-14096346 ] Daryn Sharp commented on HDFS-6826: --- Haha, synchronous discussion - that made my day.

[jira] [Commented] (HDFS-6871) Improve NameNode performance when creating file

[ https://issues.apache.org/jira/browse/HDFS-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14103984#comment-14103984 ] Daryn Sharp commented on HDFS-6871: --- My only concern which I don't have cycles to

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109221#comment-14109221 ] Daryn Sharp commented on HDFS-6826: --- Sorry I disappeared, 2.x deployment issues are

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109744#comment-14109744 ] Daryn Sharp commented on HDFS-6826: --- My position is hdfs authz (user/group/ACLs) should

[jira] [Commented] (HDFS-6871) Improve NameNode performance when creating file

[ https://issues.apache.org/jira/browse/HDFS-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109776#comment-14109776 ] Daryn Sharp commented on HDFS-6871: --- Currently, when the write lock is released the

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109855#comment-14109855 ] Daryn Sharp commented on HDFS-6776: --- I've tried to quickly scan the discussion. I don't

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109891#comment-14109891 ] Daryn Sharp commented on HDFS-6826: --- bq. To do the chown it would require the

[jira] [Created] (HDFS-6948) DN rejects blocks if it has older UC block

Daryn Sharp created HDFS-6948: - Summary: DN rejects blocks if it has older UC block Key: HDFS-6948 URL: https://issues.apache.org/jira/browse/HDFS-6948 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-6964) NN fails to fix under replication leading to data loss

Daryn Sharp created HDFS-6964: - Summary: NN fails to fix under replication leading to data loss Key: HDFS-6964 URL: https://issues.apache.org/jira/browse/HDFS-6964 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6965) NN continues to issue block locations for DNs with full disks

Daryn Sharp created HDFS-6965: - Summary: NN continues to issue block locations for DNs with full disks Key: HDFS-6965 URL: https://issues.apache.org/jira/browse/HDFS-6965 Project: Hadoop HDFS

[jira] [Created] (HDFS-6967) DNs may OOM under high webhdfs load

Daryn Sharp created HDFS-6967: - Summary: DNs may OOM under high webhdfs load Key: HDFS-6967 URL: https://issues.apache.org/jira/browse/HDFS-6967 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6967) DNs may OOM under high webhdfs load

[ https://issues.apache.org/jira/browse/HDFS-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-6967: -- Assignee: Eric Payne DNs may OOM under high webhdfs load ---

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115247#comment-14115247 ] Daryn Sharp commented on HDFS-6826: --- I'm taking a look now. It appears much more

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115337#comment-14115337 ] Daryn Sharp commented on HDFS-6826: --- I'm tinkering with a patch that should provide a

[jira] [Commented] (HDFS-6967) DNs may OOM under high webhdfs load

[ https://issues.apache.org/jira/browse/HDFS-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121518#comment-14121518 ] Daryn Sharp commented on HDFS-6967: --- This is becoming a critical issue. Wide and/or many

[jira] [Commented] (HDFS-6967) DNs may OOM under high webhdfs load

[ https://issues.apache.org/jira/browse/HDFS-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122937#comment-14122937 ] Daryn Sharp commented on HDFS-6967: --- Popular in the sense that wide jobs needed access to

[jira] [Created] (HDFS-7005) DFS input streams do not timeout

Daryn Sharp created HDFS-7005: - Summary: DFS input streams do not timeout Key: HDFS-7005 URL: https://issues.apache.org/jira/browse/HDFS-7005 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-7005) DFS input streams do not timeout

[ https://issues.apache.org/jira/browse/HDFS-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7005: -- Status: Patch Available (was: Open) DFS input streams do not timeout

[jira] [Updated] (HDFS-7005) DFS input streams do not timeout

[ https://issues.apache.org/jira/browse/HDFS-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7005: -- Attachment: HDFS-7005.patch Simply set read timeout on the peer DFS input streams do not timeout

[jira] [Commented] (HDFS-6967) DNs may OOM under high webhdfs load

[ https://issues.apache.org/jira/browse/HDFS-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125836#comment-14125836 ] Daryn Sharp commented on HDFS-6967: --- [~cnauroth], I agree jetty should be upgraded but

[jira] [Commented] (HDFS-7005) DFS input streams do not timeout

[ https://issues.apache.org/jira/browse/HDFS-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125857#comment-14125857 ] Daryn Sharp commented on HDFS-7005: --- Test failure is unrelated, it's been failing for

[jira] [Commented] (HDFS-6948) DN rejects blocks if it has older UC block

[ https://issues.apache.org/jira/browse/HDFS-6948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127032#comment-14127032 ] Daryn Sharp commented on HDFS-6948: --- I think you should use instanceof to verify it's a

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127109#comment-14127109 ] Daryn Sharp commented on HDFS-6757: --- The patch doesn't appear to apply anymore.

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127116#comment-14127116 ] Daryn Sharp commented on HDFS-6776: --- Instead of an {{IOException}}, it should probably

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127120#comment-14127120 ] Daryn Sharp commented on HDFS-6826: --- Sorry, 2.5 issues diverted my attention. I should

[jira] [Commented] (HDFS-6967) DNs may OOM under high webhdfs load

[ https://issues.apache.org/jira/browse/HDFS-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127125#comment-14127125 ] Daryn Sharp commented on HDFS-6967: --- Ok, I'll clean up the internal patch and post a

[jira] [Commented] (HDFS-6660) Use int instead of object reference to DatanodeStorageInfo in BlockInfo triplets,

[ https://issues.apache.org/jira/browse/HDFS-6660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127142#comment-14127142 ] Daryn Sharp commented on HDFS-6660: --- I believe this is an intermediate step, but by

[jira] [Commented] (HDFS-6840) Clients are always sent to the same datanode when read is off rack

[ https://issues.apache.org/jira/browse/HDFS-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127156#comment-14127156 ] Daryn Sharp commented on HDFS-6840: --- In addition to Jason's comment, I'm mildly concerned

[jira] [Commented] (HDFS-6965) NN continues to issue block locations for DNs with full disks

[ https://issues.apache.org/jira/browse/HDFS-6965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127160#comment-14127160 ] Daryn Sharp commented on HDFS-6965: --- Simply changing {{node.getRemaining()}} to

[jira] [Created] (HDFS-7046) HA NN can NPE upon transition to active

Daryn Sharp created HDFS-7046: - Summary: HA NN can NPE upon transition to active Key: HDFS-7046 URL: https://issues.apache.org/jira/browse/HDFS-7046 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-7046) HA NN can NPE upon transition to active

[ https://issues.apache.org/jira/browse/HDFS-7046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14130072#comment-14130072 ] Daryn Sharp commented on HDFS-7046: --- Stack trace from an internal 2.5.1-ish build. Line

[jira] [Commented] (HDFS-7046) HA NN can NPE upon transition to active

[ https://issues.apache.org/jira/browse/HDFS-7046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14130107#comment-14130107 ] Daryn Sharp commented on HDFS-7046: --- I actually do not know when the issue was

[jira] [Commented] (HDFS-7046) HA NN can NPE upon transition to active

[ https://issues.apache.org/jira/browse/HDFS-7046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14130111#comment-14130111 ] Daryn Sharp commented on HDFS-7046: --- We've had 2 incidents. Both were delete ops. One

[jira] [Commented] (HDFS-6306) Standby NN can hold FSDirectory's writeLock for a long time under heavy load

[ https://issues.apache.org/jira/browse/HDFS-6306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14130325#comment-14130325 ] Daryn Sharp commented on HDFS-6306: --- I like both approaches. I think #1 might be easier.

[jira] [Commented] (HDFS-7046) HA NN can NPE upon transition to active

[ https://issues.apache.org/jira/browse/HDFS-7046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14130565#comment-14130565 ] Daryn Sharp commented on HDFS-7046: --- Looks like the incremental tracking of block that is

[jira] [Commented] (HDFS-5946) Webhdfs DN choosing code is flawed

[ https://issues.apache.org/jira/browse/HDFS-5946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14131627#comment-14131627 ] Daryn Sharp commented on HDFS-5946: --- HDFS-6967 is going to make node selection be rack

[jira] [Commented] (HDFS-2450) Only complete hostname is supported to access data via hdfs://

[ https://issues.apache.org/jira/browse/HDFS-2450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13273284#comment-13273284 ] Daryn Sharp commented on HDFS-2450: --- The actual code was brought into trunk quite a while

[jira] [Commented] (HDFS-3395) NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0

[ https://issues.apache.org/jira/browse/HDFS-3395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13273296#comment-13273296 ] Daryn Sharp commented on HDFS-3395: --- This really should have used

[jira] [Commented] (HDFS-3395) NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0

[ https://issues.apache.org/jira/browse/HDFS-3395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13273430#comment-13273430 ] Daryn Sharp commented on HDFS-3395: --- True, appending the port doesn't hurt anything. I

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13280185#comment-13280185 ] Daryn Sharp commented on HDFS-2956: --- I'll look into it. It's probably a 1-line fix.

[jira] [Assigned] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp reassigned HDFS-2956: - Assignee: Daryn Sharp calling fetchdt without a --renewer argument throws NPE

[jira] [Commented] (HDFS-2473) Fetching tokens from insecure cluster throws NPEs

[ https://issues.apache.org/jira/browse/HDFS-2473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13283419#comment-13283419 ] Daryn Sharp commented on HDFS-2473: --- Tom White recently added some really neat token

[jira] [Commented] (HDFS-2025) Go Back to File View link is not working in tail.jsp

[ https://issues.apache.org/jira/browse/HDFS-2025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13286577#comment-13286577 ] Daryn Sharp commented on HDFS-2025: --- The URL ctor doesn't throw an IOException, so is the

[jira] [Commented] (HDFS-3428) move DelegationTokenRenewer to common

[ https://issues.apache.org/jira/browse/HDFS-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13286828#comment-13286828 ] Daryn Sharp commented on HDFS-3428: --- To save me some effort, did you just copy the file

[jira] [Commented] (HDFS-3428) move DelegationTokenRenewer to common

[ https://issues.apache.org/jira/browse/HDFS-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13286842#comment-13286842 ] Daryn Sharp commented on HDFS-3428: --- +1 Thanks! move

[jira] [Commented] (HDFS-2025) Go Back to File View link is not working in tail.jsp

[ https://issues.apache.org/jira/browse/HDFS-2025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13287392#comment-13287392 ] Daryn Sharp commented on HDFS-2025: --- +1 Sorry, I assumed {{MalformedURLException}} was an

[jira] [Commented] (HDFS-3483) hdfs fsck doesn't run with ViewFS path

[ https://issues.apache.org/jira/browse/HDFS-3483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13287611#comment-13287611 ] Daryn Sharp commented on HDFS-3483: --- As you can tell by the hdfs command name, the

[jira] [Commented] (HDFS-3373) FileContext HDFS implementation can leak socket caches

[ https://issues.apache.org/jira/browse/HDFS-3373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13287722#comment-13287722 ] Daryn Sharp commented on HDFS-3373: --- On a related tangent, a similar situation causes the

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13287738#comment-13287738 ] Daryn Sharp commented on HDFS-2956: --- It's potentially more than a 1-liner. The NN used

[jira] [Commented] (HDFS-3483) hdfs fsck doesn't run with ViewFS path

[ https://issues.apache.org/jira/browse/HDFS-3483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13288538#comment-13288538 ] Daryn Sharp commented on HDFS-3483: --- If I'm understanding correctly, one issue with

[jira] [Commented] (HDFS-3113) httpfs does not support delegation tokens

[ https://issues.apache.org/jira/browse/HDFS-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13288665#comment-13288665 ] Daryn Sharp commented on HDFS-3113: --- Please give me a little time to review to ensure

[jira] [Commented] (HDFS-3483) hdfs fsck doesn't run with ViewFS path

[ https://issues.apache.org/jira/browse/HDFS-3483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13288716#comment-13288716 ] Daryn Sharp commented on HDFS-3483: --- Agreed it's nice to see the mounts, but that's what

[jira] [Commented] (HDFS-3508) avoid OOM while deserializing DelegationTokenIdentifer

[ https://issues.apache.org/jira/browse/HDFS-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13289641#comment-13289641 ] Daryn Sharp commented on HDFS-3508: --- I'd suggest naming {{Text.ONE_MEGABYTE}} something

[jira] [Commented] (HDFS-3508) avoid OOM while deserializing DelegationTokenIdentifer

[ https://issues.apache.org/jira/browse/HDFS-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13289720#comment-13289720 ] Daryn Sharp commented on HDFS-3508: --- I see. I agree it would be a good idea to move the

  1   2   3   4   5   6   7   8   9   10   >