[jira] [Commented] (HDFS-7068) Support multiple block placement policies

[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356904#comment-14356904 ] Kai Zheng commented on HDFS-7068: - Thanks all for the good discussion here. We had an

[jira] [Commented] (HDFS-7846) Create off-heap BlocksMap and BlockData structures

[ https://issues.apache.org/jira/browse/HDFS-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355210#comment-14355210 ] Charles Lamb commented on HDFS-7846: Colin, this looks pretty good. A few questions and

[jira] [Commented] (HDFS-7846) Create off-heap BlocksMap and BlockData structures

[ https://issues.apache.org/jira/browse/HDFS-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355217#comment-14355217 ] Charles Lamb commented on HDFS-7846: Oh, I forgot to mention there are three places

[jira] [Commented] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357143#comment-14357143 ] Tsuyoshi Ozawa commented on HDFS-6833: -- [~szetszwo] could you commit this?

[jira] [Updated] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7898: Affects Version/s: 2.7.0 Change TestAppendSnapshotTruncate to fail-fast

[jira] [Commented] (HDFS-7068) Support multiple block placement policies

[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355309#comment-14355309 ] Zhe Zhang commented on HDFS-7068: - Thanks Walter for digging deeper on this. I currently

[jira] [Updated] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7830: Attachment: HDFS-7830.003.patch [~cmccabe] Thanks a lot for your review and inputs. I updated the

[jira] [Assigned] (HDFS-7617) Add editlog transactions for EC

[ https://issues.apache.org/jira/browse/HDFS-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Zheng reassigned HDFS-7617: --- Assignee: Hui Zheng (was: Hui Zheng) Add editlog transactions for EC

[jira] [Updated] (HDFS-7369) Erasure coding: distribute block recovery work to DataNode

[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7369: Attachment: (was: HDFS-7396-000.patch) Erasure coding: distribute block recovery work to DataNode

[jira] [Commented] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356652#comment-14356652 ] Vinayakumar B commented on HDFS-5356: - bq. For me all tests in TestRenameWithSnapshots

[jira] [Commented] (HDFS-7881) TestHftpFileSystem#testSeek fails in branch-2

[ https://issues.apache.org/jira/browse/HDFS-7881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358303#comment-14358303 ] Brahma Reddy Battula commented on HDFS-7881: Thanks [~ajisakaa] for response..

[jira] [Commented] (HDFS-7068) Support multiple block placement policies

[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356926#comment-14356926 ] Kai Zheng commented on HDFS-7068: - Looking at your 3 options, I'm wondering if we could do

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356932#comment-14356932 ] Kai Zheng commented on HDFS-7285: - Thanks [~walter.k.su] for raising the issue. I just

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358357#comment-14358357 ] Li Bo commented on HDFS-7854: - hi, Jing we may encounter some problems in your way of handling

[jira] [Assigned] (HDFS-7519) Support for a Reconfigurable NameNode

[ https://issues.apache.org/jira/browse/HDFS-7519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned HDFS-7519: - Assignee: Arun Suresh Support for a Reconfigurable NameNode

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358368#comment-14358368 ] Li Bo commented on HDFS-7854: - If we want dataQueue in DataStreamer, we can provide

[jira] [Updated] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

[ https://issues.apache.org/jira/browse/HDFS-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7913: --- Attachment: HDFS-7913-01.patch -01: full list HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in

[jira] [Commented] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

[ https://issues.apache.org/jira/browse/HDFS-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357336#comment-14357336 ] Brahma Reddy Battula commented on HDFS-7913: Thanks for update, one more query

[jira] [Updated] (HDFS-7491) Add incremental blockreport latency to DN metrics

[ https://issues.apache.org/jira/browse/HDFS-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7491: -- Attachment: HDFS-7491-4.patch Thanks Xiaoyu for suggestion. Here is the updated patch. Chris, given

[jira] [Commented] (HDFS-7827) Erasure Coding: support striped blocks in non-protobuf fsimage

[ https://issues.apache.org/jira/browse/HDFS-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358398#comment-14358398 ] Hui Zheng commented on HDFS-7827: - Hi Jing I made a mistake and found that the INodeFile

[jira] [Commented] (HDFS-7068) Support multiple block placement policies

[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358492#comment-14358492 ] Walter Su commented on HDFS-7068: - Thanks [~drankye] for enlightening me on the difference

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357672#comment-14357672 ] Charles Lamb commented on HDFS-6658: Hi [~daryn], Colin and I read over the design

[jira] [Commented] (HDFS-7891) a block placement policy with best fault tolerance

[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358518#comment-14358518 ] Walter Su commented on HDFS-7891: - Thanks for noticing. BlockPlacementPolicyDefault already

[jira] [Commented] (HDFS-7491) Add incremental blockreport latency to DN metrics

[ https://issues.apache.org/jira/browse/HDFS-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358537#comment-14358537 ] Hudson commented on HDFS-7491: -- FAILURE: Integrated in Hadoop-Yarn-trunk #864 (See

[jira] [Commented] (HDFS-7873) OIV webhdfs premature close channel issue

[ https://issues.apache.org/jira/browse/HDFS-7873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358592#comment-14358592 ] Benoit Perroud commented on HDFS-7873: -- When a folder contains a lot of files, the

[jira] [Updated] (HDFS-7873) OIV webhdfs premature close channel issue

[ https://issues.apache.org/jira/browse/HDFS-7873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Perroud updated HDFS-7873: - Attachment: HDFS-7873-v3.txt OIV webhdfs premature close channel issue

[jira] [Commented] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358717#comment-14358717 ] Kihwal Lee commented on HDFS-7587: -- It is still valid. We will get to it today. Edit log

[jira] [Commented] (HDFS-7491) Add incremental blockreport latency to DN metrics

[ https://issues.apache.org/jira/browse/HDFS-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358754#comment-14358754 ] Hudson commented on HDFS-7491: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #121 (See

[jira] [Commented] (HDFS-7491) Add incremental blockreport latency to DN metrics

[ https://issues.apache.org/jira/browse/HDFS-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358736#comment-14358736 ] Hudson commented on HDFS-7491: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2062 (See

[jira] [Updated] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7926: -- Status: Patch Available (was: Open) NameNode implementation of

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359825#comment-14359825 ] Kai Zheng commented on HDFS-7337: - Thanks [~zhz] for the review and thoughts.

[jira] [Resolved] (HDFS-7925) truncate RPC should not be considered as idempotent

[ https://issues.apache.org/jira/browse/HDFS-7925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey resolved HDFS-7925. Resolution: Duplicate Duplicate of HDFS-7926 truncate RPC should not be considered

[jira] [Commented] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359854#comment-14359854 ] Yi Liu commented on HDFS-7926: -- Hi Nicholas, the patch is not for this JIRA, can you check?

[jira] [Updated] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7854: Attachment: HDFS-7854-004.patch Separate class DataStreamer out of DFSOutputStream

[jira] [Assigned] (HDFS-7849) Update documentation for enabling a new feature in rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reassigned HDFS-7849: - Assignee: J.Andreina (was: Tsz Wo Nicholas Sze) Sure, thanks a lot! Update

[jira] [Updated] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7926: -- Attachment: h7926_20150313.patch h7926_20150313.patch: implements #2. Will add a test.

[jira] [Assigned] (HDFS-7924) NameNode goes into infinite lease recovery

[ https://issues.apache.org/jira/browse/HDFS-7924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu reassigned HDFS-7924: Assignee: Yi Liu NameNode goes into infinite lease recovery --

[jira] [Commented] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359966#comment-14359966 ] Jitendra Nath Pandey commented on HDFS-7926: [~szetszwo], I think the patch

[jira] [Updated] (HDFS-7849) Update documentation for enabling a new feature in rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-7849: - Attachment: HDFS-7849.1.patch Hi Tsz Wo Nicholas Sze, If you have not started working on this , can i

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359911#comment-14359911 ] Hadoop QA commented on HDFS-7886: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359975#comment-14359975 ] Hadoop QA commented on HDFS-7926: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7921) FileSystem listFiles doesn't list the directories if recursive is false

[ https://issues.apache.org/jira/browse/HDFS-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359974#comment-14359974 ] Yi Liu commented on HDFS-7921: -- {quote} Is this the intended behavior? It is weird just to

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359810#comment-14359810 ] Yi Liu commented on HDFS-7886: -- Konst, the patch looks good to me, just one nit: In

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359944#comment-14359944 ] Plamen Jeliazkov commented on HDFS-7886: Konstantin I ran your patch locally

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359919#comment-14359919 ] Yongjun Zhang commented on HDFS-7915: - HI Colin, Nice find of the new problem! I did

[jira] [Commented] (HDFS-7835) make initial sleeptime in locateFollowingBlock configurable for DFSClient.

[ https://issues.apache.org/jira/browse/HDFS-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359951#comment-14359951 ] Hadoop QA commented on HDFS-7835: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7491) Add incremental blockreport latency to DN metrics

[ https://issues.apache.org/jira/browse/HDFS-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358832#comment-14358832 ] Hudson commented on HDFS-7491: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #130 (See

[jira] [Assigned] (HDFS-7068) Support multiple block placement policies

[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-7068: --- Assignee: Arpit Agarwal (was: Walter Su) Support multiple block placement policies

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358907#comment-14358907 ] Allen Wittenauer commented on HDFS-5796: Hmm. I'm actually not certain we can use

[jira] [Updated] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7811: - Attachment: HDFS-7811.00.patch Post the patch that avoids recursive getStoragePolicyID call for directory

[jira] [Commented] (HDFS-7491) Add incremental blockreport latency to DN metrics

[ https://issues.apache.org/jira/browse/HDFS-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358885#comment-14358885 ] Hudson commented on HDFS-7491: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2080 (See

[jira] [Created] (HDFS-7920) FIx WebHDFS AuthFilter to use DelegationTokenAuthenticationFilter

Arun Suresh created HDFS-7920: - Summary: FIx WebHDFS AuthFilter to use DelegationTokenAuthenticationFilter Key: HDFS-7920 URL: https://issues.apache.org/jira/browse/HDFS-7920 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358930#comment-14358930 ] Arun Suresh commented on HDFS-5796: --- [~aw], I just updated HADOOP-11702 to remove the

[jira] [Updated] (HDFS-7068) Support multiple block placement policies

[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7068: Assignee: Walter Su (was: Arpit Agarwal) Support multiple block placement policies

[jira] [Updated] (HDFS-7919) Time.NANOSECONDS_PER_MILLISECOND - use class level final constant instead of method variable

[ https://issues.apache.org/jira/browse/HDFS-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HDFS-7919: -- Labels: beginner (was: ) Time.NANOSECONDS_PER_MILLISECOND - use class level final constant instead of

[jira] [Commented] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358961#comment-14358961 ] Hadoop QA commented on HDFS-7811: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7911) Buffer Overflow when running HBase on HDFS Encryption Zone

[ https://issues.apache.org/jira/browse/HDFS-7911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358951#comment-14358951 ] Sean Busbey commented on HDFS-7911: --- We should take a more general fix and instead move

[jira] [Updated] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7811: - Status: Patch Available (was: Open) Avoid recursive call getStoragePolicyID in

[jira] [Commented] (HDFS-7918) Clean up unused code for old web UI in branch-2

[ https://issues.apache.org/jira/browse/HDFS-7918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359050#comment-14359050 ] Haohui Mai commented on HDFS-7918: -- +1. I'll commit it shortly. Clean up unused code for

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358946#comment-14358946 ] Allen Wittenauer commented on HDFS-5796: I thought SignerSecretProvider injected

[jira] [Commented] (HDFS-7918) Clean up unused code for old web UI in branch-2

[ https://issues.apache.org/jira/browse/HDFS-7918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359057#comment-14359057 ] Haohui Mai commented on HDFS-7918: -- The patch no longer applies on branch-2.

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358978#comment-14358978 ] Arun Suresh commented on HDFS-5796: --- Correct me if im wrong, but, I dont think the

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359021#comment-14359021 ] Daryn Sharp commented on HDFS-6658: --- I should mention I'll split this patch into as many

[jira] [Updated] (HDFS-7435) PB encoding of block reports is very inefficient

[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7435: -- Attachment: HDFS-7435.patch Done! Thanks Jing. PB encoding of block reports is very inefficient

[jira] [Commented] (HDFS-7007) Interfaces to plugin ConsensusNode.

[ https://issues.apache.org/jira/browse/HDFS-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359033#comment-14359033 ] Konstantin Boudnik commented on HDFS-7007: -- Actually, I like #5 quite a bit: it

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359031#comment-14359031 ] Hadoop QA commented on HDFS-7435: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359138#comment-14359138 ] Hudson commented on HDFS-6833: -- FAILURE: Integrated in Hadoop-trunk-Commit #7310 (See

[jira] [Updated] (HDFS-7922) ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors

[ https://issues.apache.org/jira/browse/HDFS-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7922: --- Attachment: 001-HDFS-7922.patch ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors

[jira] [Commented] (HDFS-7433) Optimize performance of DatanodeManager's node map

[ https://issues.apache.org/jira/browse/HDFS-7433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359338#comment-14359338 ] Hadoop QA commented on HDFS-7433: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359352#comment-14359352 ] Arpit Agarwal commented on HDFS-: - +1 from me too. In the spirit of reducing

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359378#comment-14359378 ] Hadoop QA commented on HDFS-7915: - {color:red}-1 overall{color}. Here are the results of

[jira] [Assigned] (HDFS-7816) Unable to open webhdfs paths with +

[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reassigned HDFS-7816: Assignee: Haohui Mai (was: Kihwal Lee) Unable to open webhdfs paths with +

[jira] [Updated] (HDFS-7816) Unable to open webhdfs paths with +

[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7816: - Attachment: HDFS-7816.002.patch Unable to open webhdfs paths with +

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with +

[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359479#comment-14359479 ] Hadoop QA commented on HDFS-7816: - {color:red}-1 overall{color}. Here are the results of

[jira] [Issue Comment Deleted] (HDFS-7433) Optimize performance of DatanodeManager's node map

[ https://issues.apache.org/jira/browse/HDFS-7433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7433: - Comment: was deleted (was: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359351#comment-14359351 ] Colin Patrick McCabe commented on HDFS-7915: bq. Here bld is set to SUCCESS

[jira] [Updated] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7915: --- Attachment: HDFS-7915.004.patch The DataNode can sometimes allocate a ShortCircuitShm

[jira] [Commented] (HDFS-7911) Buffer Overflow when running HBase on HDFS Encryption Zone

[ https://issues.apache.org/jira/browse/HDFS-7911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359399#comment-14359399 ] Sean Busbey commented on HDFS-7911: --- [~xyao] could you test the patch over on

[jira] [Created] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

Colin Patrick McCabe created HDFS-7923: -- Summary: The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages Key: HDFS-7923 URL:

[jira] [Updated] (HDFS-7903) Cannot recover block after truncate and delete snapshot

[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-7903: --- Status: Patch Available (was: Open) Cannot recover block after truncate and delete snapshot

[jira] [Commented] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359333#comment-14359333 ] Haohui Mai commented on HDFS-: -- +1 for the proposal. Abort NameNode and DataNode

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359369#comment-14359369 ] Colin Patrick McCabe commented on HDFS-7915: I found another problem here. To

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359377#comment-14359377 ] Colin Patrick McCabe commented on HDFS-7915: bq. cnauroth asked: Thanks for the

[jira] [Updated] (HDFS-7903) Cannot recover block after truncate and delete snapshot

[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-7903: --- Attachment: HDFS-7903.2.patch Attaching new patch with Konstantin's suggestions addressed.

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358876#comment-14358876 ] Allen Wittenauer commented on HDFS-5796: How about: a) commit HADOOP-11702 b)

[jira] [Commented] (HDFS-7884) NullPointerException in BlockSender

[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359233#comment-14359233 ] Hadoop QA commented on HDFS-7884: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7884) NullPointerException in BlockSender

[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359235#comment-14359235 ] Hadoop QA commented on HDFS-7884: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359286#comment-14359286 ] Haohui Mai commented on HDFS-5796: -- I'm going to spend some time looking into the last

[jira] [Commented] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359318#comment-14359318 ] Daryn Sharp commented on HDFS-7587: --- The patch doesn't apply because the logic is very

[jira] [Updated] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7587: -- Assignee: (was: Daryn Sharp) Edit log corruption can happen if append fails with a quota violation

[jira] [Commented] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359255#comment-14359255 ] Hadoop QA commented on HDFS-5356: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359277#comment-14359277 ] Haohui Mai commented on HDFS-5796: -- I think there are multiple issues being discussed here

[jira] [Updated] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7722: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-5356: --- Attachment: HDFS-5356-7.patch MiniDFSCluster shoud close all open FileSystems when shutdown()

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359258#comment-14359258 ] Hudson commented on HDFS-7722: -- FAILURE: Integrated in Hadoop-trunk-Commit #7311 (See

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with +

[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359287#comment-14359287 ] Kihwal Lee commented on HDFS-7816: -- [~wheat9] I would appreciate if you can come up with a

[jira] [Commented] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359300#comment-14359300 ] Kihwal Lee commented on HDFS-7587: -- The patch does not apply anymore. Edit log

[jira] [Commented] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359099#comment-14359099 ] Tsz Wo Nicholas Sze commented on HDFS-6833: --- Will commit this shortly.

[jira] [Commented] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359109#comment-14359109 ] Tsz Wo Nicholas Sze commented on HDFS-7587: --- I am fine if we commit the current

[jira] [Updated] (HDFS-7884) NullPointerException in BlockSender

[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7884: -- Target Version/s: 2.7.0 NullPointerException in BlockSender

  1   2   >