[jira] [Commented] (HDFS-10862) Typos in 7 log messages

[ https://issues.apache.org/jira/browse/HDFS-10862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487513#comment-15487513 ] Sean Busbey commented on HDFS-10862: good finds! interested in coming up with a patch for fixing

[jira] [Comment Edited] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487799#comment-15487799 ] Anu Engineer edited comment on HDFS-10824 at 9/13/16 5:23 PM: -- Thanks for the

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487799#comment-15487799 ] Anu Engineer commented on HDFS-10824: - Thanks for the patch. Couple of Questions. # I was wondering

[jira] [Commented] (HDFS-10860) Switch HttpFS to use Jetty

[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487626#comment-15487626 ] Bob Hansen commented on HDFS-10860: --- [~wheat9] converted the DN side of webhdfs to use Netty for

[jira] [Commented] (HDFS-10794) [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work

[ https://issues.apache.org/jira/browse/HDFS-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487680#comment-15487680 ] Uma Maheswara Rao G commented on HDFS-10794: Thanks a lot Kai for the reviews and commit! >

[jira] [Commented] (HDFS-10599) DiskBalancer: Execute CLI via Shell

[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487570#comment-15487570 ] Manoj Govindassamy commented on HDFS-10599: --- >>

[jira] [Commented] (HDFS-10860) Switch HttpFS to use Jetty

[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487804#comment-15487804 ] John Zhuge commented on HDFS-10860: --- This is the HttpFS equvalent of HADOOP-13597. Please join

[jira] [Commented] (HDFS-10800) [SPS]: Storage Policy Satisfier daemon thread in Namenode to find the blocks which were placed in other storages than what NN is expecting.

[ https://issues.apache.org/jira/browse/HDFS-10800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487684#comment-15487684 ] Uma Maheswara Rao G commented on HDFS-10800: Since HDFS-10800 is committed, I will generate

[jira] [Comment Edited] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485496#comment-15485496 ] Erik Krogen edited comment on HDFS-10843 at 9/13/16 5:08 PM: - v002 patch

[jira] [Created] (HDFS-10862) Typos in 7 log messages

Mehran Hassani created HDFS-10862: - Summary: Typos in 7 log messages Key: HDFS-10862 URL: https://issues.apache.org/jira/browse/HDFS-10862 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-10599) DiskBalancer: Execute CLI via Shell

[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487609#comment-15487609 ] Anu Engineer commented on HDFS-10599: - +1, I will commit this shortly. > DiskBalancer: Execute CLI

[jira] [Comment Edited] (HDFS-10800) [SPS]: Storage Policy Satisfier daemon thread in Namenode to find the blocks which were placed in other storages than what NN is expecting.

[ https://issues.apache.org/jira/browse/HDFS-10800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487684#comment-15487684 ] Uma Maheswara Rao G edited comment on HDFS-10800 at 9/13/16 4:33 PM: -

[jira] [Updated] (HDFS-10599) DiskBalancer: Execute CLI via Shell

[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10599: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Comment Edited] (HDFS-10800) [SPS]: Storage Policy Satisfier daemon thread in Namenode to find the blocks which were placed in other storages than what NN is expecting.

[ https://issues.apache.org/jira/browse/HDFS-10800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487684#comment-15487684 ] Uma Maheswara Rao G edited comment on HDFS-10800 at 9/13/16 4:40 PM: -

[jira] [Commented] (HDFS-10599) DiskBalancer: Execute CLI via Shell

[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487752#comment-15487752 ] Hudson commented on HDFS-10599: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10434 (See

[jira] [Commented] (HDFS-10599) DiskBalancer: Execute CLI via Shell

[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487843#comment-15487843 ] Manoj Govindassamy commented on HDFS-10599: --- Thanks for the review and commit help [~anu]. >

[jira] [Commented] (HDFS-10823) Implement HttpFSFileSystem#listStatusIterator

[ https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488112#comment-15488112 ] Hadoop QA commented on HDFS-10823: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488243#comment-15488243 ] Hudson commented on HDFS-10562: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10437 (See

[jira] [Updated] (HDFS-10837) Standardize serializiation of WebHDFS DirectoryListing

[ https://issues.apache.org/jira/browse/HDFS-10837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10837: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.9.0 Status:

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487931#comment-15487931 ] Lei (Eddy) Xu commented on HDFS-10636: -- Hi, [~virajith] Thanks for the insights. bq. Our solution

[jira] [Updated] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10562: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Updated] (HDFS-10823) Implement HttpFSFileSystem#listStatusIterator

[ https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10823: --- Status: Patch Available (was: Open) > Implement HttpFSFileSystem#listStatusIterator >

[jira] [Commented] (HDFS-10837) Standardize serializiation of WebHDFS DirectoryListing

[ https://issues.apache.org/jira/browse/HDFS-10837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487980#comment-15487980 ] Hudson commented on HDFS-10837: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10435 (See

[jira] [Commented] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488018#comment-15488018 ] Arpit Agarwal commented on HDFS-10562: -- +1 thanks [~anu]. > DiskBalancer: update documentation on

[jira] [Updated] (HDFS-10713) Throttle FsNameSystem lock warnings

[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10713: -- Attachment: HDFS-10713.006.patch Thank you [~arpitagarwal]. I have updated the patch with the

[jira] [Updated] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9850: - Assignee: Manoj Govindassamy (was: Anu Engineer) Affects Version/s: (was:

[jira] [Updated] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10636: - Resolution: Fixed Hadoop Flags: Incompatible change Fix Version/s:

[jira] [Comment Edited] (HDFS-10378) FSDirAttrOp#setOwner throws ACE with misleading message

[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487334#comment-15487334 ] John Zhuge edited comment on HDFS-10378 at 9/13/16 5:30 PM: The

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488093#comment-15488093 ] Arpit Agarwal commented on HDFS-10713: -- +1 pending Jenkins. > Throttle FsNameSystem lock warnings >

[jira] [Updated] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9850: --- Fix Version/s: (was: HDFS-1312) > DiskBalancer : Explore removing references to FsVolumeSpi >

[jira] [Updated] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9850: --- Target Version/s: 3.0.0-alpha2 (was: HDFS-1312) > DiskBalancer : Explore removing references to

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488114#comment-15488114 ] Arpit Agarwal commented on HDFS-9668: - Thanks for your continued work on this

[jira] [Commented] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488663#comment-15488663 ] Hadoop QA commented on HDFS-10828: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488666#comment-15488666 ] Erik Krogen commented on HDFS-10843: Thanks for the comments. I am a little unsure about point 3. It

[jira] [Updated] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10843: --- Attachment: HDFS-10843.004.patch > Quota Feature Cached Size != Computed Size When Block Committed

[jira] [Commented] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1547#comment-1547 ] Zhe Zhang commented on HDFS-10475: -- Thanks for the insight Andrew. Do we have per-OP RPC processing time

[jira] [Updated] (HDFS-8845) DiskChecker should not traverse the entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-8845: -- Fix Version/s: 2.6.5 Cherry-picked it into 2.6.5 (trivial). > DiskChecker should not traverse the

[jira] [Commented] (HDFS-8845) DiskChecker should not traverse the entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488765#comment-15488765 ] Chris Trezzo commented on HDFS-8845: Thanks! > DiskChecker should not traverse the entire tree >

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488784#comment-15488784 ] Andrew Wang commented on HDFS-10713: Thanks for working on this Hanisha. I had the same review comment

[jira] [Commented] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488879#comment-15488879 ] Andrew Wang commented on HDFS-10475: Looking at it a bit more, the RPC metrics only track per-OP

[jira] [Updated] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10810: - Attachment: HDFS-10810-003.patch Hi, [~brahmareddy], I can understand that the block is removed

[jira] [Commented] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488775#comment-15488775 ] Chris Trezzo commented on HDFS-9669: Thanks! > TcpPeerServer should respect

[jira] [Updated] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-9669: -- Fix Version/s: 2.6.5 Cherry-picked it to 2.6.5 (trivial). > TcpPeerServer should respect

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488777#comment-15488777 ] Tsz Wo Nicholas Sze commented on HDFS-10810: When I ran the new test

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488779#comment-15488779 ] Tsz Wo Nicholas Sze commented on HDFS-10810: Indeed, since getMissingBlocksCount() did return

[jira] [Commented] (HDFS-9145) Tracking methods that hold FSNamesytemLock for too long

[ https://issues.apache.org/jira/browse/HDFS-9145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488802#comment-15488802 ] Andrew Wang commented on HDFS-9145: --- We still need manual CHANGES.txt entries for 2.6.x and 2.7.x

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488796#comment-15488796 ] Konstantin Shvachko commented on HDFS-10301: Vinitha, thanks for your thorough research. Minor

[jira] [Commented] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488795#comment-15488795 ] Andrew Wang commented on HDFS-10475: Thanks for the ping Zhe. Question, isn't a lot of this captured

[jira] [Commented] (HDFS-10178) Permanent write failures can happen if pipeline recoveries occur for the first packet

[ https://issues.apache.org/jira/browse/HDFS-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488823#comment-15488823 ] Chris Trezzo commented on HDFS-10178: - Thanks! > Permanent write failures can happen if pipeline

[jira] [Updated] (HDFS-10178) Permanent write failures can happen if pipeline recoveries occur for the first packet

[ https://issues.apache.org/jira/browse/HDFS-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-10178: --- Fix Version/s: 2.6.5 Cherry-picked it to 2.6.5 (trivial). > Permanent write failures can happen if

[jira] [Commented] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488923#comment-15488923 ] Hadoop QA commented on HDFS-10843: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488302#comment-15488302 ] Hudson commented on HDFS-10636: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10438 (See

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488318#comment-15488318 ] Virajith Jalaparti commented on HDFS-10636: --- Great! Thanks [~eddyxu]. > Modify ReplicaInfo to

[jira] [Commented] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488523#comment-15488523 ] Zhe Zhang commented on HDFS-10475: -- Thanks Erik for the analysis. bq. Move the logging/metrics logic

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488521#comment-15488521 ] Erik Krogen commented on HDFS-10713: One comment on this is that it would be ideal to change it to use

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488329#comment-15488329 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488354#comment-15488354 ] Konstantin Shvachko commented on HDFS-10843: Nice, Erik. Minor comments on the latest patch #

[jira] [Commented] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488429#comment-15488429 ] Chen Liang commented on HDFS-10828: --- +1. looking all good to me. Thanks [~arpitagarwal] for the work!

[jira] [Commented] (HDFS-10644) Fix intermittently failing TestDFSUpgradeWithHA#testRollbackWithJournalNodes

[ https://issues.apache.org/jira/browse/HDFS-10644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488369#comment-15488369 ] Mingliang Liu commented on HDFS-10644: -- In case the stack is missing in Jenkins cluster and hard to

[jira] [Updated] (HDFS-10644) TestDFSUpgradeWithHA#testRollbackWithJournalNodes fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-10644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10644: - Summary: TestDFSUpgradeWithHA#testRollbackWithJournalNodes fails intermittently (was: Fix

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488362#comment-15488362 ] Hanisha Koneru commented on HDFS-10713: --- The unit test TestDFSUpgradeWithHA fails intermittently.

[jira] [Updated] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10828: - Attachment: HDFS-10828.03.patch v03 patch: Rebased to trunk. > Fix usage of FsDatasetImpl object

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488376#comment-15488376 ] Arpit Agarwal commented on HDFS-9668: - Also there is a follow-up fix to the recent locking changes

[jira] [Updated] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10489: - Attachment: HDFS-10489.01.patch I'd like to get this done by alpha2. Attaching a patch 1 to remove the

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488530#comment-15488530 ] Chris Douglas commented on HDFS-10713: -- Using a {{synchronized}} block after releasing the read lock

[jira] [Updated] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10810: Description: 1)Batch IBR is enabled with number of committed blocks allowed=1 2)

[jira] [Comment Edited] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489048#comment-15489048 ] Brahma Reddy Battula edited comment on HDFS-10810 at 9/14/16 1:40 AM: --

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489069#comment-15489069 ] Brahma Reddy Battula commented on HDFS-10810: - Thanks [~szetszwo] for taking look into this

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489122#comment-15489122 ] Tsz Wo Nicholas Sze commented on HDFS-10810: What do you expect to fail without the fix? From

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489196#comment-15489196 ] Mingliang Liu commented on HDFS-10810: -- Hi [~szetszwo], please have a look at the v2 for the unit

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489223#comment-15489223 ] Arpit Agarwal commented on HDFS-10301: -- bq. I have modified the checkLease method in

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488965#comment-15488965 ] Hadoop QA commented on HDFS-10810: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8957) Consolidate client striping input stream codes for stateful read and positional read

[ https://issues.apache.org/jira/browse/HDFS-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489137#comment-15489137 ] SammiChen commented on HDFS-8957: - For easy review, I created " HDFS-10861 Refactor StatefulStripeReader

[jira] [Updated] (HDFS-9365) Balancer does not work with the HDFS-6376 HA setup

[ https://issues.apache.org/jira/browse/HDFS-9365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-9365: -- Fix Version/s: 2.6.5 Cherry-picked it to 2.6.5 with minor merge conflict resolutions. > Balancer does

[jira] [Commented] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488988#comment-15488988 ] Andrew Wang commented on HDFS-10475: Digging a bit more, I see that there's RpcMetricsDetailed, which

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489151#comment-15489151 ] Jingcheng Du commented on HDFS-9668: Thanks a lot [~arpitagarwal]! I will keep the patch updated!

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10301: - Fix Version/s: (was: 2.7.4) > BlockReport retransmissions may lead to storages falsely being

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489048#comment-15489048 ] Brahma Reddy Battula commented on HDFS-10810: - bq. but I don't see why the block is counted as

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489207#comment-15489207 ] Brahma Reddy Battula commented on HDFS-10810: - getUnderReplicatedBlocksCount() should return 0

[jira] [Updated] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-9696: -- Fix Version/s: 2.6.5 Committed it to 2.6.5. > Garbage snapshot records lingering forever >

[jira] [Updated] (HDFS-10744) Internally optimize path component resolution

[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10744: - Resolution: Fixed Fix Version/s: 2.7.4 Status: Resolved (was: Patch Available)

[jira] [Resolved] (HDFS-10378) FSDirAttrOp#setOwner throws ACE with misleading message

[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-10378. --- Resolution: Invalid In {{HDFS-10378-unit.patch}}, super user creates {{CHILD_DIR1}}, so it makes

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9668: Fix Version/s: (was: 3.0.0-alpha2) > Optimize the locking in FsDatasetImpl >

[jira] [Commented] (HDFS-10657) testAclCLI.xml setfacl test should expect mask r-x

[ https://issues.apache.org/jira/browse/HDFS-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487339#comment-15487339 ] John Zhuge commented on HDFS-10657: --- Thank you [~yzhangal] for the review and commit, [~vinayrpet] for

[jira] [Updated] (HDFS-10794) [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work

[ https://issues.apache.org/jira/browse/HDFS-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10794: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285 Status: Resolved

[jira] [Updated] (HDFS-10861) Refactor StatefulStripeReader and PositionStripeReader, use ECChunk version decode API

[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: HDFS-10861-v1.patch > Refactor StatefulStripeReader and PositionStripeReader, use ECChunk

[jira] [Updated] (HDFS-10861) Refactor StatefulStripeReader and PositionStripeReader, use ECChunk version decode API

[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Status: Patch Available (was: Open) > Refactor StatefulStripeReader and PositionStripeReader, use

[jira] [Commented] (HDFS-10861) Refactor StatefulStripeReader and PositionStripeReader, use ECChunk version decode API

[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486883#comment-15486883 ] Hadoop QA commented on HDFS-10861: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10794) [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work

[ https://issues.apache.org/jira/browse/HDFS-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486718#comment-15486718 ] Kai Zheng commented on HDFS-10794: -- Thanks Rakesh. The latest trunk LGTM. +1 and will commit it shortly.

[jira] [Created] (HDFS-10861) Refactor StatefulStripeReader and PositionStripeReader, use ECChunk version decode API

SammiChen created HDFS-10861: Summary: Refactor StatefulStripeReader and PositionStripeReader, use ECChunk version decode API Key: HDFS-10861 URL: https://issues.apache.org/jira/browse/HDFS-10861

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486753#comment-15486753 ] Hadoop QA commented on HDFS-9668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

Standby NN Pause duration alert keeps getting

Hi Team, Standby NN Concerning bad health due to GC Pause duration and alerts keep gettings. we have given Java Heap size of NN : 7.8 GB Standby NN consumes heap memory used 7.5 GB of 7.8 GB heap memory. Please provide the solution as earliest.

[jira] [Commented] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486400#comment-15486400 ] Hudson commented on HDFS-10856: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10431 (See

[jira] [Updated] (HDFS-10860) Switch HttpFS to use Jetty

[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10860: - Description: The Tomcat 6 we are using will reach EOL at the end of 2017. While there are other good

[jira] [Commented] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486429#comment-15486429 ] Yiqun Lin commented on HDFS-10856: -- Thanks [~ajisakaa] for the commit, I will attach a patch for

[jira] [Resolved] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple and testBalancerWithKeytabs are flaky in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-10859. -- Resolution: Duplicate Thanks for the pointer Xiao. HDFS-10716 indeed solves the problem. >

[jira] [Commented] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486404#comment-15486404 ] Akira Ajisaka commented on HDFS-10856: -- {quote} bq. This should be done in a separate jira. +1 for

[jira] [Updated] (HDFS-10716) In Balancer, the target task should be removed when its size < 0.

[ https://issues.apache.org/jira/browse/HDFS-10716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10716: - Fix Version/s: 2.7.4 > In Balancer, the target task should be removed when its size < 0. >

[jira] [Commented] (HDFS-10716) In Balancer, the target task should be removed when its size < 0.

[ https://issues.apache.org/jira/browse/HDFS-10716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486436#comment-15486436 ] Zhe Zhang commented on HDFS-10716: -- I backported this to branch-2.7. > In Balancer, the target task

[jira] [Commented] (HDFS-10744) Internally optimize path component resolution

[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486380#comment-15486380 ] Zhe Zhang commented on HDFS-10744: -- I verified that all reported failures pass locally. In backporting,

  1   2   >