[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-18 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932900#comment-16932900 ] Konstantin Shvachko commented on HDFS-14655: Hey guys I could not reproduce the problem with

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-17 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931797#comment-16931797 ] Konstantin Shvachko commented on HDFS-14655: Hey guys, would it possible to add a test case?

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-09-05 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923782#comment-16923782 ] Konstantin Shvachko commented on HDFS-14703: Good questions guys, thanks. ??how to handle

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-09-04 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922886#comment-16922886 ] Konstantin Shvachko commented on HDFS-14703: Hey [~arp] , thanks for reviewing. ??Do atomic

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-09-04 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922880#comment-16922880 ] Konstantin Shvachko commented on HDFS-14703: Hey [~hexiaoqiao], clarifying on your questions.

[jira] [Updated] (HDFS-14822) [SBN read] Revisit GlobalStateIdContext locking when getting server state id

2019-09-04 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14822: --- Target Version/s: 2.10.0 Labels: release-blocker (was: ) > [SBN read]

[jira] [Commented] (HDFS-14277) [SBN read] Observer benchmark results

2019-09-04 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922747#comment-16922747 ] Konstantin Shvachko commented on HDFS-14277: I think for 2.10 we should mostly target Daren's

[jira] [Updated] (HDFS-14792) [SBN read] StanbyNode does not come out of safemode while adding new blocks.

2019-09-03 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14792: --- Description: During startup StandbyNode reports that it needs additional X blocks to

[jira] [Comment Edited] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-09-03 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921740#comment-16921740 ] Konstantin Shvachko edited comment on HDFS-14305 at 9/3/19 10:01 PM: -

[jira] [Commented] (HDFS-14793) BlockTokenSecretManager should LOG block token range it operates on.

2019-09-03 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921742#comment-16921742 ] Konstantin Shvachko commented on HDFS-14793: Hey [~hemanthboyina], please feel free to assign

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-09-03 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921740#comment-16921740 ] Konstantin Shvachko commented on HDFS-14305: I don't think we should pursue the bits

[jira] [Updated] (HDFS-14794) [SBN read] reportBadBlock is rejected by Observer.

2019-08-28 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14794: --- Description: {{reportBadBlock}} is rejected by Observer via StandbyException

[jira] [Updated] (HDFS-14794) [SBN read] reportBadBlock is rejected by Observer.

2019-08-28 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14794: --- Summary: [SBN read] reportBadBlock is rejected by Observer. (was: reportBadBlock is

[jira] [Created] (HDFS-14794) reportBadBlock is rejected by Observer.

2019-08-28 Thread Konstantin Shvachko (Jira)
Konstantin Shvachko created HDFS-14794: -- Summary: reportBadBlock is rejected by Observer. Key: HDFS-14794 URL: https://issues.apache.org/jira/browse/HDFS-14794 Project: Hadoop HDFS

[jira] [Created] (HDFS-14793) BlockTokenSecretManager should LOG block tokaen range it operates on.

2019-08-28 Thread Konstantin Shvachko (Jira)
Konstantin Shvachko created HDFS-14793: -- Summary: BlockTokenSecretManager should LOG block tokaen range it operates on. Key: HDFS-14793 URL: https://issues.apache.org/jira/browse/HDFS-14793

[jira] [Created] (HDFS-14792) [SBN read] StanbyNode does not come out of safemode while adding new blocks.

2019-08-28 Thread Konstantin Shvachko (Jira)
Konstantin Shvachko created HDFS-14792: -- Summary: [SBN read] StanbyNode does not come out of safemode while adding new blocks. Key: HDFS-14792 URL: https://issues.apache.org/jira/browse/HDFS-14792

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-28 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918169#comment-16918169 ] Konstantin Shvachko commented on HDFS-13541: {{PBHelperClient}} still has a trivial

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-08-28 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918161#comment-16918161 ] Konstantin Shvachko commented on HDFS-14305: Hey guys, sorry for pitching in late. I am

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-08-27 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917060#comment-16917060 ] Konstantin Shvachko commented on HDFS-14509: Hi [~John Smith] , do I understand correctly the

[jira] [Commented] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

2019-08-27 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916981#comment-16916981 ] Konstantin Shvachko commented on HDFS-13977: Changed fix version back to 3.1.3 as it was

[jira] [Updated] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

2019-08-27 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-13977: --- Fix Version/s: (was: 3.1.4) 3.1.3 > NameNode can kill itself

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-26 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916256#comment-16916256 ] Konstantin Shvachko commented on HDFS-13541: Comments for branch-2 v02 patch: #

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-22 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913816#comment-16913816 ] Konstantin Shvachko commented on HDFS-13541: +1 on v02 patch for branch 3.1. > NameNode Port

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-20 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911832#comment-16911832 ] Konstantin Shvachko commented on HDFS-13541: Couple things for 3.1 patch: # In

[jira] [Commented] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

2019-08-20 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911800#comment-16911800 ] Konstantin Shvachko commented on HDFS-13977: Thanks for clarifying. I was indeed confused by

[jira] [Commented] (HDFS-14674) [SBN read] Got an unexpected txid when tail editlog

2019-08-19 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910908#comment-16910908 ] Konstantin Shvachko commented on HDFS-14674: +1 on v11 patch. > [SBN read] Got an unexpected

[jira] [Commented] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

2019-08-19 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910905#comment-16910905 ] Konstantin Shvachko commented on HDFS-13977: Hey [~xkrogen], really good catch. I understand

[jira] [Commented] (HDFS-14674) [SBN read] Got an unexpected txid when tail editlog

2019-08-19 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910778#comment-16910778 ] Konstantin Shvachko commented on HDFS-14674: Hi [~wangzhaohui], one extra minor things, sorry

[jira] [Commented] (HDFS-14674) [SBN read] Got an unexpected txid when tail editlog

2019-08-15 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908598#comment-16908598 ] Konstantin Shvachko commented on HDFS-14674: Hey [~wangzhaohui], minor things about the test:

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907745#comment-16907745 ] Konstantin Shvachko commented on HDFS-13541: +1. Compared most of the files with trunk, looks

[jira] [Created] (HDFS-14734) [FGL] Introduce Latch Lock to replace Namesystem global lock.

2019-08-14 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-14734: -- Summary: [FGL] Introduce Latch Lock to replace Namesystem global lock. Key: HDFS-14734 URL: https://issues.apache.org/jira/browse/HDFS-14734 Project:

[jira] [Created] (HDFS-14733) [FGL] Introduce INode key.

2019-08-14 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-14733: -- Summary: [FGL] Introduce INode key. Key: HDFS-14733 URL: https://issues.apache.org/jira/browse/HDFS-14733 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-14732) [FGL] Introduce PartitionedGSet a new implementation of GSet.

2019-08-14 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-14732: -- Summary: [FGL] Introduce PartitionedGSet a new implementation of GSet. Key: HDFS-14732 URL: https://issues.apache.org/jira/browse/HDFS-14732 Project:

[jira] [Created] (HDFS-14731) [FGL] Remove redundant locking on NameNode.

2019-08-14 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-14731: -- Summary: [FGL] Remove redundant locking on NameNode. Key: HDFS-14731 URL: https://issues.apache.org/jira/browse/HDFS-14731 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907662#comment-16907662 ] Konstantin Shvachko commented on HDFS-14703: Attaching the POC patch. It consists of 4

[jira] [Updated] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14703: --- Attachment: 001-partitioned-inodeMap-POC.tar.gz > NameNode Fine-Grained Locking via

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907609#comment-16907609 ] Konstantin Shvachko commented on HDFS-13541: Looks good overall. # I suggest in

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903491#comment-16903491 ] Konstantin Shvachko commented on HDFS-14204: +1 last patch looks good. TestSafeMode fails due

[jira] [Commented] (HDFS-14655) SBN : Namenode crashes if one of The JN is down

2019-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903466#comment-16903466 ] Konstantin Shvachko commented on HDFS-14655: Hey guys, discussed this with Chen. It seems

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903430#comment-16903430 ] Konstantin Shvachko commented on HDFS-12914: Confirmed reverting the patch fixes

[jira] [Comment Edited] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903374#comment-16903374 ] Konstantin Shvachko edited comment on HDFS-14703 at 8/8/19 10:10 PM: -

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903374#comment-16903374 ] Konstantin Shvachko commented on HDFS-14703: Hi [~hexiaoqiao], thanks for reviewing the doc.

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903334#comment-16903334 ] Konstantin Shvachko commented on HDFS-14204: Hey [~vagarychen] v6 patch doesn't look right,

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901514#comment-16901514 ] Konstantin Shvachko commented on HDFS-14204: Particularly,

[jira] [Reopened] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

2019-08-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reopened HDFS-14303: Reopening for committing the addendum patch to other versions. > check block

[jira] [Commented] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

2019-08-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901510#comment-16901510 ] Konstantin Shvachko commented on HDFS-14303: Looks like the addendum patch was committed only

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901485#comment-16901485 ] Konstantin Shvachko commented on HDFS-14204: The ASF license warning refers to a file which I

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900526#comment-16900526 ] Konstantin Shvachko commented on HDFS-14703: Attached the design document for review. >

[jira] [Updated] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14703: --- Attachment: NameNode Fine-Grained Locking.pdf > NameNode Fine-Grained Locking via

[jira] [Created] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-05 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-14703: -- Summary: NameNode Fine-Grained Locking via Metadata Partitioning Key: HDFS-14703 URL: https://issues.apache.org/jira/browse/HDFS-14703 Project: Hadoop

[jira] [Commented] (HDFS-14370) Edit log tailing fast-path should allow for backoff

2019-08-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899110#comment-16899110 ] Konstantin Shvachko commented on HDFS-14370: +1 on v3 patch. Looks good > Edit log tailing

[jira] [Commented] (HDFS-14674) Got an unexpected txid when tail editlog

2019-08-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898439#comment-16898439 ] Konstantin Shvachko commented on HDFS-14674: Hey [~wangzhaohui], thanks for reporting and

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898432#comment-16898432 ] Konstantin Shvachko commented on HDFS-14204: The patch looks good. I ran a bunch of unit

[jira] [Commented] (HDFS-14657) Refine NameSystem lock usage during processing FBR

2019-07-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896420#comment-16896420 ] Konstantin Shvachko commented on HDFS-14657: With branch-2 including 2.6 this change seems

[jira] [Comment Edited] (HDFS-14657) Refine NameSystem lock usage during processing FBR

2019-07-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893228#comment-16893228 ] Konstantin Shvachko edited comment on HDFS-14657 at 7/26/19 12:29 AM:

[jira] [Comment Edited] (HDFS-14657) Refine NameSystem lock usage during processing FBR

2019-07-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893228#comment-16893228 ] Konstantin Shvachko edited comment on HDFS-14657 at 7/26/19 12:29 AM:

[jira] [Commented] (HDFS-14657) Refine NameSystem lock usage during processing FBR

2019-07-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893228#comment-16893228 ] Konstantin Shvachko commented on HDFS-14657: Hi [~zhangchen]. Looking at your patch v2. I am

[jira] [Commented] (HDFS-14573) Backport Standby Read to branch-3

2019-07-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892329#comment-16892329 ] Konstantin Shvachko commented on HDFS-14573: Actually the two YARN tests fail for 3.0 without

[jira] [Commented] (HDFS-14573) Backport Standby Read to branch-3

2019-07-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892322#comment-16892322 ] Konstantin Shvachko commented on HDFS-14573: Looks like the {{TestDirectoryScanner}} failures

[jira] [Commented] (HDFS-14657) Refine NameSystem lock usage during processing FBR

2019-07-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887295#comment-16887295 ] Konstantin Shvachko commented on HDFS-14657: I was wondering if you looked at other jiras

[jira] [Commented] (HDFS-14573) Backport Standby Read to branch-3

2019-07-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883357#comment-16883357 ] Konstantin Shvachko commented on HDFS-14573: {{TestDiskBalancer}} is failing due to

[jira] [Commented] (HDFS-14599) HDFS-12487 breaks test TestDiskBalancer.testDiskBalancerWithFedClusterWithOneNameServiceEmpty

2019-07-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883354#comment-16883354 ] Konstantin Shvachko commented on HDFS-14599: Should this also need to be commit to 3.2 and

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2019-07-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883339#comment-16883339 ] Konstantin Shvachko commented on HDFS-12733: I am strongly opposing introducing a new

[jira] [Commented] (HDFS-14611) Move handshake secret field from Token to BlockAccessToken

2019-07-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880784#comment-16880784 ] Konstantin Shvachko commented on HDFS-14611: +1 on my side for v3 patch. > Move handshake

[jira] [Commented] (HDFS-14611) Move handshake secret field from Token to BlockAccessToken

2019-06-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875281#comment-16875281 ] Konstantin Shvachko commented on HDFS-14611: Looks reasonable overall, simpler than the

[jira] [Commented] (HDFS-14573) Backport Standby Read to branch-3

2019-06-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875212#comment-16875212 ] Konstantin Shvachko commented on HDFS-14573: +1 for the latest branch-3.2 patch. Looks like

[jira] [Updated] (HDFS-14047) [libhdfs++] Fix hdfsGetLastExceptionRootCause bug in test_libhdfs_threaded.c

2019-06-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14047: --- Affects Version/s: 3.2.0 Fix Version/s: 3.2.1 I just committed this to

[jira] [Commented] (HDFS-11021) Add FSNamesystemLock metrics for BlockManager operations

2019-06-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868969#comment-16868969 ] Konstantin Shvachko commented on HDFS-11021: I think separating IBR and FBR lock metrics out

[jira] [Comment Edited] (HDFS-11021) Add FSNamesystemLock metrics for BlockManager operations

2019-06-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868969#comment-16868969 ] Konstantin Shvachko edited comment on HDFS-11021 at 6/20/19 10:09 PM:

[jira] [Comment Edited] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-06-15 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16864884#comment-16864884 ] Konstantin Shvachko edited comment on HDFS-14204 at 6/15/19 10:40 PM:

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-06-15 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16864884#comment-16864884 ] Konstantin Shvachko commented on HDFS-14204: Checked the patch, looks good, but two tests

[jira] [Commented] (HDFS-14573) Backport Standby Read to branch-3

2019-06-15 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16864876#comment-16864876 ] Konstantin Shvachko commented on HDFS-14573: Thanks [~vagarychen] for moving this forward.

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-06-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856051#comment-16856051 ] Konstantin Shvachko commented on HDFS-12979: Wanted to emphasize that with this change Active

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-06-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855171#comment-16855171 ] Konstantin Shvachko commented on HDFS-12979: Only suggestion I can think of for avoiding

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2019-05-31 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853337#comment-16853337 ] Konstantin Shvachko commented on HDFS-12733: I would really prefer if this could be done

[jira] [Updated] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()

2019-05-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14502: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.3

[jira] [Updated] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()

2019-05-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14502: --- Target Version/s: 2.10.0 Description: {{-keepResults}} option is usually

[jira] [Updated] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()

2019-05-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14502: --- Component/s: hdfs benchmarks > keepResults option in

[jira] [Commented] (HDFS-14500) NameNode StartupProgress continues to report edit log segments after the LOADING_EDITS phase is finished

2019-05-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844399#comment-16844399 ] Konstantin Shvachko commented on HDFS-14500: Do I understand correctly? NN have already

[jira] [Updated] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()

2019-05-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14502: --- Status: Patch Available (was: Open) Simple patch adding {{saveNamespace()}} >

[jira] [Updated] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()

2019-05-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14502: --- Attachment: HDFS-14502.001.patch > keepResults option in NNThroughputBenchmark

[jira] [Created] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()

2019-05-20 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-14502: -- Summary: keepResults option in NNThroughputBenchmark should call saveNamespace() Key: HDFS-14502 URL: https://issues.apache.org/jira/browse/HDFS-14502

[jira] [Created] (HDFS-14494) Move Server logging of StatedId inside receiveRequestState()

2019-05-15 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-14494: -- Summary: Move Server logging of StatedId inside receiveRequestState() Key: HDFS-14494 URL: https://issues.apache.org/jira/browse/HDFS-14494 Project:

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-05-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16836754#comment-16836754 ] Konstantin Shvachko commented on HDFS-14245: +1 for v 007 patch > Class cast error in

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-05-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16835005#comment-16835005 ] Konstantin Shvachko commented on HDFS-14245: +1 looks good > Class cast error in GetGroups

[jira] [Comment Edited] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-05-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834245#comment-16834245 ] Konstantin Shvachko edited comment on HDFS-14245 at 5/6/19 10:53 PM: -

[jira] [Comment Edited] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-05-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834245#comment-16834245 ] Konstantin Shvachko edited comment on HDFS-14245 at 5/6/19 10:43 PM: -

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-05-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834245#comment-16834245 ] Konstantin Shvachko commented on HDFS-14245: ??getHAServiceState() assumes STANDBY state no

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-05-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833443#comment-16833443 ] Konstantin Shvachko commented on HDFS-14245: Let's go over it one issue at a time.

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-04-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827302#comment-16827302 ] Konstantin Shvachko commented on HDFS-14245: Great, simple is good. # It would be better if

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-04-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827227#comment-16827227 ] Konstantin Shvachko commented on HDFS-14245: [~xkrogen] could you please update the patch. It

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-04-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820373#comment-16820373 ] Konstantin Shvachko commented on HDFS-14245: [~xkrogen] your option 2 - _ORPP not using

[jira] [Commented] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2019-04-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808196#comment-16808196 ] Konstantin Shvachko commented on HDFS-13699: +1 on v010 patch. > Add DFSClient sending

[jira] [Commented] (HDFS-10477) Stop decommission a rack of DataNodes caused NameNode fail over to standby

2019-04-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807311#comment-16807311 ] Konstantin Shvachko commented on HDFS-10477: Let's target this for 2.10 at the minimum. >

[jira] [Updated] (HDFS-10477) Stop decommission a rack of DataNodes caused NameNode fail over to standby

2019-04-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10477: --- Target Version/s: 2.10.0 > Stop decommission a rack of DataNodes caused NameNode

[jira] [Commented] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2019-04-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807295#comment-16807295 ] Konstantin Shvachko commented on HDFS-13699: Chen, thanks for the comprehensive analysis of

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-03-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804514#comment-16804514 ] Konstantin Shvachko commented on HDFS-14245: ORPP requires {{ClientProtocol}}, since it needs

[jira] [Commented] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2019-03-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802284#comment-16802284 ] Konstantin Shvachko commented on HDFS-13699: Thanks, [~vagarychen] for the patch. So my main

[jira] [Commented] (HDFS-14211) [Consistent Observer Reads] Allow for configurable "always msync" mode

2019-03-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795704#comment-16795704 ] Konstantin Shvachko commented on HDFS-14211: Good documentation. +1 on the latest patch

[jira] [Commented] (HDFS-14211) [Consistent Observer Reads] Allow for configurable "always msync" mode

2019-03-16 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794334#comment-16794334 ] Konstantin Shvachko commented on HDFS-14211: +1. All tests pass with HADOOP-16192 >

<    1   2   3   4   5   6   7   8   9   10   >