[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-18 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16932900#comment-16932900 ] Konstantin Shvachko commented on HDFS-14655: Hey guys I could not reproduce t

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-17 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16931797#comment-16931797 ] Konstantin Shvachko commented on HDFS-14655: Hey guys, would it possible to a

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-09-05 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16923782#comment-16923782 ] Konstantin Shvachko commented on HDFS-14703: Good questions guys, thanks. ??

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-09-04 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922886#comment-16922886 ] Konstantin Shvachko commented on HDFS-14703: Hey [~arp] , thanks for reviewin

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-09-04 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922880#comment-16922880 ] Konstantin Shvachko commented on HDFS-14703: Hey [~hexiaoqiao], clarifying on

[jira] [Updated] (HDFS-14822) [SBN read] Revisit GlobalStateIdContext locking when getting server state id

2019-09-04 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14822: --- Target Version/s: 2.10.0 Labels: release-blocker (was: ) > [SBN read]

[jira] [Commented] (HDFS-14277) [SBN read] Observer benchmark results

2019-09-04 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922747#comment-16922747 ] Konstantin Shvachko commented on HDFS-14277: I think for 2.10 we should mostl

[jira] [Updated] (HDFS-14792) [SBN read] StanbyNode does not come out of safemode while adding new blocks.

2019-09-03 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14792: --- Description: During startup StandbyNode reports that it needs additional X blocks to

[jira] [Comment Edited] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-09-03 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921740#comment-16921740 ] Konstantin Shvachko edited comment on HDFS-14305 at 9/3/19 10:01 PM: --

[jira] [Commented] (HDFS-14793) BlockTokenSecretManager should LOG block token range it operates on.

2019-09-03 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921742#comment-16921742 ] Konstantin Shvachko commented on HDFS-14793: Hey [~hemanthboyina], please fee

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-09-03 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921740#comment-16921740 ] Konstantin Shvachko commented on HDFS-14305: I don't think we should pursue t

[jira] [Updated] (HDFS-14794) [SBN read] reportBadBlock is rejected by Observer.

2019-08-28 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14794: --- Description: {{reportBadBlock}} is rejected by Observer via StandbyException {code}St

[jira] [Updated] (HDFS-14794) [SBN read] reportBadBlock is rejected by Observer.

2019-08-28 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14794: --- Summary: [SBN read] reportBadBlock is rejected by Observer. (was: reportBadBlock is

[jira] [Created] (HDFS-14794) reportBadBlock is rejected by Observer.

2019-08-28 Thread Konstantin Shvachko (Jira)
Konstantin Shvachko created HDFS-14794: -- Summary: reportBadBlock is rejected by Observer. Key: HDFS-14794 URL: https://issues.apache.org/jira/browse/HDFS-14794 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-14793) BlockTokenSecretManager should LOG block tokaen range it operates on.

2019-08-28 Thread Konstantin Shvachko (Jira)
Konstantin Shvachko created HDFS-14793: -- Summary: BlockTokenSecretManager should LOG block tokaen range it operates on. Key: HDFS-14793 URL: https://issues.apache.org/jira/browse/HDFS-14793 Proje

[jira] [Created] (HDFS-14792) [SBN read] StanbyNode does not come out of safemode while adding new blocks.

2019-08-28 Thread Konstantin Shvachko (Jira)
Konstantin Shvachko created HDFS-14792: -- Summary: [SBN read] StanbyNode does not come out of safemode while adding new blocks. Key: HDFS-14792 URL: https://issues.apache.org/jira/browse/HDFS-14792

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-28 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918169#comment-16918169 ] Konstantin Shvachko commented on HDFS-13541: {{PBHelperClient}} still has a t

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-08-28 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918161#comment-16918161 ] Konstantin Shvachko commented on HDFS-14305: Hey guys, sorry for pitching in

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-08-27 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16917060#comment-16917060 ] Konstantin Shvachko commented on HDFS-14509: Hi [~John Smith] , do I understa

[jira] [Commented] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

2019-08-27 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16916981#comment-16916981 ] Konstantin Shvachko commented on HDFS-13977: Changed fix version back to 3.1.

[jira] [Updated] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

2019-08-27 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-13977: --- Fix Version/s: (was: 3.1.4) 3.1.3 > NameNode can kill itself i

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-26 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16916256#comment-16916256 ] Konstantin Shvachko commented on HDFS-13541: Comments for branch-2 v02 patch:

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-22 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16913816#comment-16913816 ] Konstantin Shvachko commented on HDFS-13541: +1 on v02 patch for branch 3.1.

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-20 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16911832#comment-16911832 ] Konstantin Shvachko commented on HDFS-13541: Couple things for 3.1 patch: # I

[jira] [Commented] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

2019-08-20 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16911800#comment-16911800 ] Konstantin Shvachko commented on HDFS-13977: Thanks for clarifying. I was ind

[jira] [Commented] (HDFS-14674) [SBN read] Got an unexpected txid when tail editlog

2019-08-19 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16910908#comment-16910908 ] Konstantin Shvachko commented on HDFS-14674: +1 on v11 patch. > [SBN read] G

[jira] [Commented] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

2019-08-19 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16910905#comment-16910905 ] Konstantin Shvachko commented on HDFS-13977: Hey [~xkrogen], really good catc

[jira] [Commented] (HDFS-14674) [SBN read] Got an unexpected txid when tail editlog

2019-08-19 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16910778#comment-16910778 ] Konstantin Shvachko commented on HDFS-14674: Hi [~wangzhaohui], one extra min

[jira] [Commented] (HDFS-14674) [SBN read] Got an unexpected txid when tail editlog

2019-08-15 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908598#comment-16908598 ] Konstantin Shvachko commented on HDFS-14674: Hey [~wangzhaohui], minor things

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907745#comment-16907745 ] Konstantin Shvachko commented on HDFS-13541: +1. Compared most of the files w

[jira] [Created] (HDFS-14734) [FGL] Introduce Latch Lock to replace Namesystem global lock.

2019-08-14 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-14734: -- Summary: [FGL] Introduce Latch Lock to replace Namesystem global lock. Key: HDFS-14734 URL: https://issues.apache.org/jira/browse/HDFS-14734 Project: Hado

[jira] [Created] (HDFS-14733) [FGL] Introduce INode key.

2019-08-14 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-14733: -- Summary: [FGL] Introduce INode key. Key: HDFS-14733 URL: https://issues.apache.org/jira/browse/HDFS-14733 Project: Hadoop HDFS Issue Type: Sub-ta

[jira] [Created] (HDFS-14732) [FGL] Introduce PartitionedGSet a new implementation of GSet.

2019-08-14 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-14732: -- Summary: [FGL] Introduce PartitionedGSet a new implementation of GSet. Key: HDFS-14732 URL: https://issues.apache.org/jira/browse/HDFS-14732 Project: Hado

[jira] [Created] (HDFS-14731) [FGL] Remove redundant locking on NameNode.

2019-08-14 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-14731: -- Summary: [FGL] Remove redundant locking on NameNode. Key: HDFS-14731 URL: https://issues.apache.org/jira/browse/HDFS-14731 Project: Hadoop HDFS I

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907662#comment-16907662 ] Konstantin Shvachko commented on HDFS-14703: Attaching the POC patch. It cons

[jira] [Updated] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14703: --- Attachment: 001-partitioned-inodeMap-POC.tar.gz > NameNode Fine-Grained Locking via M

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907609#comment-16907609 ] Konstantin Shvachko commented on HDFS-13541: Looks good overall. # I suggest

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903491#comment-16903491 ] Konstantin Shvachko commented on HDFS-14204: +1 last patch looks good. TestSa

[jira] [Commented] (HDFS-14655) SBN : Namenode crashes if one of The JN is down

2019-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903466#comment-16903466 ] Konstantin Shvachko commented on HDFS-14655: Hey guys, discussed this with Ch

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903430#comment-16903430 ] Konstantin Shvachko commented on HDFS-12914: Confirmed reverting the patch fi

[jira] [Comment Edited] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903374#comment-16903374 ] Konstantin Shvachko edited comment on HDFS-14703 at 8/8/19 10:10 PM: --

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903374#comment-16903374 ] Konstantin Shvachko commented on HDFS-14703: Hi [~hexiaoqiao], thanks for rev

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903334#comment-16903334 ] Konstantin Shvachko commented on HDFS-14204: Hey [~vagarychen] v6 patch doesn

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901514#comment-16901514 ] Konstantin Shvachko commented on HDFS-14204: Particularly, {{TestDirectorySca

[jira] [Reopened] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

2019-08-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reopened HDFS-14303: Reopening for committing the addendum patch to other versions. > check block directory

[jira] [Commented] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

2019-08-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901510#comment-16901510 ] Konstantin Shvachko commented on HDFS-14303: Looks like the addendum patch wa

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901485#comment-16901485 ] Konstantin Shvachko commented on HDFS-14204: The ASF license warning refers t

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900526#comment-16900526 ] Konstantin Shvachko commented on HDFS-14703: Attached the design document for

[jira] [Updated] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14703: --- Attachment: NameNode Fine-Grained Locking.pdf > NameNode Fine-Grained Locking via Met

[jira] [Created] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-05 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-14703: -- Summary: NameNode Fine-Grained Locking via Metadata Partitioning Key: HDFS-14703 URL: https://issues.apache.org/jira/browse/HDFS-14703 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14370) Edit log tailing fast-path should allow for backoff

2019-08-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899110#comment-16899110 ] Konstantin Shvachko commented on HDFS-14370: +1 on v3 patch. Looks good > Ed

[jira] [Commented] (HDFS-14674) Got an unexpected txid when tail editlog

2019-08-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898439#comment-16898439 ] Konstantin Shvachko commented on HDFS-14674: Hey [~wangzhaohui], thanks for r

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898432#comment-16898432 ] Konstantin Shvachko commented on HDFS-14204: The patch looks good. I ran a bu

[jira] [Commented] (HDFS-14657) Refine NameSystem lock usage during processing FBR

2019-07-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896420#comment-16896420 ] Konstantin Shvachko commented on HDFS-14657: With branch-2 including 2.6 this

[jira] [Comment Edited] (HDFS-14657) Refine NameSystem lock usage during processing FBR

2019-07-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893228#comment-16893228 ] Konstantin Shvachko edited comment on HDFS-14657 at 7/26/19 12:29 AM: -

[jira] [Comment Edited] (HDFS-14657) Refine NameSystem lock usage during processing FBR

2019-07-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893228#comment-16893228 ] Konstantin Shvachko edited comment on HDFS-14657 at 7/26/19 12:29 AM: -

[jira] [Commented] (HDFS-14657) Refine NameSystem lock usage during processing FBR

2019-07-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893228#comment-16893228 ] Konstantin Shvachko commented on HDFS-14657: Hi [~zhangchen]. Looking at your

[jira] [Commented] (HDFS-14573) Backport Standby Read to branch-3

2019-07-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892329#comment-16892329 ] Konstantin Shvachko commented on HDFS-14573: Actually the two YARN tests fail

[jira] [Commented] (HDFS-14573) Backport Standby Read to branch-3

2019-07-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892322#comment-16892322 ] Konstantin Shvachko commented on HDFS-14573: Looks like the {{TestDirectorySc

[jira] [Commented] (HDFS-14657) Refine NameSystem lock usage during processing FBR

2019-07-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887295#comment-16887295 ] Konstantin Shvachko commented on HDFS-14657: I was wondering if you looked at

[jira] [Commented] (HDFS-14573) Backport Standby Read to branch-3

2019-07-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16883357#comment-16883357 ] Konstantin Shvachko commented on HDFS-14573: {{TestDiskBalancer}} is failing

[jira] [Commented] (HDFS-14599) HDFS-12487 breaks test TestDiskBalancer.testDiskBalancerWithFedClusterWithOneNameServiceEmpty

2019-07-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16883354#comment-16883354 ] Konstantin Shvachko commented on HDFS-14599: Should this also need to be comm

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2019-07-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16883339#comment-16883339 ] Konstantin Shvachko commented on HDFS-12733: I am strongly opposing introduci

[jira] [Commented] (HDFS-14611) Move handshake secret field from Token to BlockAccessToken

2019-07-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880784#comment-16880784 ] Konstantin Shvachko commented on HDFS-14611: +1 on my side for v3 patch. > M

[jira] [Commented] (HDFS-14611) Move handshake secret field from Token to BlockAccessToken

2019-06-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875281#comment-16875281 ] Konstantin Shvachko commented on HDFS-14611: Looks reasonable overall, simple

[jira] [Commented] (HDFS-14573) Backport Standby Read to branch-3

2019-06-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875212#comment-16875212 ] Konstantin Shvachko commented on HDFS-14573: +1 for the latest branch-3.2 pat

[jira] [Updated] (HDFS-14047) [libhdfs++] Fix hdfsGetLastExceptionRootCause bug in test_libhdfs_threaded.c

2019-06-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14047: --- Affects Version/s: 3.2.0 Fix Version/s: 3.2.1 I just committed this to branch

[jira] [Comment Edited] (HDFS-11021) Add FSNamesystemLock metrics for BlockManager operations

2019-06-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868969#comment-16868969 ] Konstantin Shvachko edited comment on HDFS-11021 at 6/20/19 10:09 PM: -

[jira] [Commented] (HDFS-11021) Add FSNamesystemLock metrics for BlockManager operations

2019-06-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868969#comment-16868969 ] Konstantin Shvachko commented on HDFS-11021: I think separating IBR and FBR l

[jira] [Comment Edited] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-06-15 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16864884#comment-16864884 ] Konstantin Shvachko edited comment on HDFS-14204 at 6/15/19 10:40 PM: -

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-06-15 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16864884#comment-16864884 ] Konstantin Shvachko commented on HDFS-14204: Checked the patch, looks good, b

[jira] [Commented] (HDFS-14573) Backport Standby Read to branch-3

2019-06-15 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16864876#comment-16864876 ] Konstantin Shvachko commented on HDFS-14573: Thanks [~vagarychen] for moving

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-06-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856051#comment-16856051 ] Konstantin Shvachko commented on HDFS-12979: Wanted to emphasize that with th

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-06-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855171#comment-16855171 ] Konstantin Shvachko commented on HDFS-12979: Only suggestion I can think of f

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2019-05-31 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16853337#comment-16853337 ] Konstantin Shvachko commented on HDFS-12733: I would really prefer if this co

[jira] [Updated] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()

2019-05-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14502: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.3

[jira] [Updated] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()

2019-05-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14502: --- Target Version/s: 2.10.0 Description: {{-keepResults}} option is usually use

[jira] [Updated] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()

2019-05-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14502: --- Component/s: hdfs benchmarks > keepResults option in NNThroughputBen

[jira] [Commented] (HDFS-14500) NameNode StartupProgress continues to report edit log segments after the LOADING_EDITS phase is finished

2019-05-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844399#comment-16844399 ] Konstantin Shvachko commented on HDFS-14500: Do I understand correctly? NN ha

[jira] [Updated] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()

2019-05-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14502: --- Status: Patch Available (was: Open) Simple patch adding {{saveNamespace()}} > keepR

[jira] [Updated] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()

2019-05-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-14502: --- Attachment: HDFS-14502.001.patch > keepResults option in NNThroughputBenchmark should

[jira] [Created] (HDFS-14502) keepResults option in NNThroughputBenchmark should call saveNamespace()

2019-05-20 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-14502: -- Summary: keepResults option in NNThroughputBenchmark should call saveNamespace() Key: HDFS-14502 URL: https://issues.apache.org/jira/browse/HDFS-14502 Pro

[jira] [Created] (HDFS-14494) Move Server logging of StatedId inside receiveRequestState()

2019-05-15 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-14494: -- Summary: Move Server logging of StatedId inside receiveRequestState() Key: HDFS-14494 URL: https://issues.apache.org/jira/browse/HDFS-14494 Project: Hadoo

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-05-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16836754#comment-16836754 ] Konstantin Shvachko commented on HDFS-14245: +1 for v 007 patch > Class cast

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-05-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16835005#comment-16835005 ] Konstantin Shvachko commented on HDFS-14245: +1 looks good > Class cast erro

[jira] [Comment Edited] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-05-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834245#comment-16834245 ] Konstantin Shvachko edited comment on HDFS-14245 at 5/6/19 10:53 PM: --

[jira] [Comment Edited] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-05-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834245#comment-16834245 ] Konstantin Shvachko edited comment on HDFS-14245 at 5/6/19 10:43 PM: --

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-05-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834245#comment-16834245 ] Konstantin Shvachko commented on HDFS-14245: ??getHAServiceState() assumes ST

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-05-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833443#comment-16833443 ] Konstantin Shvachko commented on HDFS-14245: Let's go over it one issue at a

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-04-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16827302#comment-16827302 ] Konstantin Shvachko commented on HDFS-14245: Great, simple is good. # It wou

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-04-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16827227#comment-16827227 ] Konstantin Shvachko commented on HDFS-14245: [~xkrogen] could you please upda

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-04-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820373#comment-16820373 ] Konstantin Shvachko commented on HDFS-14245: [~xkrogen] your option 2 - _ORPP

[jira] [Commented] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2019-04-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808196#comment-16808196 ] Konstantin Shvachko commented on HDFS-13699: +1 on v010 patch. > Add DFSClie

[jira] [Commented] (HDFS-10477) Stop decommission a rack of DataNodes caused NameNode fail over to standby

2019-04-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16807311#comment-16807311 ] Konstantin Shvachko commented on HDFS-10477: Let's target this for 2.10 at th

[jira] [Updated] (HDFS-10477) Stop decommission a rack of DataNodes caused NameNode fail over to standby

2019-04-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10477: --- Target Version/s: 2.10.0 > Stop decommission a rack of DataNodes caused NameNode fail

[jira] [Commented] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2019-04-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16807295#comment-16807295 ] Konstantin Shvachko commented on HDFS-13699: Chen, thanks for the comprehensi

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-03-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16804514#comment-16804514 ] Konstantin Shvachko commented on HDFS-14245: ORPP requires {{ClientProtocol}}

[jira] [Commented] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2019-03-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16802284#comment-16802284 ] Konstantin Shvachko commented on HDFS-13699: Thanks, [~vagarychen] for the pa

[jira] [Commented] (HDFS-14211) [Consistent Observer Reads] Allow for configurable "always msync" mode

2019-03-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795704#comment-16795704 ] Konstantin Shvachko commented on HDFS-14211: Good documentation. +1 on the la

[jira] [Commented] (HDFS-14211) [Consistent Observer Reads] Allow for configurable "always msync" mode

2019-03-16 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794334#comment-16794334 ] Konstantin Shvachko commented on HDFS-14211: +1. All tests pass with HADOOP-1

<    1   2   3   4   5   6   7   8   9   10   >