[jira] [Commented] (HDFS-13688) Introduce msync API call

2018-07-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16545898#comment-16545898 ] Chen Liang commented on HDFS-13688: --- I was rebasing the patch, and I found that one of my tests failed.

[jira] [Commented] (HDFS-13688) Introduce msync API call

2018-07-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16545720#comment-16545720 ] Chen Liang commented on HDFS-13688: --- Thanks [~linyiqun], [~zero45] for the comments! Sorry for the late

[jira] [Commented] (HDFS-13688) Introduce msync API call

2018-07-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16529284#comment-16529284 ] Chen Liang commented on HDFS-13688: --- There have been some offline discussion on msync, sharing some

[jira] [Commented] (HDFS-13610) [Edit Tail Fast Path Pt 4] Cleanup: integration test, documentation, remove unnecessary dummy sync

2018-06-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16526676#comment-16526676 ] Chen Liang commented on HDFS-13610: --- v003 patch LGTM, +1, thanks for working on this feature

[jira] [Commented] (HDFS-13617) Allow wrapping NN QOP into token in encrypted message

2018-06-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525318#comment-16525318 ] Chen Liang commented on HDFS-13617: --- Thanks [~xkrogen] for the great comments! I think v002 patch has

[jira] [Updated] (HDFS-13617) Allow wrapping NN QOP into token in encrypted message

2018-06-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13617: -- Attachment: HDFS-13617.003.patch > Allow wrapping NN QOP into token in encrypted message >

[jira] [Commented] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2018-06-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522956#comment-16522956 ] Chen Liang commented on HDFS-13699: --- Post a WIP patch. Tests still need to be added. > Add DFSClient

[jira] [Updated] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2018-06-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13699: -- Attachment: HDFS-13699.WIP.001.patch > Add DFSClient sending handshake token to DataNode, and allow

[jira] [Created] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2018-06-25 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13699: - Summary: Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP Key: HDFS-13699 URL: https://issues.apache.org/jira/browse/HDFS-13699

[jira] [Work started] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2018-06-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13699 started by Chen Liang. - > Add DFSClient sending handshake token to DataNode, and allow DataNode > overwrite

[jira] [Updated] (HDFS-13617) Allow wrapping NN QOP into token in encrypted message

2018-06-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13617: -- Attachment: HDFS-13617.002.patch > Allow wrapping NN QOP into token in encrypted message >

[jira] [Commented] (HDFS-13617) Allow wrapping NN QOP into token in encrypted message

2018-06-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522752#comment-16522752 ] Chen Liang commented on HDFS-13617: --- Rebased with v002 patch. > Allow wrapping NN QOP into token in

[jira] [Updated] (HDFS-13688) Introduce msync API call

2018-06-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13688: -- Attachment: HDFS-13688-HDFS-12943.WIP.002.patch > Introduce msync API call >

[jira] [Commented] (HDFS-13688) Introduce msync API call

2018-06-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522703#comment-16522703 ] Chen Liang commented on HDFS-13688: --- Thanks [~linyiqun] for the review, appreciate it! bq. LastSeenId

[jira] [Updated] (HDFS-13688) Introduce msync API call

2018-06-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13688: -- Attachment: (was: HDFS-13688-HDFS-12943.WIP.002.patch) > Introduce msync API call >

[jira] [Updated] (HDFS-13688) Introduce msync API call

2018-06-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13688: -- Attachment: HDFS-13688-HDFS-12943.WIP.002.patch > Introduce msync API call >

[jira] [Comment Edited] (HDFS-13688) Introduce msync API call

2018-06-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520803#comment-16520803 ] Chen Liang edited comment on HDFS-13688 at 6/22/18 9:51 PM: Post a WIP patch

[jira] [Commented] (HDFS-13688) Introduce msync API call

2018-06-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520803#comment-16520803 ] Chen Liang commented on HDFS-13688: --- Post a WIP patch for early review. This patch depends on

[jira] [Updated] (HDFS-13688) Introduce msync API call

2018-06-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13688: -- Attachment: HDFS-13688-HDFS-12943.WIP.patch > Introduce msync API call > > >

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-06-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519803#comment-16519803 ] Chen Liang commented on HDFS-12977: --- It seems the name space ID is picked up here by reading 

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516480#comment-16516480 ] Chen Liang commented on HDFS-12976: --- Hey [~csun], I just noticed one more thing: although {{ReadOnly}}

[jira] [Work started] (HDFS-13688) Introduce msync API call

2018-06-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13688 started by Chen Liang. - > Introduce msync API call > > > Key:

[jira] [Created] (HDFS-13688) Introduce msync API call

2018-06-18 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13688: - Summary: Introduce msync API call Key: HDFS-13688 URL: https://issues.apache.org/jira/browse/HDFS-13688 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-06-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508613#comment-16508613 ] Chen Liang commented on HDFS-13566: --- Thanks for the review [~ajayydv]! Post v003 patch to address

[jira] [Updated] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-06-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13566: -- Attachment: HDFS-13566.003.patch > Add configurable additional RPC listener to NameNode >

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508344#comment-16508344 ] Chen Liang commented on HDFS-12976: --- Thanks for pointing it out [~xkrogen]. I was not reading into 

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506688#comment-16506688 ] Chen Liang commented on HDFS-12976: --- Hey [~csun], I've got another thought when thinking of how

[jira] [Updated] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-06-07 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13566: -- Status: Patch Available (was: In Progress) > Add configurable additional RPC listener to NameNode >

[jira] [Commented] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-06-07 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505083#comment-16505083 ] Chen Liang commented on HDFS-13566: --- Post v002 patch to address the comments for a Jenkins check.

[jira] [Updated] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-06-07 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13566: -- Attachment: HDFS-13566.002.patch > Add configurable additional RPC listener to NameNode >

[jira] [Commented] (HDFS-13608) [Edit Tail Fast Path Pt 2] Add ability for JournalNode to serve edits via RPC

2018-06-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504065#comment-16504065 ] Chen Liang commented on HDFS-13608: --- Thanks [~xkrogen] for the patch, looks good to me overall, a

[jira] [Commented] (HDFS-13607) [Edit Tail Fast Path Pt 1] Enhance JournalNode with an in-memory cache of recent edit transactions

2018-06-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502392#comment-16502392 ] Chen Liang commented on HDFS-13607: --- Thanks for the followup [~xkrogen]. Sorry for not clarifying it.

[jira] [Updated] (HDFS-13547) Add ingress port based sasl resolver

2018-06-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13547: -- Resolution: Fixed Fix Version/s: 3.1.1 Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-13547) Add ingress port based sasl resolver

2018-06-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502302#comment-16502302 ] Chen Liang commented on HDFS-13547: --- Committed to trunk, thanks [~shv] for the review! > Add ingress

[jira] [Commented] (HDFS-13547) Add ingress port based sasl resolver

2018-06-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502237#comment-16502237 ] Chen Liang commented on HDFS-13547: --- The failed test is unrelated, will commit the patch shortly. >

[jira] [Commented] (HDFS-13607) [Edit Tail Fast Path Pt 1] Enhance JournalNode with an in-memory cache of recent edit transactions

2018-06-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502063#comment-16502063 ] Chen Liang commented on HDFS-13607: --- v002 patch looks pretty good overall, just one comment. In

[jira] [Commented] (HDFS-12976) Introduce StandbyReadProxyProvider

2018-06-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16501028#comment-16501028 ] Chen Liang commented on HDFS-12976: --- Thanks for the quick followup [~csun]! I'm perfectly fine with

[jira] [Commented] (HDFS-12976) Introduce StandbyReadProxyProvider

2018-06-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16500869#comment-16500869 ] Chen Liang commented on HDFS-12976: --- Definitely a tricky change, thanks for working on this [~csun]!

[jira] [Updated] (HDFS-13547) Add ingress port based sasl resolver

2018-06-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13547: -- Attachment: HDFS-13547.004.patch > Add ingress port based sasl resolver >

[jira] [Commented] (HDFS-13547) Add ingress port based sasl resolver

2018-06-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16500694#comment-16500694 ] Chen Liang commented on HDFS-13547: --- Thanks [~shv] for the followup! The compile warnings seem

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497192#comment-16497192 ] Chen Liang commented on HDFS-12978: --- Thanks [~shv] for the followup! I'm okay with optimizing this

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493883#comment-16493883 ] Chen Liang commented on HDFS-12978: --- Thanks for the clarification [~shv]! I missed that. So in this

[jira] [Commented] (HDFS-13547) Add ingress port based sasl resolver

2018-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491362#comment-16491362 ] Chen Liang commented on HDFS-13547: --- Thanks for the review [~shv]! uploaded v003 patch with 2 and 3

[jira] [Updated] (HDFS-13547) Add ingress port based sasl resolver

2018-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13547: -- Attachment: HDFS-13547.003.patch > Add ingress port based sasl resolver >

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491231#comment-16491231 ] Chen Liang commented on HDFS-12978: --- I read through the discussion, seems the concerns are mostly on

[jira] [Created] (HDFS-13617) Allow wrapping NN QOP into token in encrypted message

2018-05-24 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13617: - Summary: Allow wrapping NN QOP into token in encrypted message Key: HDFS-13617 URL: https://issues.apache.org/jira/browse/HDFS-13617 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-13617) Allow wrapping NN QOP into token in encrypted message

2018-05-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13617: -- Attachment: HDFS-13617.001.patch > Allow wrapping NN QOP into token in encrypted message >

[jira] [Work started] (HDFS-13617) Allow wrapping NN QOP into token in encrypted message

2018-05-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13617 started by Chen Liang. - > Allow wrapping NN QOP into token in encrypted message >

[jira] [Work started] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-05-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13566 started by Chen Liang. - > Add configurable additional RPC listener to NameNode >

[jira] [Updated] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-05-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13566: -- Attachment: HDFS-13566.001.patch > Add configurable additional RPC listener to NameNode >

[jira] [Updated] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-05-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13566: -- Attachment: HDFS-13566.001.patch > Add configurable additional RPC listener to NameNode >

[jira] [Updated] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-05-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13566: -- Attachment: (was: HDFS-13566.001.patch) > Add configurable additional RPC listener to NameNode >

[jira] [Created] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-05-15 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13566: - Summary: Add configurable additional RPC listener to NameNode Key: HDFS-13566 URL: https://issues.apache.org/jira/browse/HDFS-13566 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-13547) Add ingress port based sasl resolver

2018-05-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13547: -- Attachment: HDFS-13547.002.patch > Add ingress port based sasl resolver >

[jira] [Commented] (HDFS-13547) Add ingress port based sasl resolver

2018-05-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474470#comment-16474470 ] Chen Liang commented on HDFS-13547: --- v002 patch to resolver findbug and checkstyle warnings. > Add

[jira] [Updated] (HDFS-13547) Add ingress port based sasl resolver

2018-05-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13547: -- Status: Patch Available (was: Open) > Add ingress port based sasl resolver >

[jira] [Commented] (HDFS-13547) Add ingress port based sasl resolver

2018-05-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472588#comment-16472588 ] Chen Liang commented on HDFS-13547: --- v001 patch adds only ingress port to the interface as for now.

[jira] [Updated] (HDFS-13547) Add ingress port based sasl resolver

2018-05-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13547: -- Attachment: HDFS-13547.001.patch > Add ingress port based sasl resolver >

[jira] [Created] (HDFS-13547) Add ingress port based sasl resolver

2018-05-11 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13547: - Summary: Add ingress port based sasl resolver Key: HDFS-13547 URL: https://issues.apache.org/jira/browse/HDFS-13547 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2018-05-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471159#comment-16471159 ] Chen Liang commented on HDFS-13541: --- Thought a bit more about passing additional fields of the

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2018-05-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470781#comment-16470781 ] Chen Liang commented on HDFS-13541: --- Thanks a lot for taking a look [~benoyantony]! bq. We could also

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2018-05-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469155#comment-16469155 ] Chen Liang commented on HDFS-13541: --- [~benoyantony], would you be interested in taking a look? cc.

[jira] [Updated] (HDFS-13541) NameNode Port based selective encryption

2018-05-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13541: -- Attachment: NameNode Port based selective encryption-v1.pdf > NameNode Port based selective encryption

[jira] [Created] (HDFS-13541) NameNode Port based selective encryption

2018-05-09 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13541: - Summary: NameNode Port based selective encryption Key: HDFS-13541 URL: https://issues.apache.org/jira/browse/HDFS-13541 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-13286) Add haadmin commands to transition between standby and observer

2018-04-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449121#comment-16449121 ] Chen Liang commented on HDFS-13286: --- Thanks [~csun] for working on this! the patch LGTM, only two minor

[jira] [Commented] (HDFS-13418) NetworkTopology should be configurable when enable DFSNetworkTopology

2018-04-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16434231#comment-16434231 ] Chen Liang commented on HDFS-13418: --- Thans [~Tao Jie] and [~linyiqun] for the followup! v003 patch LGTM,

[jira] [Commented] (HDFS-13418) NetworkTopology should be configurable when enable DFSNetworkTopology

2018-04-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432565#comment-16432565 ] Chen Liang commented on HDFS-13418: --- Thanks for the discussion [~Tao Jie] and [~linyiqun]! The change in

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402512#comment-16402512 ] Chen Liang commented on HDFS-12977: --- Thanks [~zero45] for working on this! patch looks pretty good to

[jira] [Comment Edited] (HDFS-11142) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk

2018-03-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395828#comment-16395828 ] Chen Liang edited comment on HDFS-11142 at 3/12/18 8:33 PM: Hi [~linyiqun],

[jira] [Commented] (HDFS-11142) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk

2018-03-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395828#comment-16395828 ] Chen Liang commented on HDFS-11142: --- Hi [~linyiqun], Thanks for reporting this! One question, is there

[jira] [Commented] (HDFS-11398) TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure still fails intermittently

2018-03-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395717#comment-16395717 ] Chen Liang commented on HDFS-11398: --- Hi [~linyiqun], Thanks for reporting this. I looked at the patch

[jira] [Updated] (HDFS-13161) Update comment in start-dfs.sh to mention correct variable for secure datanode user

2018-02-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13161: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Update comment in start-dfs.sh to

[jira] [Commented] (HDFS-13161) Update comment in start-dfs.sh to mention correct variable for secure datanode user

2018-02-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368037#comment-16368037 ] Chen Liang commented on HDFS-13161: --- +1 on v000 patch, I've committed to trunk, thanks Ajay for the

[jira] [Comment Edited] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354286#comment-16354286 ] Chen Liang edited comment on HDFS-10453 at 2/6/18 6:22 PM: --- Thanks for the

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354286#comment-16354286 ] Chen Liang commented on HDFS-10453: --- Thanks for the follow up [~hexiaoqiao]! bq. if check if(targets ==

[jira] [Comment Edited] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353143#comment-16353143 ] Chen Liang edited comment on HDFS-10453 at 2/6/18 12:50 AM: This is a very

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353143#comment-16353143 ] Chen Liang commented on HDFS-10453: --- This is a very tricky case, thanks [~hexiaoqiao] for working on

[jira] [Commented] (HDFS-13048) LowRedundancyReplicatedBlocks metric can be negative

2018-01-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346064#comment-16346064 ] Chen Liang commented on HDFS-13048: --- Thanks for the catch [~ajisakaa]! +1 on v002 patch.  >

[jira] [Commented] (HDFS-13079) Provide a config to start namenode in safemode state upto a certain transaction id

2018-01-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344356#comment-16344356 ] Chen Liang commented on HDFS-13079: --- Thanks for working on this [~msingh]! I've only quickly looked at

[jira] [Updated] (HDFS-13036) Reusing the volume storage ID obtained by replicaInfo

2018-01-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13036: -- Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-13036) Reusing the volume storage ID obtained by replicaInfo

2018-01-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333123#comment-16333123 ] Chen Liang commented on HDFS-13036: --- Thanks [~liaoyuxiangqin] for the catch! The failed tests are

[jira] [Commented] (HDFS-13017) Block Storage: implement simple iscsi discovery in jscsi server

2018-01-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325395#comment-16325395 ] Chen Liang commented on HDFS-13017: --- Thanks [~elek] for working on this! v001 patch LGTM, just one

[jira] [Updated] (HDFS-12989) Ozone: Container : Add key versioning support-4

2018-01-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12989: -- Attachment: HDFS-12989-HDFS-7240.001.patch > Ozone: Container : Add key versioning support-4 >

[jira] [Work started] (HDFS-12989) Ozone: Container : Add key versioning support-4

2018-01-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12989 started by Chen Liang. - > Ozone: Container : Add key versioning support-4 >

[jira] [Created] (HDFS-12989) Ozone: Container : Add key versioning support-4

2018-01-04 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12989: - Summary: Ozone: Container : Add key versioning support-4 Key: HDFS-12989 URL: https://issues.apache.org/jira/browse/HDFS-12989 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12980) Ozone: SCM: Restructuring container state transition and events

2018-01-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308903#comment-16308903 ] Chen Liang commented on HDFS-12980: --- Thanks [~anu] for the follow-up explanation! I was also thinking it

[jira] [Commented] (HDFS-12980) Ozone: SCM: Restructuring container state transition and events

2018-01-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308880#comment-16308880 ] Chen Liang commented on HDFS-12980: --- Thanks for the illustration [~anu]! Still though, is there a reason

[jira] [Commented] (HDFS-12980) Ozone: SCM: Restructuring container state transition and events

2018-01-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308761#comment-16308761 ] Chen Liang commented on HDFS-12980: --- Thanks for working on this [~nandakumar131]! I'm just looking at

[jira] [Commented] (HDFS-12940) Ozone: KSM: TestKeySpaceManager#testExpiredOpenKey fails occasionally

2018-01-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308660#comment-16308660 ] Chen Liang commented on HDFS-12940: --- [~nandakumar131] how often did you see these tests fail? I ran

[jira] [Updated] (HDFS-12954) Ozone: Container : Add key versioning support-3

2017-12-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12954: -- Attachment: HDFS-12954-HDFS-7240.001.patch > Ozone: Container : Add key versioning support-3 >

[jira] [Work started] (HDFS-12954) Ozone: Container : Add key versioning support-3

2017-12-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12954 started by Chen Liang. - > Ozone: Container : Add key versioning support-3 >

[jira] [Updated] (HDFS-12958) Ozone: remove setAllocatedBytes method in ContainerInfo

2017-12-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12958: -- Attachment: HDFS-12958-HDFS-7240.001.patch Post v001 patch. [~nandakumar131] would you mind taking a

[jira] [Updated] (HDFS-12958) Ozone: remove setAllocatedBytes method in ContainerInfo

2017-12-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12958: -- Status: Patch Available (was: Open) > Ozone: remove setAllocatedBytes method in ContainerInfo >

[jira] [Updated] (HDFS-12951) Incorrect javadoc in SaslDataTransferServer.java#receive

2017-12-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12951: -- Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-12951) Incorrect javadoc in SaslDataTransferServer.java#receive

2017-12-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300466#comment-16300466 ] Chen Liang commented on HDFS-12951: --- Thanks [~msingh] for the catch, the failed tests and findbug

[jira] [Assigned] (HDFS-12958) Ozone: remove setAllocatedBytes method in ContainerInfo

2017-12-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-12958: - Assignee: Chen Liang > Ozone: remove setAllocatedBytes method in ContainerInfo >

[jira] [Commented] (HDFS-12751) Ozone: SCM: update container allocated size to container db for all the open containers in ContainerStateManager#close

2017-12-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300395#comment-16300395 ] Chen Liang commented on HDFS-12751: --- Thanks for the clarification [~nandakumar131]. Filed HDFS-12958 as

[jira] [Created] (HDFS-12958) Ozone: remove setAllocatedBytes method in ContainerInfo

2017-12-21 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12958: - Summary: Ozone: remove setAllocatedBytes method in ContainerInfo Key: HDFS-12958 URL: https://issues.apache.org/jira/browse/HDFS-12958 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12954) Ozone: Container : Add key versioning support-3

2017-12-20 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12954: - Summary: Ozone: Container : Add key versioning support-3 Key: HDFS-12954 URL: https://issues.apache.org/jira/browse/HDFS-12954 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12751) Ozone: SCM: update container allocated size to container db for all the open containers in ContainerStateManager#close

2017-12-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298970#comment-16298970 ] Chen Liang commented on HDFS-12751: --- Thanks [~nandakumar131] for the comment! bq. 1. Getting all the

<    3   4   5   6   7   8   9   10   11   12   >