[jira] [Updated] (HADOOP-12453) Support decoding KMS Delegation Token with its own Identifier
[ https://issues.apache.org/jira/browse/HADOOP-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-12453: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.8.0 Status: Resolved (was: Patch Available) Committed to trunk, branch-2, and branch-2.8. Thanks again Xiaoyu! > Support decoding KMS Delegation Token with its own Identifier > - > > Key: HADOOP-12453 > URL: https://issues.apache.org/jira/browse/HADOOP-12453 > Project: Hadoop Common > Issue Type: Improvement > Components: kms, security >Affects Versions: 2.4.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao > Fix For: 2.8.0, 3.0.0-alpha2 > > Attachments: HADOOP-12453.00.patch, HADOOP-12453.01.patch, > HADOOP-12453.02.patch, HADOOP-12453.03.patch, HADOOP-12453.04.patch, > HADOOP-12453.05.patch > > > kms-dt currently does not have its own token identifier class to decode it > properly as shown in the HDFS logs below. This JIRA is opened to add support > for that. > {code} > 2015-09-30 > 22:36:14,379|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 WARN token.Token: Cannot find class for token kind kms-dt > 2015-09-30 > 22:36:14,380|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 INFO security.TokenCache: Got dt for > hdfs://tde-hdfs-3.novalocal:8020; Kind: kms-dt, Service: 172.22.64.179:9292, > Ident: 00 06 68 72 74 5f 71 61 02 72 6d 00 8a 01 50 20 66 1c a3 8a 01 50 44 > 72 a0 a3 0f 03 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-12453) Support decoding KMS Delegation Token with its own Identifier
[ https://issues.apache.org/jira/browse/HADOOP-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-12453: --- Attachment: HADOOP-12453.05.patch Patch 5 to fix the checkstyle that was hidden by a checkstyle. Verified locally the KMSDT class doesn't have any checkstyle issue [~xyao] could you take a quick look again? Sorry for the back and forth. > Support decoding KMS Delegation Token with its own Identifier > - > > Key: HADOOP-12453 > URL: https://issues.apache.org/jira/browse/HADOOP-12453 > Project: Hadoop Common > Issue Type: Improvement > Components: kms, security >Affects Versions: 2.4.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao > Attachments: HADOOP-12453.00.patch, HADOOP-12453.01.patch, > HADOOP-12453.02.patch, HADOOP-12453.03.patch, HADOOP-12453.04.patch, > HADOOP-12453.05.patch > > > kms-dt currently does not have its own token identifier class to decode it > properly as shown in the HDFS logs below. This JIRA is opened to add support > for that. > {code} > 2015-09-30 > 22:36:14,379|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 WARN token.Token: Cannot find class for token kind kms-dt > 2015-09-30 > 22:36:14,380|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 INFO security.TokenCache: Got dt for > hdfs://tde-hdfs-3.novalocal:8020; Kind: kms-dt, Service: 172.22.64.179:9292, > Ident: 00 06 68 72 74 5f 71 61 02 72 6d 00 8a 01 50 20 66 1c a3 8a 01 50 44 > 72 a0 a3 0f 03 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-12453) Support decoding KMS Delegation Token with its own Identifier
[ https://issues.apache.org/jira/browse/HADOOP-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-12453: --- Attachment: HADOOP-12453.04.patch Oops, 1 more checkstyle.. > Support decoding KMS Delegation Token with its own Identifier > - > > Key: HADOOP-12453 > URL: https://issues.apache.org/jira/browse/HADOOP-12453 > Project: Hadoop Common > Issue Type: Improvement > Components: kms, security >Affects Versions: 2.4.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao > Attachments: HADOOP-12453.00.patch, HADOOP-12453.01.patch, > HADOOP-12453.02.patch, HADOOP-12453.03.patch, HADOOP-12453.04.patch > > > kms-dt currently does not have its own token identifier class to decode it > properly as shown in the HDFS logs below. This JIRA is opened to add support > for that. > {code} > 2015-09-30 > 22:36:14,379|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 WARN token.Token: Cannot find class for token kind kms-dt > 2015-09-30 > 22:36:14,380|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 INFO security.TokenCache: Got dt for > hdfs://tde-hdfs-3.novalocal:8020; Kind: kms-dt, Service: 172.22.64.179:9292, > Ident: 00 06 68 72 74 5f 71 61 02 72 6d 00 8a 01 50 20 66 1c a3 8a 01 50 44 > 72 a0 a3 0f 03 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-12453) Support decoding KMS Delegation Token with its own Identifier
[ https://issues.apache.org/jira/browse/HADOOP-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-12453: --- Attachment: HADOOP-12453.03.patch Attaching patch 3 to fix the checkstyle. [~xyao], could you take a look? Thanks. > Support decoding KMS Delegation Token with its own Identifier > - > > Key: HADOOP-12453 > URL: https://issues.apache.org/jira/browse/HADOOP-12453 > Project: Hadoop Common > Issue Type: Improvement > Components: kms, security >Affects Versions: 2.4.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao > Attachments: HADOOP-12453.00.patch, HADOOP-12453.01.patch, > HADOOP-12453.02.patch, HADOOP-12453.03.patch > > > kms-dt currently does not have its own token identifier class to decode it > properly as shown in the HDFS logs below. This JIRA is opened to add support > for that. > {code} > 2015-09-30 > 22:36:14,379|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 WARN token.Token: Cannot find class for token kind kms-dt > 2015-09-30 > 22:36:14,380|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 INFO security.TokenCache: Got dt for > hdfs://tde-hdfs-3.novalocal:8020; Kind: kms-dt, Service: 172.22.64.179:9292, > Ident: 00 06 68 72 74 5f 71 61 02 72 6d 00 8a 01 50 20 66 1c a3 8a 01 50 44 > 72 a0 a3 0f 03 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-12453) Support decoding KMS Delegation Token with its own Identifier
[ https://issues.apache.org/jira/browse/HADOOP-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HADOOP-12453: Attachment: HADOOP-12453.02.patch Thanks [~xiaochen] for the review. Update the patch based on the feedback. The TOKEN_KIND/TOKEN_KIND_STR in KMSCP have been used by upstream projects such as Ranger KMS and other KMS server implementations. Keep it as-is to make the change backward compatible. > Support decoding KMS Delegation Token with its own Identifier > - > > Key: HADOOP-12453 > URL: https://issues.apache.org/jira/browse/HADOOP-12453 > Project: Hadoop Common > Issue Type: Improvement > Components: kms, security >Affects Versions: 2.4.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao > Attachments: HADOOP-12453.00.patch, HADOOP-12453.01.patch, > HADOOP-12453.02.patch > > > kms-dt currently does not have its own token identifier class to decode it > properly as shown in the HDFS logs below. This JIRA is opened to add support > for that. > {code} > 2015-09-30 > 22:36:14,379|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 WARN token.Token: Cannot find class for token kind kms-dt > 2015-09-30 > 22:36:14,380|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 INFO security.TokenCache: Got dt for > hdfs://tde-hdfs-3.novalocal:8020; Kind: kms-dt, Service: 172.22.64.179:9292, > Ident: 00 06 68 72 74 5f 71 61 02 72 6d 00 8a 01 50 20 66 1c a3 8a 01 50 44 > 72 a0 a3 0f 03 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-12453) Support decoding KMS Delegation Token with its own Identifier
[ https://issues.apache.org/jira/browse/HADOOP-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HADOOP-12453: Attachment: HADOOP-12453.01.patch Thanks [~xiaochen] for the heads up. I've updated the patch to address the comments. Decide to keep the KMSDelegationToken class as a placeholder for the kms-dt related constants and the identifier class. Please review, thanks! > Support decoding KMS Delegation Token with its own Identifier > - > > Key: HADOOP-12453 > URL: https://issues.apache.org/jira/browse/HADOOP-12453 > Project: Hadoop Common > Issue Type: Improvement > Components: kms, security >Affects Versions: 2.4.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao > Attachments: HADOOP-12453.00.patch, HADOOP-12453.01.patch > > > kms-dt currently does not have its own token identifier class to decode it > properly as shown in the HDFS logs below. This JIRA is opened to add support > for that. > {code} > 2015-09-30 > 22:36:14,379|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 WARN token.Token: Cannot find class for token kind kms-dt > 2015-09-30 > 22:36:14,380|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 INFO security.TokenCache: Got dt for > hdfs://tde-hdfs-3.novalocal:8020; Kind: kms-dt, Service: 172.22.64.179:9292, > Ident: 00 06 68 72 74 5f 71 61 02 72 6d 00 8a 01 50 20 66 1c a3 8a 01 50 44 > 72 a0 a3 0f 03 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-12453) Support decoding KMS Delegation Token with its own Identifier
[ https://issues.apache.org/jira/browse/HADOOP-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HADOOP-12453: Status: Patch Available (was: Open) > Support decoding KMS Delegation Token with its own Identifier > - > > Key: HADOOP-12453 > URL: https://issues.apache.org/jira/browse/HADOOP-12453 > Project: Hadoop Common > Issue Type: Improvement > Components: kms, security >Affects Versions: 2.4.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao > Attachments: HADOOP-12453.00.patch > > > kms-dt currently does not have its own token identifier class to decode it > properly as shown in the HDFS logs below. This JIRA is opened to add support > for that. > {code} > 2015-09-30 > 22:36:14,379|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 WARN token.Token: Cannot find class for token kind kms-dt > 2015-09-30 > 22:36:14,380|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 INFO security.TokenCache: Got dt for > hdfs://tde-hdfs-3.novalocal:8020; Kind: kms-dt, Service: 172.22.64.179:9292, > Ident: 00 06 68 72 74 5f 71 61 02 72 6d 00 8a 01 50 20 66 1c a3 8a 01 50 44 > 72 a0 a3 0f 03 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-12453) Support decoding KMS Delegation Token with its own Identifier
[ https://issues.apache.org/jira/browse/HADOOP-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HADOOP-12453: Attachment: HADOOP-12453.00.patch Add the KMSDelegationTokenIdentifier class to decode it properly in Token#tokenMap. > Support decoding KMS Delegation Token with its own Identifier > - > > Key: HADOOP-12453 > URL: https://issues.apache.org/jira/browse/HADOOP-12453 > Project: Hadoop Common > Issue Type: Improvement > Components: kms, security >Affects Versions: 2.4.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao > Attachments: HADOOP-12453.00.patch > > > kms-dt currently does not have its own token identifier class to decode it > properly as shown in the HDFS logs below. This JIRA is opened to add support > for that. > {code} > 2015-09-30 > 22:36:14,379|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 WARN token.Token: Cannot find class for token kind kms-dt > 2015-09-30 > 22:36:14,380|beaver.machine|INFO|5619|140004068153152|MainThread|15/09/30 > 22:36:14 INFO security.TokenCache: Got dt for > hdfs://tde-hdfs-3.novalocal:8020; Kind: kms-dt, Service: 172.22.64.179:9292, > Ident: 00 06 68 72 74 5f 71 61 02 72 6d 00 8a 01 50 20 66 1c a3 8a 01 50 44 > 72 a0 a3 0f 03 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)