[
https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17885643#comment-17885643
]
wayne cook edited comment on HDFS-15098 at 9/29/24 6:13 AM:
------------------------------------------------------------
I have a error message as follows, when i update to hadoop 3.4.0 from 3.3.4.
{code:java}
# The namenode log
2024-09-27 16:41:39 ERROR org.apache.ranger.plugin.util.PolicyRefresher:
PolicyRefresher(serviceName=hdfs-service): failed to refresh policies. Will
continue to use last known version of policies
(10)javax.ws.rs.WebApplicationException:
com.sun.xml.bind.v2.runtime.IllegalAnnotationsException: 2 counts of
IllegalAnnotationExceptionsjava.util.Map is an interface, and JAXB can't handle
interfaces. this problem is related to the following location:
at java.util.Map at private java.util.List
org.apache.ranger.plugin.model.RangerPolicy.additionalResources
at org.apache.ranger.plugin.model.RangerPolicy at private
java.util.List org.apache.ranger.plugin.util.ServicePolicies.policies
at org.apache.ranger.plugin.util.ServicePoliciesjava.util.Map does not
have a no-arg default constructor. this problem is related to the
following location: at java.util.Map at private
java.util.List org.apache.ranger.plugin.model.RangerPolicy.additionalResources
at org.apache.ranger.plugin.model.RangerPolicy at private
java.util.List org.apache.ranger.plugin.util.ServicePolicies.policies
at org.apache.ranger.plugin.util.ServicePolicies
at
com.sun.jersey.core.provider.jaxb.AbstractRootElementProvider.readFrom(AbstractRootElementProvider.java:115)
at com.sun.jersey.api.client.ClientResponse.getEntity(ClientResponse.java:634)
at com.sun.jersey.api.client.ClientResponse.getEntity(ClientResponse.java:586)
at
org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdatedWithCred(RangerAdminRESTClient.java:858)
at
org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:146)
at
org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:308)
at
org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:247)
at
org.apache.ranger.plugin.util.PolicyRefresher.run(PolicyRefresher.java:209)Caused
by: com.sun.xml.bind.v2.runtime.IllegalAnnotationsException: 2 counts of
IllegalAnnotationExceptionsjava.util.Map is an interface, and JAXB can't handle
interfaces. this problem is related to the following location:
at java.util.Map at private java.util.List
org.apache.ranger.plugin.model.RangerPolicy.additionalResources
at org.apache.ranger.plugin.model.RangerPolicy at private
java.util.List org.apache.ranger.plugin.util.ServicePolicies.policies
at org.apache.ranger.plugin.util.ServicePoliciesjava.util.Map does not
have a no-arg default constructor. this problem is related to the
following location: at java.util.Map at private
java.util.List org.apache.ranger.plugin.model.RangerPolicy.additionalResources
at org.apache.ranger.plugin.model.RangerPolicy at private
java.util.List org.apache.ranger.plugin.util.ServicePolicies.policies
at org.apache.ranger.plugin.util.ServicePolicies
at
com.sun.xml.bind.v2.runtime.IllegalAnnotationsException$Builder.check(IllegalAnnotationsException.java:106)
at
com.sun.xml.bind.v2.runtime.JAXBContextImpl.getTypeInfoSet(JAXBContextImpl.java:489)
at
com.sun.xml.bind.v2.runtime.JAXBContextImpl.<init>(JAXBContextImpl.java:319) at
com.sun.xml.bind.v2.runtime.JAXBContextImpl$JAXBContextBuilder.build(JAXBContextImpl.java:1170)
at
com.sun.xml.bind.v2.ContextFactory.createContext(ContextFactory.java:145) at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498) at
javax.xml.bind.ContextFinder.newInstance(ContextFinder.java:247) at
javax.xml.bind.ContextFinder.newInstance(ContextFinder.java:234) at
javax.xml.bind.ContextFinder.find(ContextFinder.java:441) at
javax.xml.bind.JAXBContext.newInstance(JAXBContext.java:641) at
javax.xml.bind.JAXBContext.newInstance(JAXBContext.java:584) at
com.sun.jersey.core.provider.jaxb.AbstractJAXBProvider.getStoredJAXBContext(AbstractJAXBProvider.java:196)
at
com.sun.jersey.core.provider.jaxb.AbstractJAXBProvider.getJAXBContext(AbstractJAXBProvider.java:188)
at
com.sun.jersey.core.provider.jaxb.AbstractJAXBProvider.getUnmarshaller(AbstractJAXBProvider.java:140)
at
com.sun.jersey.core.provider.jaxb.AbstractJAXBProvider.getUnmarshaller(AbstractJAXBProvider.java:123)
at
com.sun.jersey.core.provider.jaxb.AbstractRootElementProvider.readFrom(AbstractRootElementProvider.java:111)
... 7 more
{code}
ranger: 2.4.0
hadoop: 3.4.0 SM4
HDFS SM4 test is success！
was (Author: JIRAUSER306130):
I have a error message as follows, when i update to hadoop 3.4.0 from 3.3.4.
{code:java}
# The namenode log
2024-09-27 16:41:39 ERROR org.apache.ranger.plugin.util.PolicyRefresher:
PolicyRefresher(serviceName=hdfs-service): failed to refresh policies. Will
continue to use last known version of policies
(10)javax.ws.rs.WebApplicationException:
com.sun.xml.bind.v2.runtime.IllegalAnnotationsException: 2 counts of
IllegalAnnotationExceptionsjava.util.Map is an interface, and JAXB can't handle
interfaces. this problem is related to the following location:
at java.util.Map at private java.util.List
org.apache.ranger.plugin.model.RangerPolicy.additionalResources
at org.apache.ranger.plugin.model.RangerPolicy at private
java.util.List org.apache.ranger.plugin.util.ServicePolicies.policies
at org.apache.ranger.plugin.util.ServicePoliciesjava.util.Map does not
have a no-arg default constructor. this problem is related to the
following location: at java.util.Map at private
java.util.List org.apache.ranger.plugin.model.RangerPolicy.additionalResources
at org.apache.ranger.plugin.model.RangerPolicy at private
java.util.List org.apache.ranger.plugin.util.ServicePolicies.policies
at org.apache.ranger.plugin.util.ServicePolicies
at
com.sun.jersey.core.provider.jaxb.AbstractRootElementProvider.readFrom(AbstractRootElementProvider.java:115)
at com.sun.jersey.api.client.ClientResponse.getEntity(ClientResponse.java:634)
at com.sun.jersey.api.client.ClientResponse.getEntity(ClientResponse.java:586)
at
org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdatedWithCred(RangerAdminRESTClient.java:858)
at
org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:146)
at
org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:308)
at
org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:247)
at
org.apache.ranger.plugin.util.PolicyRefresher.run(PolicyRefresher.java:209)Caused
by: com.sun.xml.bind.v2.runtime.IllegalAnnotationsException: 2 counts of
IllegalAnnotationExceptionsjava.util.Map is an interface, and JAXB can't handle
interfaces. this problem is related to the following location:
at java.util.Map at private java.util.List
org.apache.ranger.plugin.model.RangerPolicy.additionalResources
at org.apache.ranger.plugin.model.RangerPolicy at private
java.util.List org.apache.ranger.plugin.util.ServicePolicies.policies
at org.apache.ranger.plugin.util.ServicePoliciesjava.util.Map does not
have a no-arg default constructor. this problem is related to the
following location: at java.util.Map at private
java.util.List org.apache.ranger.plugin.model.RangerPolicy.additionalResources
at org.apache.ranger.plugin.model.RangerPolicy at private
java.util.List org.apache.ranger.plugin.util.ServicePolicies.policies
at org.apache.ranger.plugin.util.ServicePolicies
at
com.sun.xml.bind.v2.runtime.IllegalAnnotationsException$Builder.check(IllegalAnnotationsException.java:106)
at
com.sun.xml.bind.v2.runtime.JAXBContextImpl.getTypeInfoSet(JAXBContextImpl.java:489)
at
com.sun.xml.bind.v2.runtime.JAXBContextImpl.<init>(JAXBContextImpl.java:319) at
com.sun.xml.bind.v2.runtime.JAXBContextImpl$JAXBContextBuilder.build(JAXBContextImpl.java:1170)
at
com.sun.xml.bind.v2.ContextFactory.createContext(ContextFactory.java:145) at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498) at
javax.xml.bind.ContextFinder.newInstance(ContextFinder.java:247) at
javax.xml.bind.ContextFinder.newInstance(ContextFinder.java:234) at
javax.xml.bind.ContextFinder.find(ContextFinder.java:441) at
javax.xml.bind.JAXBContext.newInstance(JAXBContext.java:641) at
javax.xml.bind.JAXBContext.newInstance(JAXBContext.java:584) at
com.sun.jersey.core.provider.jaxb.AbstractJAXBProvider.getStoredJAXBContext(AbstractJAXBProvider.java:196)
at
com.sun.jersey.core.provider.jaxb.AbstractJAXBProvider.getJAXBContext(AbstractJAXBProvider.java:188)
at
com.sun.jersey.core.provider.jaxb.AbstractJAXBProvider.getUnmarshaller(AbstractJAXBProvider.java:140)
at
com.sun.jersey.core.provider.jaxb.AbstractJAXBProvider.getUnmarshaller(AbstractJAXBProvider.java:123)
at
com.sun.jersey.core.provider.jaxb.AbstractRootElementProvider.readFrom(AbstractRootElementProvider.java:111)
... 7 more
{code}
ranger: 2.4.0
hadoop: 3.4.0
HDFS SM4 test is success！
> Add SM4 encryption method for HDFS
> ----------------------------------
>
> Key: HDFS-15098
> URL: https://issues.apache.org/jira/browse/HDFS-15098
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: hdfs
> Affects Versions: 3.4.0
> Reporter: liusheng
> Assignee: liusheng
> Priority: Major
> Labels: pull-request-available, sm4
> Fix For: 3.4.0
>
> Attachments: HDFS-15098.001.patch, HDFS-15098.002.patch,
> HDFS-15098.003.patch, HDFS-15098.004.patch, HDFS-15098.005.patch,
> HDFS-15098.006.patch, HDFS-15098.007.patch, HDFS-15098.008.patch,
> HDFS-15098.009.patch, image-2020-08-19-16-54-41-341.png
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> SM4 (formerly SMS4)is a block cipher used in the Chinese National Standard
> for Wireless LAN WAPI (Wired Authentication and Privacy Infrastructure).
> SM4 was a cipher proposed to for the IEEE 802.11i standard, but has so far
> been rejected by ISO. One of the reasons for the rejection has been
> opposition to the WAPI fast-track proposal by the IEEE. please see:
> [https://en.wikipedia.org/wiki/SM4_(cipher)]
>
> *Use sm4 on hdfs as follows:*
> 1.Configure Hadoop KMS
> 2.test HDFS sm4
> hadoop key create key1 -cipher 'SM4/CTR/NoPadding'
> hdfs dfs -mkdir /benchmarks
> hdfs crypto -createZone -keyName key1 -path /benchmarks
> *requires:*
> 1.openssl version >=1.1.1
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
