[jira] [Commented] (CASSANDRA-16426) Cannot read from C* during migration

2021-02-08 Thread Marius Morlock (Jira)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-16426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280917#comment-17280917
 ] 

Marius Morlock commented on CASSANDRA-16426:


Hello Alex,

here is the how we created the table that causes the issue:
{code:java}
CREATE TABLE file.log (
tenant text,
year smallint,
month tinyint,
day tinyint,
hour tinyint,
time timestamp,
category text,
format_version text,
message text,
user text,
PRIMARY KEY ((tenant, year, month, day, hour), time)
) WITH CLUSTERING ORDER BY (time DESC)
AND bloom_filter_fp_chance = 0.01
AND caching = '{"keys":"ALL", "rows_per_partition":"NONE"}'
AND comment = ''
AND compaction = {'class': 
'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'}
AND compression = {'sstable_compression': 
'org.apache.cassandra.io.compress.LZ4Compressor'}
AND dclocal_read_repair_chance = 0.1
AND default_time_to_live = 0
AND gc_grace_seconds = 864000
AND max_index_interval = 2048
AND memtable_flush_period_in_ms = 0
AND min_index_interval = 128
AND read_repair_chance = 0.0
AND speculative_retry = '99.0PERCENTILE';
{code}
We cannot read anything from the C* cluster during the migration process. The 
cluster has 3 nodes which are all C* version 2.2.9 before we start the upgrade 
and we want to upgrade all nodes to version 3.11.

Do you need any further information? In the datastax ticket that I linked above 
are more details to the tables before and after the migration.
Thank you and best regards!

 

> Cannot read from C* during migration
> 
>
> Key: CASSANDRA-16426
> URL: https://issues.apache.org/jira/browse/CASSANDRA-16426
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Marius Morlock
>Priority: Normal
>
> Hello,
> We tried to migrate our C* clusters from 2.2.9 to 3.11.6. During the 
> migration our clients (using C* driver version 3.4.0 ) failed with the 
> following exception and were continuously reporting the exception. 
> Interestingly after the migration, the same clients are running fine and no 
> issues are being reported. We have observed this on multiple migrations. As 
> this issue occurs we cannot read from C* which causes unwanted downtimes.
> {code:java}
> java.lang.RuntimeException: 
> com.datastax.driver.core.exceptions.CodecNotFoundException: Codec not found 
> for requested operation: ['org.apache.cassandra.db.marshal.ShortType' <-> 
> java.lang.Short] at com.test.LogReader.readFromDB(LogReader.java:150) at 
> com.test.readLogData(LogReader.java:113) at 
> com.test.retrieveLogs(LogApiServletV2.java:124) at 
> com.test.doGet(LogApiServletV2.java:82) 
> atjavax.servlet.http.HttpServlet.service(HttpServlet.java:626) at 
> javax.servlet.http.HttpServlet.service(HttpServlet.java:733) at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
>  at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
>  at 
> org.apache.tomee.webservices.CXFJAXRSFilter.doFilter(CXFJAXRSFilter.java:83) 
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
>  at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
>  at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
>  at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
>  at 
> org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118)
>  at 
> org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:154)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> 

[jira] [Updated] (CASSANDRA-16426) Cannot read from C* during migration

2021-02-05 Thread Marius Morlock (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-16426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marius Morlock updated CASSANDRA-16426:
---
Bug Category: Parent values: Availability(12983)Level 1 values: 
Unavailable(12994)

> Cannot read from C* during migration
> 
>
> Key: CASSANDRA-16426
> URL: https://issues.apache.org/jira/browse/CASSANDRA-16426
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Marius Morlock
>Priority: Normal
>
> Hello,
> We tried to migrate our C* clusters from 2.2.9 to 3.11.6. During the 
> migration our clients (using C* driver version 3.4.0 ) failed with the 
> following exception and were continuously reporting the exception. 
> Interestingly after the migration, the same clients are running fine and no 
> issues are being reported. We have observed this on multiple migrations. As 
> this issue occurs we cannot read from C* which causes unwanted downtimes.
> {code:java}
> java.lang.RuntimeException: 
> com.datastax.driver.core.exceptions.CodecNotFoundException: Codec not found 
> for requested operation: ['org.apache.cassandra.db.marshal.ShortType' <-> 
> java.lang.Short] at com.test.LogReader.readFromDB(LogReader.java:150) at 
> com.test.readLogData(LogReader.java:113) at 
> com.test.retrieveLogs(LogApiServletV2.java:124) at 
> com.test.doGet(LogApiServletV2.java:82) 
> atjavax.servlet.http.HttpServlet.service(HttpServlet.java:626) at 
> javax.servlet.http.HttpServlet.service(HttpServlet.java:733) at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
>  at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
>  at 
> org.apache.tomee.webservices.CXFJAXRSFilter.doFilter(CXFJAXRSFilter.java:83) 
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
>  at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
>  at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
>  at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
>  at 
> org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118)
>  at 
> org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:154)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.oauth2.provider.authentication.OAuth2AuthenticationProcessingFilter.doFilter(OAuth2AuthenticationProcessingFilter.java:176)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:50)
>  at 
> org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192)
>  at 
> org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160)
>  at 
> 

[jira] [Created] (CASSANDRA-16426) Cannot read from C* during migration

2021-02-05 Thread Marius Morlock (Jira)
Marius Morlock created CASSANDRA-16426:
--

 Summary: Cannot read from C* during migration
 Key: CASSANDRA-16426
 URL: https://issues.apache.org/jira/browse/CASSANDRA-16426
 Project: Cassandra
  Issue Type: Bug
Reporter: Marius Morlock


Hello,

We tried to migrate our C* clusters from 2.2.9 to 3.11.6. During the migration 
our clients (using C* driver version 3.4.0 ) failed with the following 
exception and were continuously reporting the exception. Interestingly after 
the migration, the same clients are running fine and no issues are being 
reported. We have observed this on multiple migrations. As this issue occurs we 
cannot read from C* which causes unwanted downtimes.
{code:java}
java.lang.RuntimeException: 
com.datastax.driver.core.exceptions.CodecNotFoundException: Codec not found for 
requested operation: ['org.apache.cassandra.db.marshal.ShortType' <-> 
java.lang.Short] at com.test.LogReader.readFromDB(LogReader.java:150) at 
com.test.readLogData(LogReader.java:113) at 
com.test.retrieveLogs(LogApiServletV2.java:124) at 
com.test.doGet(LogApiServletV2.java:82) 
atjavax.servlet.http.HttpServlet.service(HttpServlet.java:626) at 
javax.servlet.http.HttpServlet.service(HttpServlet.java:733) at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
 at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
 at 
org.apache.tomee.webservices.CXFJAXRSFilter.doFilter(CXFJAXRSFilter.java:83) at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
 at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
 at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
 at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
 at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
 at 
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118)
 at 
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84)
 at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
 at 
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
 at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
 at 
org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103)
 at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
 at 
org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:154)
 at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
 at 
org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)
 at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
 at 
org.springframework.security.oauth2.provider.authentication.OAuth2AuthenticationProcessingFilter.doFilter(OAuth2AuthenticationProcessingFilter.java:176)
 at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
 at 
org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:50)
 at 
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
 at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
 at 
org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
 at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
 at 
org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192)
 at 
org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160)
 at 
org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:344)
 at 
org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:261)
 at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
 at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
 at 

[jira] [Updated] (CASSANDRA-16426) Cannot read from C* during migration

2021-02-05 Thread Marius Morlock (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-16426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marius Morlock updated CASSANDRA-16426:
---
Platform:   (was: All)

> Cannot read from C* during migration
> 
>
> Key: CASSANDRA-16426
> URL: https://issues.apache.org/jira/browse/CASSANDRA-16426
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Marius Morlock
>Priority: Normal
>
> Hello,
> We tried to migrate our C* clusters from 2.2.9 to 3.11.6. During the 
> migration our clients (using C* driver version 3.4.0 ) failed with the 
> following exception and were continuously reporting the exception. 
> Interestingly after the migration, the same clients are running fine and no 
> issues are being reported. We have observed this on multiple migrations. As 
> this issue occurs we cannot read from C* which causes unwanted downtimes.
> {code:java}
> java.lang.RuntimeException: 
> com.datastax.driver.core.exceptions.CodecNotFoundException: Codec not found 
> for requested operation: ['org.apache.cassandra.db.marshal.ShortType' <-> 
> java.lang.Short] at com.test.LogReader.readFromDB(LogReader.java:150) at 
> com.test.readLogData(LogReader.java:113) at 
> com.test.retrieveLogs(LogApiServletV2.java:124) at 
> com.test.doGet(LogApiServletV2.java:82) 
> atjavax.servlet.http.HttpServlet.service(HttpServlet.java:626) at 
> javax.servlet.http.HttpServlet.service(HttpServlet.java:733) at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
>  at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
>  at 
> org.apache.tomee.webservices.CXFJAXRSFilter.doFilter(CXFJAXRSFilter.java:83) 
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
>  at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
>  at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
>  at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
>  at 
> org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118)
>  at 
> org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:154)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.oauth2.provider.authentication.OAuth2AuthenticationProcessingFilter.doFilter(OAuth2AuthenticationProcessingFilter.java:176)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:50)
>  at 
> org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192)
>  at 
> org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160)
>  at 
> 

[jira] [Updated] (CASSANDRA-16426) Cannot read from C* during migration

2021-02-05 Thread Marius Morlock (Jira)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-16426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marius Morlock updated CASSANDRA-16426:
---
Impacts:   (was: None)

> Cannot read from C* during migration
> 
>
> Key: CASSANDRA-16426
> URL: https://issues.apache.org/jira/browse/CASSANDRA-16426
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Marius Morlock
>Priority: Normal
>
> Hello,
> We tried to migrate our C* clusters from 2.2.9 to 3.11.6. During the 
> migration our clients (using C* driver version 3.4.0 ) failed with the 
> following exception and were continuously reporting the exception. 
> Interestingly after the migration, the same clients are running fine and no 
> issues are being reported. We have observed this on multiple migrations. As 
> this issue occurs we cannot read from C* which causes unwanted downtimes.
> {code:java}
> java.lang.RuntimeException: 
> com.datastax.driver.core.exceptions.CodecNotFoundException: Codec not found 
> for requested operation: ['org.apache.cassandra.db.marshal.ShortType' <-> 
> java.lang.Short] at com.test.LogReader.readFromDB(LogReader.java:150) at 
> com.test.readLogData(LogReader.java:113) at 
> com.test.retrieveLogs(LogApiServletV2.java:124) at 
> com.test.doGet(LogApiServletV2.java:82) 
> atjavax.servlet.http.HttpServlet.service(HttpServlet.java:626) at 
> javax.servlet.http.HttpServlet.service(HttpServlet.java:733) at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
>  at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
>  at 
> org.apache.tomee.webservices.CXFJAXRSFilter.doFilter(CXFJAXRSFilter.java:83) 
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
>  at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
>  at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
>  at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
>  at 
> org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118)
>  at 
> org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:154)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.oauth2.provider.authentication.OAuth2AuthenticationProcessingFilter.doFilter(OAuth2AuthenticationProcessingFilter.java:176)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:50)
>  at 
> org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
>  at 
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>  at 
> org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192)
>  at 
> org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160)
>  at 
>