[
https://issues.apache.org/jira/browse/FLINK-18347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140081#comment-17140081
]
Nicholas Jiang edited comment on FLINK-18347 at 6/19/20, 8:54 AM:
------------------------------------------------------------------
[~lining], this error is caused by conflicting versions of the Jackson
libraries. flink-connector-kinesis uses the 1.11.754 version of
aws-java-sdk-kinesis and aws-java-sdk-core. The version of aws-java-sdk-core
uses the 2.6.7 version of jackson-dataformat-cbor, which repository refers to
[AWS SDK For Java Core
1.11.754|https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-core/1.11.754].
But Flink uses the 2.10.1 version of jackson.
{code:java}
[INFO] +- com.amazonaws:aws-java-sdk-kinesis:jar:1.11.754:compile
[INFO] | +- com.amazonaws:aws-java-sdk-core:jar:1.11.754:compile
[INFO] | | +- org.apache.httpcomponents:httpclient:jar:4.5.9:compile
[INFO] | | | +- org.apache.httpcomponents:httpcore:jar:4.4.6:compile
[INFO] | | | \- commons-codec:commons-codec:jar:1.10:compile
[INFO] | | +- software.amazon.ion:ion-java:jar:1.0.2:compile
[INFO] | | +- com.fasterxml.jackson.core:jackson-databind:jar:2.10.1:compile
[INFO] | | | +-
com.fasterxml.jackson.core:jackson-annotations:jar:2.10.1:compile
[INFO] | | | \- com.fasterxml.jackson.core:jackson-core:jar:2.10.1:compile
[INFO] | | +-
com.fasterxml.jackson.dataformat:jackson-dataformat-cbor:jar:2.10.1:compile
[INFO] | | \- joda-time:joda-time:jar:2.5:compile
[INFO] | \- com.amazonaws:jmespath-java:jar:1.11.754:compile
{code}
Therefore, flink-connector-kinesis should modify the version of
jackson-dataformat-cbor to use 2.6.7.
was (Author: nicholasjiang):
[~lining], this exception is caused by conflicting versions of the Jackson
libraries. flink-connector-kinesis uses the 1.11.754 version of
aws-java-sdk-kinesis and aws-java-sdk-core. The version of aws-java-sdk-core
uses the 2.6.7 version of jackson-dataformat-cbor, which repository refers to
[AWS SDK For Java Core
1.11.754|https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-core/1.11.754].
But Flink uses the 2.10.1 version of jackson.
{code:java}
[INFO] +- com.amazonaws:aws-java-sdk-kinesis:jar:1.11.754:compile
[INFO] | +- com.amazonaws:aws-java-sdk-core:jar:1.11.754:compile
[INFO] | | +- org.apache.httpcomponents:httpclient:jar:4.5.9:compile
[INFO] | | | +- org.apache.httpcomponents:httpcore:jar:4.4.6:compile
[INFO] | | | \- commons-codec:commons-codec:jar:1.10:compile
[INFO] | | +- software.amazon.ion:ion-java:jar:1.0.2:compile
[INFO] | | +- com.fasterxml.jackson.core:jackson-databind:jar:2.10.1:compile
[INFO] | | | +-
com.fasterxml.jackson.core:jackson-annotations:jar:2.10.1:compile
[INFO] | | | \- com.fasterxml.jackson.core:jackson-core:jar:2.10.1:compile
[INFO] | | +-
com.fasterxml.jackson.dataformat:jackson-dataformat-cbor:jar:2.10.1:compile
[INFO] | | \- joda-time:joda-time:jar:2.5:compile
[INFO] | \- com.amazonaws:jmespath-java:jar:1.11.754:compile
{code}
Therefore, flink-connector-kinesis should modify the version of
jackson-dataformat-cbor to use 2.6.7.
> kinesis connector throw Error java.lang.NoSuchFieldError: NO_INTS
> -----------------------------------------------------------------
>
> Key: FLINK-18347
> URL: https://issues.apache.org/jira/browse/FLINK-18347
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kinesis
> Affects Versions: 1.10.1
> Reporter: lining
> Assignee: Nicholas Jiang
> Priority: Major
>
> java.lang.NoSuchFieldError: NO_INTSjava.lang.NoSuchFieldError: NO_INTS at
> com.fasterxml.jackson.dataformat.cbor.CBORParser.<init>(CBORParser.java:285)
> ~[usercode.jar:?] at
> com.fasterxml.jackson.dataformat.cbor.CBORParserBootstrapper.constructParser(CBORParserBootstrapper.java:91)
> ~[usercode.jar:?] at
> com.fasterxml.jackson.dataformat.cbor.CBORFactory._createParser(CBORFactory.java:399)
> ~[usercode.jar:?] at
> com.fasterxml.jackson.dataformat.cbor.CBORFactory.createParser(CBORFactory.java:324)
> ~[usercode.jar:?] at
> com.fasterxml.jackson.dataformat.cbor.CBORFactory.createParser(CBORFactory.java:26)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.http.JsonResponseHandler.handle(JsonResponseHandler.java:109)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.http.JsonResponseHandler.handle(JsonResponseHandler.java:43)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.http.response.AwsResponseHandlerAdapter.handle(AwsResponseHandlerAdapter.java:70)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleResponse(AmazonHttpClient.java:1627)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1336)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1113)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:770)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:744)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:726)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:686)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:668)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:532)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:512)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.services.kinesis.AmazonKinesisClient.doInvoke(AmazonKinesisClient.java:2809)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.services.kinesis.AmazonKinesisClient.invoke(AmazonKinesisClient.java:2776)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.services.kinesis.AmazonKinesisClient.invoke(AmazonKinesisClient.java:2765)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.services.kinesis.AmazonKinesisClient.executeListShards(AmazonKinesisClient.java:1557)
> ~[usercode.jar:?] at
> org.apache.flink.kinesis.shaded.com.amazonaws.services.kinesis.AmazonKinesisClient.listShards(AmazonKinesisClient.java:1528)
> ~[usercode.jar:?] at
> org.apache.flink.streaming.connectors.kinesis.proxy.KinesisProxy.listShards(KinesisProxy.java:439)
> ~[usercode.jar:?] at
> org.apache.flink.streaming.connectors.kinesis.proxy.KinesisProxy.getShardsOfStream(KinesisProxy.java:389)
> ~[usercode.jar:?] at
> org.apache.flink.streaming.connectors.kinesis.proxy.KinesisProxy.getShardList(KinesisProxy.java:279)
> ~[usercode.jar:?] at
> org.apache.flink.streaming.connectors.kinesis.internals.KinesisDataFetcher.discoverNewShardsToSubscribe(KinesisDataFetcher.java:686)
> ~[usercode.jar:?] at
> org.apache.flink.streaming.connectors.kinesis.FlinkKinesisConsumer.run(FlinkKinesisConsumer.java:287)
> ~[usercode.jar:?] at
> org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:100)
> ~[flink-dist_2.11-1.10-vvr-1.0.2-SNAPSHOT.jar:1.10-vvr-1.0.2-SNAPSHOT] at
> org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:63)
> ~[flink-dist_2.11-1.10-vvr-1.0.2-SNAPSHOT.jar:1.10-vvr-1.0.2-SNAPSHOT] at
> org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:200)
> ~[flink-dist_2.11-1.10-vvr-1.0.2-SNAPSHOT.jar:1.10-vvr-1.0.2-SNAPSHOT]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
