[
https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071157#comment-15071157
]
Martin Schade commented on SPARK-12453:
---------------------------------------
I can confirm that removing the dependency works as well. Something I tried as
well but thought the least amount of change is preferred. However, removing the
dependency will get rid of possible future version conflicts and therefore less
effort and risk in the long run.
> Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version
> ------------------------------------------------------------------------
>
> Key: SPARK-12453
> URL: https://issues.apache.org/jira/browse/SPARK-12453
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Affects Versions: 1.5.2
> Reporter: Martin Schade
> Priority: Critical
> Labels: easyfix
>
> The Spark Streaming Kinesis Example (kinesis-asl) is broken due to wrong AWS
> Java SDK version (1.9.16) referenced with the AWS KCL version (1.3.0).
> AWS KCL 1.3.0 references AWS Java SDK version 1.9.37.
> Using 1.9.16 in combination with 1.3.0 does fail to get data out of the
> stream.
> I tested Spark Streaming with 1.9.37 and it works fine.
> Testing a simple KCL client outside of Spark with 1.3.0 and 1.9.16 also
> fails, so it is due to the specific versions used in 1.5.2 and not a Spark
> related implementation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
