[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15069720#comment-15069720 ]
Brian London commented on SPARK-12453: -------------------------------------- To be clear then, the two changes are 1) remove the explicit Aws Java Sdk dependency and bump the KCL version and 2) bump the Jackson version as in https://github.com/apache/spark/pull/10256? You're saying backport 1 into 1.5.x and leave 2 in master/1.6? As for the AWS version we should really get on to 1.10.x and off the 1.9.x branch, although I do prefer dropping the explicit dependency altogether. > Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version > ------------------------------------------------------------------------ > > Key: SPARK-12453 > URL: https://issues.apache.org/jira/browse/SPARK-12453 > Project: Spark > Issue Type: Bug > Components: Streaming > Affects Versions: 1.5.2 > Reporter: Martin Schade > Priority: Critical > Labels: easyfix > > The Spark Streaming Kinesis Example (kinesis-asl) is broken due to wrong AWS > Java SDK version (1.9.16) referenced with the AWS KCL version (1.3.0). > AWS KCL 1.3.0 references AWS Java SDK version 1.9.37. > Using 1.9.16 in combination with 1.3.0 does fail to get data out of the > stream. > I tested Spark Streaming with 1.9.37 and it works fine. > Testing a simple KCL client outside of Spark with 1.3.0 and 1.9.16 also > fails, so it is due to the specific versions used in 1.5.2 and not a Spark > related implementation. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org