[
https://issues.apache.org/jira/browse/SPARK-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-12269:
------------------------------
Priority: Minor (was: Major)
Makes some sense, but the question is always: are there any incompatible
changes? do dependencies change? for example I think the Jackson dependency
change is actually in the right direction, to match Spark's, but this is what
you'd need to research and establish if you're asking for a dependency update
across minor versions.
> Update aws-java-sdk version
> ---------------------------
>
> Key: SPARK-12269
> URL: https://issues.apache.org/jira/browse/SPARK-12269
> Project: Spark
> Issue Type: Improvement
> Components: Streaming
> Reporter: Brian London
> Priority: Minor
>
> The current Spark Streaming kinesis connector references a quite old version
> 1.9.40 of the AWS Java SDK (1.10.40 is current). Numerous AWS features
> including Kinesis Firehose are unavailable in 1.9. Those two versions of
> the AWS SDK in turn require conflicting versions of Jackson (2.4.4 and 2.5.3
> respectively) such that one cannot include the current AWS SDK in a project
> that also uses the Spark Streaming Kinesis ASL.
> Bumping the version of Jackson and the AWS library solves this problem and
> will allow Firehose integrations.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
