GitHub user BrianLondon opened a pull request:
https://github.com/apache/spark/pull/10492
[SPARK-12453][Streaming] Remove explicit dependency on aws-java-sdk
Successfully ran kinesis demo on a live, aws hosted kinesis stream against
master and 1.6 branches. For reasons I don't entirely understand it required a
manual merge to 1.5 which I did as shown here:
https://github.com/BrianLondon/spark/commit/075c22e89bc99d5e99be21f40e0d72154a1e23a2
The demo ran successfully on the 1.5 branch as well.
According to `mvn dependency:tree` it is still pulling a fairly old version
of the aws-java-sdk (1.9.37), but this appears to have fixed the kinesis
regression in 1.5.2.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/BrianLondon/spark remove-only
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10492.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10492
----
commit 8e80f5ebf694d7b00f6558ce08bed3d14f82760c
Author: BrianLondon <[email protected]>
Date: 2015-12-10T20:49:07Z
Remove explicit dependency on aws-java-sdk
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
