Github user BrianLondon commented on the pull request:
https://github.com/apache/spark/pull/10256#issuecomment-163781633
I ran the demo with the following two commands against a stream
(test-stream1) on my AWS account. It performed as expected.
bin/run-example streaming.KinesisWordProducerASL test-stream1
https://kinesis.us-east-1.amazonaws.com 100 10
bin/run-example streaming.KinesisWordCountASL testapp test-stream1
https://kinesis.us-east-1.amazonaws.com
I happy to bump the KCL library as well. With the bumped
com.fasterxml.jackson.core version, the project build and passed all tests
except docker-integration, which I can't run. AWS Java SDK 1.10.40 calls a
function that isn't provided by Jackson 2.4.x. If raising that to 2.5.x isn't
an option, then we can find whatever the last version of AWS Java SDK to not
use it is. I know it works with 1.10.24, so somewhere between 1.10.24 and
1.10.40 could be a temporary solution.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
