GitHub user brkyvz opened a pull request:
https://github.com/apache/spark/pull/8954
[SPARK-10891][STREAMING][KINESIS] Add MessageHandler to
KinesisUtils.createStream similar to Direct Kafka
This PR allows users to map a Kinesis `Record` to a generic `T` when
creating a Kinesis stream. This is particularly useful, if you would like to do
extra work with Kinesis metadata such as sequence number, and partition key.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/brkyvz/spark kinesis-handler
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/8954.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #8954
----
commit 40c92b31bf91b263ca727ba05b4405d9071c7e32
Author: Burak Yavuz <[email protected]>
Date: 2015-10-01T05:53:51Z
added message handler
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
