Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/9970#discussion_r47544052
--- Diff: docs/streaming-kinesis-integration.md ---
@@ -60,18 +60,47 @@ A Kinesis stream can be set up at one of the valid
Kinesis endpoints with 1 or m
[region name], [initial position], [checkpoint
interval], StorageLevel.MEMORY_AND_DISK_2)
See the [API
docs](api/python/pyspark.streaming.html#pyspark.streaming.kinesis.KinesisUtils)
- and the
[example]({{site.SPARK_GITHUB_URL}}/tree/master/extras/kinesis-asl/src/main/python/examples/streaming/kinesis_wordcount_asl.py).
Refer to the next subsection for instructions to run the example.
+ and the
[example]({{site.SPARK_GITHUB_URL}}/tree/master/extras/kinesis-asl/src/main/python/examples/streaming/kinesis_wordcount_asl.py).
Refer to the Running the Example subsection for instructions to run the
example.
</div>
</div>
- - `streamingContext`: StreamingContext containg an application name
used by Kinesis to tie this Kinesis application to the Kinesis stream
+ You may also provide a "message handler function" that takes a Kinesis
`Record` and returns a generic object `T`, in case you would like to use other
data included in a `Record` such as partition key. This is currently only
supported in Java and Python.
--- End diff --
only in Java and Python?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
