Github user yssharma commented on a diff in the pull request:
https://github.com/apache/spark/pull/18029#discussion_r120235619
--- Diff:
external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisInputDStream.scala
---
@@ -193,6 +197,21 @@ object KinesisInputDStream {
}
/**
+ * Sets the Kinesis initial position data to the provided timestamp.
+ * Sets InitialPositionInStream to
[[InitialPositionInStream.AT_TIMESTAMP]]
+ * and the timestamp to the provided value.
+ *
+ * @param timestamp Timestamp to resume the Kinesis stream from a
provided
+ * timestamp.
+ * @return Reference to this [[KinesisInputDStream.Builder]]
+ */
+ def withTimestampAtInitialPositionInStream(timestamp: Date) : Builder
= {
--- End diff --
@brkyvz
`withInitialPositionAtTimestamp` is an enhancer method for the
InitialPositionAtTimestamp. If provided It will set the timestamp value along
with the InitialPosition.AT_TIMESTAMP.
Its optional, hence the `initialPositionInStream` can still be used. This
will not introduce and incompatibilities in usage.
Thoughts ?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
