Christopher Highman created SPARK-32155:
-------------------------------------------
Summary: Provide options for offset-based semantics when using
structured streaming from a file stream source
Key: SPARK-32155
URL: https://issues.apache.org/jira/browse/SPARK-32155
Project: Spark
Issue Type: Improvement
Components: Structured Streaming
Affects Versions: 3.1.0
Reporter: Christopher Highman
Implement the following options while performing structured streaming from a
file data source:
{code:java}
startingOffsetsByTimestamp
endingOffsetsByTimestamp
startingOffsets
endingOffsets
{code}
These options currently exist when using structured streaming from a Kafka data
source.
*Please see comments from the below PR for details.*
[#28841|[https://github.com/apache/spark/pull/28841]]
*Example from usage with Kafka data source*
[http://spark.apache.org/docs/latest/structured-streaming-kafka-integration.html#creating-a-kafka-source-for-batch-queries]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
