This is an automated email from the ASF dual-hosted git repository.
kabhwan pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 58d4da1 [SPARK-35486][CORE] TaskMemoryManager: retry if other task
takes memory freed by partial self-spill
add a57afd4 [SPARK-29223][SQL][SS] New option to specify timestamp on all
subscribing topic-partitions in Kafka source
No new revisions were added by this update.
Summary of changes:
docs/structured-streaming-kafka-integration.md | 63 ++++---
.../spark/sql/kafka010/KafkaContinuousStream.scala | 2 +
.../spark/sql/kafka010/KafkaMicroBatchStream.scala | 2 +
.../spark/sql/kafka010/KafkaOffsetRangeLimit.scala | 7 +
.../spark/sql/kafka010/KafkaOffsetReader.scala | 14 ++
.../sql/kafka010/KafkaOffsetReaderAdmin.scala | 34 ++++
.../sql/kafka010/KafkaOffsetReaderConsumer.scala | 36 ++++
.../apache/spark/sql/kafka010/KafkaSource.scala | 2 +
.../spark/sql/kafka010/KafkaSourceProvider.scala | 85 ++++++----
.../sql/kafka010/KafkaMicroBatchSourceSuite.scala | 181 +++++++++++++++++----
.../spark/sql/kafka010/KafkaRelationSuite.scala | 47 ++++++
11 files changed, 394 insertions(+), 79 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]