This is an automated email from the ASF dual-hosted git repository.
fanjia pushed a change to branch dev
in repository https://gitbox.apache.org/repos/asf/seatunnel.git
from a04add6991 [Improve] Add default implement for
`SeaTunnelSource::getProducedType` (#5670)
add eeff242828 [Feature][Spark] Support flow control in Spark (#5510)
No new revisions were added by this update.
Summary of changes:
docs/en/concept/speed-limit.md | 1 +
.../spark/execution/SourceExecuteProcessor.java | 12 ++++++++++++
.../kafka/kafkasource_earliest_to_console.conf | 2 ++
.../kafka/kafkasource_group_offset_to_console.conf | 2 ++
.../spark/source/SeaTunnelSourceSupport.java | 8 ++++++--
.../spark/source/partition/batch/BatchPartition.java | 15 ++++++++++++---
.../source/partition/micro/MicroBatchPartition.java | 13 ++++++++++---
.../spark/source/reader/batch/BatchSourceReader.java | 13 ++++++++++---
.../batch/CoordinatedBatchPartitionReader.java | 11 ++++++++---
.../reader/batch/ParallelBatchPartitionReader.java | 10 ++++++++--
.../micro/CoordinatedMicroBatchPartitionReader.java | 10 +++++++---
.../source/reader/micro/MicroBatchSourceReader.java | 12 +++++++++---
.../micro/ParallelMicroBatchPartitionReader.java | 5 +++--
.../batch/CoordinatedBatchPartitionReader.java | 11 ++++++++---
.../batch/ParallelBatchPartitionReader.java | 10 ++++++++--
.../spark/source/partition/batch/SeaTunnelBatch.java | 11 +++++++++--
.../batch/SeaTunnelBatchPartitionReaderFactory.java | 15 ++++++++++++---
.../micro/CoordinatedMicroBatchPartitionReader.java | 10 +++++++---
.../micro/ParallelMicroBatchPartitionReader.java | 5 +++--
.../SeaTunnelMicroBatchPartitionReaderFactory.java | 9 +++++++--
.../translation/spark/source/scan/SeaTunnelScan.java | 5 ++++-
.../seatunnel-translation-spark-common/pom.xml | 6 +++++-
.../spark/serialization/InternalRowCollector.java | 20 +++++++++++++++++++-
23 files changed, 172 insertions(+), 44 deletions(-)