This is an automated email from the ASF dual-hosted git repository.
wanghailin pushed a change to branch dev
in repository https://gitbox.apache.org/repos/asf/seatunnel.git
from 021af147cc [Feature] [Postgre CDC]support array type (#8560)
add 2bfb97e502 [Feature][Iceberg] Support read multi-table (#8524)
No new revisions were added by this update.
Summary of changes:
docs/en/connector-v2/source/Iceberg.md | 50 ++++---
.../seatunnel/iceberg/config/SourceConfig.java | 81 +++++-----
.../iceberg/config/SourceTableConfig.java | 81 ++++++++++
.../seatunnel/iceberg/sink/IcebergSinkWriter.java | 1 +
.../sink/commit/IcebergAggregatedCommitter.java | 7 +-
.../seatunnel/iceberg/source/IcebergSource.java | 138 +++++++----------
.../iceberg/source/IcebergSourceFactory.java | 47 ++++--
.../source/enumerator/AbstractSplitEnumerator.java | 163 ++++++++++++++++-----
.../enumerator/IcebergBatchSplitEnumerator.java | 79 ++++++----
.../enumerator/IcebergSplitEnumeratorState.java | 53 ++++++-
.../enumerator/IcebergStreamSplitEnumerator.java | 114 +++++++++-----
.../source/enumerator/scan/IcebergScanContext.java | 32 ++--
.../enumerator/scan/IcebergScanSplitPlanner.java | 2 +-
.../reader/IcebergFileScanTaskSplitReader.java | 2 +
.../iceberg/source/reader/IcebergSourceReader.java | 125 ++++++++++------
.../source/split/IcebergFileScanTaskSplit.java | 10 +-
.../e2e/connector/iceberg/IcebergSourceIT.java | 1 +
.../src/test/resources/iceberg/iceberg_source.conf | 6 +-
.../connector/iceberg/hadoop3/IcebergSourceIT.java | 1 +
.../e2e/connector/iceberg/s3/IcebergSourceIT.java | 1 +
20 files changed, 665 insertions(+), 329 deletions(-)
create mode 100644
seatunnel-connectors-v2/connector-iceberg/src/main/java/org/apache/seatunnel/connectors/seatunnel/iceberg/config/SourceTableConfig.java