This is an automated email from the ASF dual-hosted git repository.
tyrantlucifer pushed a change to branch 2.3.0-release
in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git
from ac4e880fb [Feature][Connector-V2][File] Optimize filesystem utils
(#3749)
new d37cd69ee [Feature][ST-Engine] Support engine restart job information
will not be lost (#3637)
new a3789b7d4 [Feature][Connector V2] expose configurable options in Hudi
(#3383)
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
docs/en/connector-v2/source/Hudi.md | 18 +--
.../seatunnel/hudi/config/HudiSourceConfig.java | 50 +++++--
.../seatunnel/hudi/source/HudiSource.java | 20 +--
.../seatunnel/hudi/source/HudiSourceFactory.java} | 18 +--
.../seatunnel/hudi/HudiFactoryTest.java} | 8 +-
.../engine/e2e/ClusterFaultToleranceIT.java | 149 +++++++++++++--------
.../engine/client/job/ClientJobProxy.java | 1 +
.../apache/seatunnel/engine/common/Constant.java | 16 ++-
seatunnel-engine/seatunnel-engine-server/pom.xml | 19 +--
.../seatunnel/engine/server/SeaTunnelServer.java | 2 +-
.../server/checkpoint/CheckpointManager.java | 4 +-
.../engine/server/dag/physical/SubPlan.java | 4 +-
.../engine/server/persistence/FileMapStore.java | 43 ++++--
.../server/persistence/FileMapStoreFactory.java | 22 ++-
.../serializable/TaskDataSerializerHook.java | 3 +
.../server/checkpoint/CheckpointManagerTest.java | 4 +-
.../engine/imap/storage/api/IMapStorage.java | 2 +-
.../storage/api/common/ProtoStuffSerializer.java | 11 ++
.../imap/storage/api/ProtoStuffSerializerTest.java | 91 +++++++++++++
.../engine/imap/storage/file/IMapFileStorage.java | 18 +--
.../imap/storage/file/IMapFileStorageTest.java | 45 +++++--
21 files changed, 383 insertions(+), 165 deletions(-)
copy
seatunnel-connectors-v2/{connector-hive/src/main/java/org/apache/seatunnel/connectors/seatunnel/hive/source/HiveSourceFactory.java
=>
connector-hudi/src/main/java/org/apache/seatunnel/connectors/seatunnel/hudi/source/HudiSourceFactory.java}
(64%)
copy
seatunnel-connectors-v2/{connector-http/connector-http-jira/src/test/java/org/apache/seatunnel/connectors/seatunnel/jira/JiraFactoryTest.java
=>
connector-hudi/src/test/java/org/apache/seatunnel/connectors/seatunnel/hudi/HudiFactoryTest.java}
(80%)
copy
seatunnel-connectors-v2/connector-elasticsearch/src/main/java/org/apache/seatunnel/connectors/seatunnel/elasticsearch/state/ElasticsearchCommitInfo.java
=>
seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/persistence/FileMapStoreFactory.java
(66%)
create mode 100644
seatunnel-engine/seatunnel-engine-storage/imap-storage-api/src/test/java/org/apache/seatunnel/engine/imap/storage/api/ProtoStuffSerializerTest.java
