This is an automated email from the ASF dual-hosted git repository. shenghang pushed a commit to branch 2.3.10-release in repository https://gitbox.apache.org/repos/asf/seatunnel.git
commit d1aff9a56409aec3652436b7043ddda4da1e32f6 Author: shenghang <[email protected]> AuthorDate: Fri Mar 21 09:48:14 2025 +0800 [Release][2.3.10][release-note] Add release-note --- release-note.md | 441 ++++++++++++++++++++++++++------------------------------ 1 file changed, 208 insertions(+), 233 deletions(-) diff --git a/release-note.md b/release-note.md index 6147093eee..128b6a1924 100644 --- a/release-note.md +++ b/release-note.md @@ -1,236 +1,211 @@ -# next-release - -## Bug fix - -### Core -- [Core] [API] Fixed generic class loss for lists (#4421) -- [Core] [API] Fix parse nested row data type key changed upper (#4459) -- [Starter][Flink]Support transform-v2 for flink #3396 -- [Flink] Support flink 1.14.x #3963 -- [Core][Translation][Spark] Fix SeaTunnelRowConvertor fail to convert when schema contains row type (#5170) - -### Transformer -- [Spark] Support transform-v2 for spark (#3409) -- [ALL]Add FieldMapper Transform #3781 -- [All]Add JsonPath Transform #5633 -### Connectors -- [Elasticsearch] Support https protocol & compatible with opensearch -- [Hbase] Add hbase sink connector #4049 -- [Clickhouse] Fix clickhouse old version compatibility #5326 -- [Easysearch] Support INFINI Easysearch #5933 -- [Web3j] add Web3j source connector #6598 -### Formats -- [Canal]Support read canal format message #3950 -- [Debezium]Support debezium canal format message #3981 - -### Connector-V2 - -- [Json-format] [Canal-Json] Fix json deserialize NPE (#4195) -- [Connector-V2] [Jdbc] Field aliases are not supported in the query of jdbc source. (#4210) -- [Connector-V2] [Jdbc] Fix connection failure caused by connection timeout. (#4322) -- [Connector-V2] [Jdbc] Set default value to false of JdbcOption: generate_sink_sql (#4471) -- [Connector-V2] [JDBC] Fix TiDBCatalog without open (#4718) -- [Connector-V2] [Jdbc] Fix XA DataSource crash(Oracle/Dameng/SqlServer) (#4866) -- [Connector-V2] [Pulsar] Fix the bug that can't consume messages all the time. (#4125) -- [Connector-V2] [Eleasticsearch] Document description error (#4390) -- [Connector-V2] [Eleasticsearch] Source deserializer error and inappropriate (#4233) -- [Connector-V2] [Kafka] Fix KafkaProducer resources have never been released. (#4302) -- [Connector-V2] [Kafka] Fix the permission problem caused by client.id. (#4246) -- [Connector-V2] [Kafka] Fix KafkaConsumerThread exit caused by commit offset error. (#4379) -- [Connector-V2] [Mongodb] Mongodb support cdc sink. (#4833) -- [Connector-V2] [kafka] Fix the problem that the partition information can not be obtained when kafka is restored (#4764) -- [Connector-V2] [SFTP] Fix incorrect exception handling logic (#4720) -- [Connector-V2] [File] Fix read temp file (#4876) -- [Connector-V2] [CDC Base] Solving the ConcurrentModificationException caused by snapshotState being modified concurrently. (#4877) -- [Connector-V2] [Doris] update last checkpoint id when doing snapshot (#4881) -- [Connector-v2] [kafka] Fix the short interval of pull data settings and revise the format (#4875) -- [Connector-v2] [RabbitMQ] Fix reduplicate ack msg bug and code style (#4842) -- [Connector-V2] [Jdbc] Fix the error of extracting primary key column in sink (#4815) -- [Connector-V2] [Jdbc] Fix reconnect throw close statement exception (#4801) -- [Connector-V2] [Jdbc] Fix sqlserver system table case sensitivity (#4806) -- [Connector-v2] [File] Fix configuration file format and error comments (#4762) -- [Connector-v2] [Jdbc] Fix oracle sql table identifier (#4754) -- [Connector-v2] [Clickhouse] fix get clickhouse local table name with closing bracket from distributed table engineFull (#4710) -- [Connector-v2] [CDC] Fix jdbc connection leak for mysql (#5037) -- [Connector-v2] [File] Fix WriteStrategy parallel writing thread unsafe issue #5546 -- [Connector-v2] [File] Inject FileSystem to OrcWriteStrategy -- [Connector-v2] [File] Support assign encoding for file source/sink (#5973) -- [Connector-v2] [Mongodb] Support to convert to double from numeric type that mongodb saved it as numeric internally (#6997) -- [Connector-v2] [Redis] Using scan replace keys operation command,support batchWrite in single mode(#7030,#7085) -- [Connector-V2] [Clickhouse] Add a new optional configuration `clickhouse.config` to the source connector of ClickHouse (#7143) -- [Connector-V2] [Redis] Redis scan command supports versions 3, 4, 5, 6, 7 (#7666) - -### Zeta(ST-Engine) - -- [Zeta] Fix LogicalDagGeneratorTest testcase (#4401) -- [Zeta] Fix MultipleTableJobConfigParser parse only one transform (#4412) -- [Zeta] Fix missing common plugin jars (#4448) -- [Zeta] Fix handleCheckpointError be called while checkpoint already complete (#4442) -- [Zeta] Fix job error message is not right bug (#4463) -- [Zeta] Fix finding TaskGroup deployment node bug (#4449) -- [Zeta] Fix the bug of conf (#4488) -- [Zeta] Fix Connector load logic from zeta (#4510) -- [Zeta] Fix conflict dependency of hadoop-hdfs (#4509) -- [Zeta] Fix TaskExecutionService synchronized lock will not release (#4886) -- [Zeta] Fix TaskExecutionService will return not active ExecutionContext (#4869) -- [Zeta] Fix deploy operation timeout but task already finished bug (#4867) -- [Zeta] Fix restoreComplete Future can't be completed when cancel task (#4863) -- [Zeta] Fix IMap operation timeout bug (#4859) -- [Zeta] fix pipeline state not right bug (#4823) -- [Zeta] Fix the incorrect setting of transform parallelism (#4814) -- [Zeta] Fix master active bug (#4855) -- [Zeta] Fix completePendingCheckpoint concurrent action (#4854) -- [Zeta] Fix engine runtime error (#4850) -- [Zeta] Fix TaskGroupContext always hold classloader so classloader can't recycle (#4849) -- [Zeta] Fix task `notifyTaskStatusToMaster` failed when job not running or failed before run (#4847) -- [Zeta] Fix cpu load problem (#4828) -- [zeta] Fix the deadlock issue with JDBC driver loading (#4878) -- [zeta] dynamically replace the value of the variable at runtime (#4950) -- [Zeta] Add from_unixtime function (#5462) -- [zeta] Fix CDC task restore throw NPE (#5507) -- [Zeta] Fix a checkpoint storage document with OSS (#7507) - -### E2E - -- [E2E] [Kafka] Fix kafka e2e testcase (#4520) -- [Container Version] Fix risk of unreproducible test cases #4591 -- [E2e] [Mysql-cdc] Removing the excess MySqlIncrementalSourceIT e2e reduces the CI time (#4738) -- [E2E] [Common] Update test container version of seatunnel engine (#5323) -- [E2E] [Jdbc] Fix not remove docker image after test finish on jdbc suite (#5586) - -## Improve - -- [Improve][Connector-V2][Jdbc-Source] Support for Decimal types as splict keys (#4634) - -### Core - -- [Core] [Spark] Push transform operation from Spark Driver to Executors (#4503) -- [Core] [Starter] Optimize code structure & remove redundant code (#4525) -- [Core] [Translation] [Flink] Optimize code structure & remove redundant code (#4527) -- [Core] [Starter] Add check of sink and source config to avoid null pointer exception. (#4734) -- [Core] [Flink] Remove useless stage type related codes. (#5650) - -### Formats - -- [Json] Remove assert key word. (#5919) -- [Formats] Replace CommonErrorCodeDeprecated.JSON_OPERATION_FAILED. (#5948) -- [Formats] Refactor exception catch for `ignoreParseErrors`. (#6065) - -### Connector-V2 - -- [Connector-V2] [CDC] Improve startup.mode/stop.mode options (#4360) -- [Connector-V2] [CDC] Optimize jdbc fetch-size options (#4352) -- [Connector-V2] [CDC] Fix chunk start/end parameter type error (#4777) -- [Connector-V2] [SQLServer] Fix sqlserver catalog (#4441) -- [Connector-V2] [StarRocks] Improve StarRocks Serialize Error Message (#4458) -- [Connector-V2] [Jdbc] add the log for sql and update some style (#4475) -- [Connector-V2] [Jdbc] Fix the table name is not automatically obtained when multiple tables (#4514) -- [Connector-V2] [S3 & Kafka] Delete unavailable S3 & Kafka Catalogs (#4477) -- [Connector-V2] [Pulsar] Support Canal Format -- [Connector-V2] [CDC base] Implement Sample-based Sharding Strategy with Configurable Sampling Rate (#4856) -- [Connector-V2] [SelectDB] Add a jobId to the selectDB label to distinguish between tasks (#4864) -- [Connector-V2] [Doris] Add a jobId to the doris label to distinguish between tasks (#4839) (#4853) -- [Connector-v2] [Mongodb]Refactor mongodb connector (#4620) -- [Connector-v2] [Jdbc] Populate primary key when jdbc sink is created using CatalogTable (#4755) -- [Connector-v2] [Neo4j] Supports neo4j sink batch write mode (#4835) -- [Transform-V2] Optimize SQL Transform package and Fix Spark type conversion bug of transform (#4490) -- [Connector-V2] [Common] Remove assert key word (#5915) -- [Connector-V2] Replace CommonErrorCodeDeprecated.JSON_OPERATION_FAILED. (#5978) - -### CI - -- [CI] Fix error repository name in ci config files (#4795) -- [CI][E2E][Zeta] Increase Zeta checkpoint timeout to avoid connector-file-sftp-e2e failed frequently (#5339) - -### Zeta(ST-Engine) - -- [Zeta] Support run the server through daemon mode (#4161) -- [Zeta] Change ClassLoader To Improve the SDK compatibility of the client (#4447) -- [Zeta] Client Support Async Submit Job (#4456) -- [Zeta] Add more detailed log output. (#4446) -- [Zeta] Improve seatunnel-cluster.sh (#4435) -- [Zeta] Reduce CPU Cost When Task Not Ready (#4479) -- [Zeta] Add parser log (#4485) -- [Zeta] Remove redundant code (#4489) -- [Zeta] Remove redundancy code in validateSQL (#4506) -- [Zeta] Improve JobMetrics fetch performance (#4467) -- [Zeta] Reduce the operation count of imap_running_job_metrics (#4861) -- [Zeta] Speed up listAllJob function (#4852) -- [Zeta] async execute checkpoint trigger and other block method (#4846) -- [Zeta] Reduce the number of IMAPs used by checkpointIdCounter (#4832) -- [Zeta] Cancel pipeline add retry to avoid cancel failed. (#4792) -- [Zeta] Improve Zeta operation max count and ignore NPE (#4787) -- [Zeta] Remove serialize(deserialize) cost when use shuffle action (#4722) -- [zeta] Checkpoint exception status messages exclude state data (#5547) -- [Zeta] Remove assert key words (#5947) +# 2.3.10 Release Note ## Feature -### Core - -- [Core] [API] Support convert strings as List<T> option (#4362) -- [Core] [API] Add copy method to Catalog codes (#4414) -- [Core] [API] Add options check before create source and sink and transform in FactoryUtil (#4424) -- [Core] [Shade] Add guava shade module (#4358) -- [Core] [Spark] Support SeaTunnel Time Type (#5188) -- [Core] [Flink] Support Decimal Type with configurable precision and scale (#5419) -- [Core] [API] Support hocon style declare row type in generic type (#6187) - -### Connector-V2 - -- [Connector-V2] [CDC] [SQLServer] Support multi-table read (#4377) -- [Connector-V2] [Kafka] Kafka source supports data deserialization failure skipping (#4364) -- [Connector-V2] [Jdbc] [TiDB] Add TiDB catalog (#4438) -- [Connector-V2] [File] Add file excel sink and source (#4164) -- [Connector-V2] [FILE-OBS] Add Huawei Cloud OBS connector (#4577) -- [Connector-v2] [Snowflake] Add Snowflake Source&Sink connector (#4470) -- [Connector-V2] [Pular] support read format for pulsar (#4111) -- [Connector-V2] [Paimon] Introduce paimon connector (#4178) -- [Connector V2] [Cassandra] Expose configurable options in Cassandra (#3681) -- [Connector V2] [Jdbc] Supports GEOMETRY data type for PostgreSQL (#4673) -- [Connector V2] [Jdbc] Supports Kingbase database (#4803) -- [Transform-V2] Add UDF SPI and an example implement for SQL Transform plugin (#4392) -- [Transform-V2] Support copy field list (#4404) -- [Transform-V2] Add support CatalogTable for FieldMapperTransform (#4423) -- [Transform-V2] Add CatalogTable support for ReplaceTransform (#4411) -- [Transform-V2] Add Catalog support for FilterRowKindTransform (#4420) -- [Transform-V2] Add support CatalogTable for FilterFieldTransform (#4422) -- [Transform-V2] Add catalog support for SQL Transform plugin (#4819) -- [Connector-V2] [Assert] Support check the precision and scale of Decimal type (#6110) -- [Connector-V2] [Assert] Support field type assert and field value equality assert for full data types (#6275) -- [Connector-V2] [Iceberg] Support iceberg sink #6198 -- [Connector-V2] [FILE-OBS] Add Huawei Cloud OBS connector #4578 -- [Connector-V2] [ElasticsSource] Source support multiSource (#6730) - -### Zeta(ST-Engine) - -- [Zeta] Support for mixing Factory and Plugin SPI (#4359) -- [Zeta] Add get running job info by jobId rest api (#4140) -- [Zeta] Add REST API To Get System Monitoring Information (#4315) -- [Transform V2 & Zeta] Make SplitTransform Support CatalogTable And CatalogTable Evolution (#4396) -- [Zeta] Move driver into lib directory and change operation count (#4845) -- [Zeta] Add Metaspace size default value to config file (#4848) -- [Zeta] Reduce the frequency of fetching data from imap (#4851) -- [Zeta] Add OSS support for Imap storage to cluster-mode type (#4683) -- [Zeta] Improve local mode startup request ports (#4660) - -## Docs - -- [Docs] Optimizes part of the Doris and SelectDB connector documentation (#4365) -- [Docs] Fix docs code style (#4368) -- [Docs] Update jdbc doc and kafka doc (#4380) -- [Docs] Fix max_retries default value is 0. (#4383) -- [Docs] Fix markdown syntax (#4426) -- [Docs] Fix Kafka Doc Error Config Key "kafka." (#4427) -- [Docs] Add Transform to Quick Start v2 (#4436) -- [Docs] Fix Dockerfile and seatunnel-flink.yaml in Set Up with Kubernetes (#4788) -- [Docs] Fix Mysql sink format doc (#4800) -- [Docs] Add the generate sink sql parameter for the jdbc sink document (#4797) -- [Docs] Add the generate sink sql parameter And example (#4769) -- [Docs] Redshift add defaultRowFetchSize (#4616) -- [Docs] Refactor connector-v2 docs using unified format Mysql (#4590) -- [Docs] Add Value types in Java to Schema features (#5087) -- [Docs] Replace username by user in the options of FtpFile (#5421) -- [Docs] Add how to configure logging related parameters of SeaTunnel-E2E Test (#5589) -- [Docs] Remove redundant double quotation mark from an example code (#5845) -- [Docs] Add Hive JDBC reference value (#5882) +- [improve] update localfile connector config (#8765) +- [Improve][Zeta] Check closing log file handle every 1 minute (#9003) +- Revert " [improve] update localfile connector config" (#9018) +- [improve] update Web3j connector config option (#9005) +- [Improve] influxdb options (#8966) +- [improve] http connector options (#8969) +- [improve] iotdb options (#8965) +- [improve] email connector options (#8983) +- [Feature][Jdbc] Support sink ddl for sqlserver #8114 (#8936) +- [Improve] iceberg options (#8967) +- [Improve] Update label-scope-conf.yml for core label (#8979) +- [Improve][Core] Support parse quote as key (#8975) +- [Improve][deploy] helm chart config improve (#8954) +- [Feature][Connector-V2] Support between predicate pushdown in paimon (#8962) +- [Improve][Connector-V2] Ensure that the FTP connector behaves reliably during directory operation (#8959) +- [Improve] easysearch options (#8951) +- [Feature][elasticsearch-connector] support elasticsearch sql source (#8895) +- [Improve][Connector-V2] RocketMQ Source add message tag config (#8825) +- [improve] hudi options (#8952) +- [Improve][Shade] Unit the module name of Shade. (#8960) +- [Feature][Connector-V2] Suppor Time type in paimon connector (#8880) +- [improve] fake source options (#8950) +- [Improve] hbase options (#8923) +- [Improve][CDC] Filter ddl for snapshot phase (#8911) +- [Improve][Oracle-CDC] Support ReadOnlyLogWriterFlushStrategy (#8912) +- [improve] google sheets options (#8922) +- [Improve][Connector-V2] Random pick the starrocks fe address which can be connected (#8898) +- [Improve][E2E][Connector V2][CDC Oracle] OracleContainer support ARM architecture images (#8928) +- [Improve] filestore options (#8921) +- [improve] improve TaskLocation/TaskLocationGroup info (#8862) +- [Improve][CDC] Extract duplicate code (#8906) +- [Feature][Paimon] Customize the hadoop user (#8888) +- [Improve][connector-file-base] Improved multiple table file source allocation algorithm for subtasks (#8878) +- [Improve][connector-hive] Improved hive file allocation algorithm for subtasks (#8876) +- [Improve] sink mongodb schema is not required (#8887) +- [Feature][Connector-v2] Support multi starrocks source (#8789) +- [Feature][Kafka] Support native format read/write kafka record (#8724) +- [Improve][Redis] Optimized Redis connection params (#8841) +- [Improve][CDC] Filter heartbeat event (#8569) +- [Improve][Jdbc] Support upsert for opengauss (#8627) +- [Improve][Zeta] Split classloader in job master (#8622) +- [Feature][Connector-V2] Add parameter for read/write file (#8769) +- [Improve] doris options (#8745) +- [Feature][Transform-v2] Add support for Zhipu AI in Embedding and LLM module (#8790) +- [Improve][Jdbc] Remove useless utils. (#8793) +- [improve] update clickhouse connector config option (#8755) +- [Feature][Config] Support custom config keys for encrypt/decrypt (#8739) +- [Improve] rabbit mq options (#8740) +- [Improve] re-struct Zeta Engine config options (#8741) +- [Improve][Zeta] Disable restful api v1 by default (#8766) +- [improve] update kafka source default schema from content<ROW<content STRING>> to content<STRING> (#8642) +- [Feature][Transforms-V2] Handling LLM non-standard format responses (#8551) +- [improve] console sink options (#8743) +- [Improve][Connector-V2] Improve orc read error message (#8751) +- [Improve][connector][activemq] Remove duplicate dependencies (#8753) +- [Improve][Jdbc] Improve catalog connection cache (#8626) +- [improve] datahub sink options (#8744) +- [improve] dingtalk sink options (#8742) +- [improve] Slack connector options (#8738) +- [Improve][Connector-V2] Add optional flag for rocketmq connector to skip parse errors instead of failing (#8737) +- [Improve][Connector-v2][Paimon]PaimonCatalog close error message update (#8640) +- [Feature][Jdbc] Support sink ddl for dameng (#8380) +- [Improve] restruct connector common options (#8634) +- [improve] add StarRocks options (#8639) +- [improve] update Redis connector config option (#8631) +- [improve] add assert options (#8620) +- [Improve][e2e] Remove duplicate dependencies (#8628) +- [improve] update S3File connector config option (#8615) +- [Feature][Connector-V2] Support maxcompute source with multi-table (#8582) +- [improve] add Elasticsearch options (#8623) +- [improve] update amazondynamodb connector (#8601) +- [improve] amazon sqs connector update (#8602) +- [improve] update activemq connector config option (#8580) +- [Feature][transform-v2] jsonpath support map array type (#8577) +- [improve] cassandra connector options (#8608) +- [improve] kafka connector options (#8616) +- [improve] update Druid connector config option (#8594) +- [Refactor][core] Unify transformFactory creation logic (#8574) +- [improve] add connector options class exist check (#8600) +- [Feature][Core] Add slot allocation strategy (#8233) +- [Improve] Update snapshot version to 2.3.10 (#8578) +- [Improve][Jdbc] Remove oracle 'v' query (#8571) +- [feature][core] Unified engine initialization connector logic (#8536) +- [Feature][Iceberg] Support read multi-table (#8524) +- [Feature] [Postgre CDC]support array type (#8560) +- [Feature][Connector-V2] Support create emtpy file when no data (#8543) +- [config][enhance]support use properties when encrypt/decrypt config (#8527) +- [Improve][Connector-v2] add starrocks comment test (#8545) +- [Feature][Transform-V2] llm add deepseek (#8544) +- [Feature][Connector-V2] Support single file mode in file sink (#8518) +- [Improve][Connector-V2] MaxComputeSink support create partition in savemode (#8474) + +## Bug Fix + +- [Fix][Connector-V2] Fix load state check in MilvusSourceReader to consider partition-level status (#8937) +- [Fix][File]use common-csv to read csv file (#8919) +- [Fix][CI] Ignore dead link check for change log commit url (#9001) +- [Fix][Connector-V2] Fix StarRocksCatalogTest#testCatalog() NPE (#8987) +- [Improve] Update nodejs version to fix ci (#8991) +- [Fix][Command] Run seatunnel on windows with fileAppender enabled, no log file been created (#8938) +- [Fix][Connector-V2] Fix maxcompute read with partition spec (#8896) +- [Fix] [Mongo-cdc] Fallback to timestamp startup mode when resume token has expired (#8754) +- [Fix][Connector-V2] Fix text file read separator issue (#8970) +- [hotfix][redis] fix npe cause by null host parameter (#8881) +- [Fix][CI] Update known-dependencies.txt to fix ci (#8947) +- [Fix] [Clickhouse] Parallelism makes data duplicate (#8916) +- [Fix][Connector-V2] Fixed incorrectly setting s3 key in some cases (#8885) +- [Fix]update reload4j version to 1.7.36 (#8883) +- [Fix][chore] Fix --role parameter not working in seatunnel-cluster.cmd (#8877) +- [Fix][Connector-V2] Fix MaxCompute cannot get project and tableName when use schema (#8865) +- [Fix][Connector-File] Fix conflicting requirement (#8823) +- [Fix][Connector-V2] Fix parse SqlServer JDBC Url error (#8784) +- [Fix][Plugin] Optimize the plugin discovery mechanism (#8603) +- [Fix] Fix error log name for SourceSplitEnumerator implements class (#8817) +- [Fix][connector-http] fix when post have param (#8434) +- [Bugfix] Fix ClassCastException of ExceptionUtil (#8776) +- [Fix][Connector-V2] Fix possible data loss in scenarios of request_tablet_size is less than the number of BUCKETS (#8768) +- [Fix][Connector-V2]Fix Descriptions for CUSTOM_SQL in Connector (#8778) +- [Fix][E2e] Optimized pom file name tag (#8770) +- [Fix][Connector-v2] Add DateMilliConvertor to Convert DateMilliVector into Default Timezone (#8736) +- [Fix][Transform] Fix FieldMapper transform lost field constraint information (#8697) +- [Bugfix][Canal] Fix canal serialization to json (#8695) +- [Fix][Connector-V2] Fix jdbc sink statement buffer wrong time to clear (#8653) +- [Fix][Connector-V2] Fix file reading cannot read empty strings (#8646) +- [Fix][Connector-v2][DorisIT]Fix the problem that DorisIT cannot run local (#8630) +- [Fix][transform-v2]LLM transform provider switch case miss break (#8643) +- [Fix][transform-v2]SQL transform support max/min function (#8625) +- [Fix][MySQL-CDC]fix recovery task failure caused by binlog deletion (#8587) +- [Fix][mysql-cdc] Fix GTIDs on startup to correctly recover from checkpoint (#8528) +- [Fix][Connector-V2] User selects csv string pattern (#8572) +- [Fix][doris-e2e] Fix flaky Doris e2e tests (#8596) +- [Fix][Connector-Mongodb] close MongodbClient when close MongodbReader (#8592) +- [Bugfix][example] Fixing spark test cases (#8589) +- [Fix][Connector-V2] fix starRocks automatically creates tables with comment (#8568) +- [Fix][Connector-V2] Fix CSV String type write type (#8499) +- [Hotfix][Connector-V2][SFTP] Add quote to sftp file names with wildcard characters (#8501) +- [Fix][connector-elasticsearch] support elasticsearch nest type && spark with Array<map> (#8492) +- [Fix] [Connector-V2] Postgres support for multiple primary keys (#8526) +- [Fix][File] Fix Multi-file with binary format synchronization failed (#8546) +- [Fix] Update zh table-merge.md (#8535) +- [Fix] Update table-merge.md (#8532) +- [Fix][Connector-V2] Fixed adding table comments (#8514) +- [Fix] [Kafka Source] kafka source use topic as table name instead of fullName (#8401) +- [Fix][Hive] Writing parquet files supports the optional timestamp int96 (#8509) + +## Docs + +- [Improve][Doc] Added automatically generate connector commit history documents (#8948) +- [Fix][Doc] s3 file doc mismatch with code (#8926) +- [Doc][Improve] translate FtpFile related chinese document (#8944) +- [Fix][Doc] Fixed the parameter error in the JDBC doc (#8943) +- [Doc] Fix example error (#8905) +- [Doc][FTP] Fix the dead link of ftp doc. (#8860) +- [Doc][Improve] support chinese [docs/zh/connector-v2/source/CosFile.md] (#8826) +- [Doc][Improve] support chinese [docs/zh/connector-v2/source/Clickhouse.md] (#8824) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/ObsFile.md] (#8827) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/OceanBase.md] (#8830) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Oracle.md] (#8831) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/OssFile.md] (#8832) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/OssJindoFile.md] (#8833) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/RocketMQ.md] (#8834) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/S3-Redshift.md] (#8835) +- [Doc][Improve] support chinese [docs/zh/connector-v2/source/DB2.md] (#8842) +- [Doc][Improve] support chinese [docs/zh/connector-v2/source/Easysearch.md] (#8843) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/SftpFile.md] (#8844) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Snowflake.md] (#8845) +- [Doc][Improve] support chinese [docs/zh/connector-v2/source/FakeSource.md] (#8847) +- [Doc][Improve] support chinese [docs/zh/connector-v2/source/FtpFile.md] (#8848) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/S3File.md] (#8849) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/SelectDB-Cloud.md] (#8850) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/SqlServer.md] (#8851) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Vertica.md] (#8852) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Mysql.md] (#8818) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Tablestore.md] (#8731) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Kudu.md] (#8725) +- [Fix][Doc] fix s3File doc (#8798) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/TDengine.md] (#8732) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Socket.md] (#8729) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Milvus.md] (#8727) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/IoTDB.md] (#8722) +- [Docs][S3File] "Orc Data Type" should be corrected to "Parquet Data Type" in the documentation (#8705) +- [Doc][Improve] support chinese [docs/zh/connector-v2/source/Cassandra.md] (#8704) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/CosFile.md] (#8700) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Slack.md] (#8701) +- [Doc][Improve] support chinese [docs/zh/connector-v2/source/AmazonSqs.md] (#8703) +- [Doc][Improve] support chinese [docs/zh/connector-v2/source/GoogleSheets.md] (#8706) +- [Doc] Add Milvus source zh doc (#8709) +- [Doc][Improve] support chinese [docs/zh/connector-v2/source/Maxcompute.md] (#8708) +- [Doc][Improve] support chinese [docs/zh/connector-v2/source/OpenMldb.md] (#8710) +- [Doc][Improve] support chinese [docs/zh/connector-v2/source/Phoenix.md] (#8711) +- [Improve][Doc] Update old links in doc (#8690) +- [Doc][Improve] support chinese [docs/zh/connector-v2/source/AmazonDynamoDB.md] (#8694) +- [Doc][Improve] support chinese [docs/zh/connector-v2/sink/Sentry.md] #8497 (#8672) +- [Improve][dist] Reduce Docker image size (#8641) +- [hotfix][doc] typo HdfsFile doc (#8613) +- [Doc][Improve] translate Redis/Paimon related chinese document (#8584) +- [Doc][Mysql-cdc]Update doc to support mysql 8.0 (#8579) +- [Doc][Fix]fix deadlink (#8555) +- [Doc][Improve] translate postgresql related chinese document (#8552) +- [Doc][Improve] translate neo4j starrocks related chinese document (#8549) +- [config][doc]add sensitive columns and enhance the doc (#8523) +- [Doc][Translate] translated and corrected the error in the original document (#8505) +- [Fix][Doc] Fix dead link (#8525) +- [Improve][Doc] Update the transform contribute guide (#8487) +- [Docs][Iceberg] translate connector-v2/sink/Iceberg.md to Chinese #8497 (#8520) +- [Fix][Doc] Fix dead link in kubernetes docs (#8510) +- [Improve][Doc] Add remote_user parameter in HdfsFile.md (#8503)
