This is an automated email from the ASF dual-hosted git repository.
dockerzhang pushed a change to branch branch-1.4
in repository https://gitbox.apache.org/repos/asf/inlong.git
from c0546e829 [INLONG-6435][Release] Change the tag of Docker images to
1.4.0 (#6458)
new ce8f194f7 [INLONG-6417][SDK] Support proxy-send mode (#6437)
new 19ba51d4a [INLONG-6409][Sort] Unspported Time and Timestamp iceberg
auto create table in spark session query (#6424)
new 1e3212cdb [INLONG-6438][SDK] Parses and handles ack response from
DataProxy (#6448)
new 077a7e08c [INLONG-6456][Dashboard] Supports management of Oracle
sources (#6469)
new 7644e71d5 [INLONG-6451][Manager] Optimize the resource process of
Kafka MQ (#6455)
new b04d4472e [INLONG-6426][Manager] SortSourceService support multi
stream under one group (#6427)
new f30dec91e [INLONG-6382][Sort] Iceberg data is messed up when the
source table has no primary key in multiple sink scenes (#6461)
The 7 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../inlong/common/msg/AttributeConstants.java | 5 +
inlong-dashboard/src/locales/cn.json | 10 +
inlong-dashboard/src/locales/en.json | 10 +
.../sources/defaults/{MySQLBinlog.ts => Oracle.ts} | 71 ++--
.../src/metas/sources/defaults/index.ts | 5 +
.../resources/mappers/InlongStreamEntityMapper.xml | 3 +-
.../resources/mappers/StreamSinkEntityMapper.xml | 1 +
.../manager/pojo/group/kafka/InlongKafkaDTO.java | 4 -
.../manager/pojo/group/kafka/InlongKafkaInfo.java | 4 -
.../pojo/group/kafka/InlongKafkaRequest.java | 4 -
.../pojo/sort/standalone/SortSourceStreamInfo.java | 23 ++
.../sort/standalone/SortSourceStreamSinkInfo.java | 1 +
.../service/core/impl/SortSourceServiceImpl.java | 96 +++--
.../resource/queue/kafka/KafkaOperator.java | 31 +-
.../queue/kafka/KafkaResourceOperators.java | 18 +-
.../service/resource/queue/kafka/KafkaUtils.java | 27 +-
.../service/source/kafka/KafkaSourceOperator.java | 39 ++
.../manager/service/sort/SortServiceImplTest.java | 24 +-
.../inlong/sdk/dataproxy/DefaultMessageSender.java | 376 +++++++++++++++----
.../apache/inlong/sdk/dataproxy/SendResult.java | 11 +-
.../inlong/sdk/dataproxy/codec/EncodeObject.java | 154 +++++---
.../inlong/sdk/dataproxy/codec/ErrorCode.java | 52 ---
.../sdk/dataproxy/codec/ProtocolDecoder.java | 38 +-
.../inlong/sdk/dataproxy/network/Sender.java | 92 +++--
.../inlong/sdk/dataproxy/utils/ProxyUtils.java | 3 +-
.../org/apache/inlong/sort/base/Constants.java | 14 +
.../base/format/AbstractDynamicSchemaFormat.java | 7 -
.../base/format/CanalJsonDynamicSchemaFormat.java | 25 +-
.../format/DebeziumJsonDynamicSchemaFormat.java | 24 +-
.../base/format/DynamicSchemaFormatFactory.java | 39 +-
.../sort/base/format/JsonDynamicSchemaFormat.java | 50 ++-
.../sort/base/format/JsonToRowDataConverters.java | 414 +++++++++++++++++++++
.../inlong/sort/base/sink/MultipleSinkOption.java | 48 ++-
.../format/CanalJsonDynamicSchemaFormatTest.java | 12 +-
.../DebeziumJsonDynamicSchemaFormatTest.java | 3 +-
...eziumJsonDynamicSchemaFormatWithSchemaTest.java | 3 +-
.../sort/doris/table/DorisDynamicTableFactory.java | 6 +-
.../sort/iceberg/FlinkDynamicTableFactory.java | 4 +
.../inlong/sort/iceberg/IcebergTableSink.java | 4 +
.../apache/inlong/sort/iceberg/sink/FlinkSink.java | 3 +-
.../sink/multiple/DynamicSchemaHandleOperator.java | 4 +-
.../sink/multiple/IcebergMultipleStreamWriter.java | 8 +-
.../sort/kafka/table/KafkaDynamicTableFactory.java | 5 +-
43 files changed, 1274 insertions(+), 501 deletions(-)
copy inlong-dashboard/src/metas/sources/defaults/{MySQLBinlog.ts => Oracle.ts}
(74%)
delete mode 100644
inlong-sdk/dataproxy-sdk/src/main/java/org/apache/inlong/sdk/dataproxy/codec/ErrorCode.java
create mode 100644
inlong-sort/sort-connectors/base/src/main/java/org/apache/inlong/sort/base/format/JsonToRowDataConverters.java