This is an automated email from the ASF dual-hosted git repository.
dockerzhang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/inlong.git
The following commit(s) were added to refs/heads/master by this push:
new ded6ab0cd4 [INLONG-9649][Release] Update changes log for the 1.11.0
version (#9668)
ded6ab0cd4 is described below
commit ded6ab0cd42c36b70ad6bc1320b8ca98b8a196be
Author: 卢春亮 <[email protected]>
AuthorDate: Sun Feb 4 19:56:32 2024 +0800
[INLONG-9649][Release] Update changes log for the 1.11.0 version (#9668)
---
CHANGES.md | 322 +++++++++++++++++++------------------------------------------
1 file changed, 99 insertions(+), 223 deletions(-)
diff --git a/CHANGES.md b/CHANGES.md
index 8b420df30c..cdfe9f9c98 100644
--- a/CHANGES.md
+++ b/CHANGES.md
@@ -22,238 +22,114 @@
# of release header or remove the below marker. This file is generated.
# DO NOT REMOVE THIS MARKER; FOR INTERPOLATING CHANGES!-->
-# Release InLong 1.10.0 - Released (as of 2023-12-05)
+# Release InLong 1.11.0 - Released (as of 2024-02-04)
### Agent
-| ISSUE | Summary
|
-|:-----------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------|
-| [INLONG-9089](https://github.com/apache/inlong/issues/9089) |
[Improve][Agent] Add enums for task and instance
|
-| [INLONG-9091](https://github.com/apache/inlong/issues/9091) |
[Improve][Agent] Add offset profile
|
-| [INLONG-9094](https://github.com/apache/inlong/issues/9094) |
[Umbrella][Agent] Reconfiguration of task management
|
-| [INLONG-9102](https://github.com/apache/inlong/issues/9102) |
[Improve][Agent] Add file utils
|
-| [INLONG-9112](https://github.com/apache/inlong/issues/9112) |
[Improve][Agent] Add task and instance profile
|
-| [INLONG-9117](https://github.com/apache/inlong/issues/9117) |
[Improve][Agent] Rewrite class RocksDbImp to enable it to be constructed with a
child path |
-| [INLONG-9120](https://github.com/apache/inlong/issues/9120) |
[Improve][Agent] Add offset db to store the offset data
|
-| [INLONG-9122](https://github.com/apache/inlong/issues/9122) |
[Improve][Agent] Add task and instance action
|
-| [INLONG-9124](https://github.com/apache/inlong/issues/9124) |
[Improve][Agent] Add task and instance db
|
-| [INLONG-9125](https://github.com/apache/inlong/issues/9125) |
[Improve][Agent] Add offset manager
|
-| [INLONG-9132](https://github.com/apache/inlong/issues/9132) |
[Improve][Agent] Add file used message cache
|
-| [INLONG-9134](https://github.com/apache/inlong/issues/9134) |
[Improve][Agent] Add file related utils
|
-| [INLONG-9136](https://github.com/apache/inlong/issues/9136) |
[Improve][Agent] Add instance manager
|
-| [INLONG-9138](https://github.com/apache/inlong/issues/9138) |
[Improve][Agent] Add task manager
|
-| [INLONG-9143](https://github.com/apache/inlong/issues/9143) |
[Improve][Agent] Add log file collect task
|
-| [INLONG-9149](https://github.com/apache/inlong/issues/9149) |
[Improve][Agent] Add sender manager for file collect
|
-| [INLONG-9151](https://github.com/apache/inlong/issues/9151) |
[Improve][Agent] Add log file source and source related modification
|
-| [INLONG-9155](https://github.com/apache/inlong/issues/9155) |
[Improve][Agent] Add file used proxy
|
-| [INLONG-9159](https://github.com/apache/inlong/issues/9159) |
[Improve][Agent] Add file instance
|
-| [INLONG-9161](https://github.com/apache/inlong/issues/9161) |
[Improve][Agent] Modify left sink
|
-| [INLONG-9163](https://github.com/apache/inlong/issues/9163) |
[Improve][Agent] Delete trigger related file
|
-| [INLONG-9165](https://github.com/apache/inlong/issues/9165) |
[Improve][Agent] Delete job related file
|
-| [INLONG-9182](https://github.com/apache/inlong/issues/9182) |
[Improve][Agent] Delete useless code
|
-| [INLONG-9187](https://github.com/apache/inlong/issues/9187) |
[Improve][Agent] Delete useless memory manager
|
-| [INLONG-9190](https://github.com/apache/inlong/issues/9190) | [Bug][Agent]
Log file source clear buffer queue does not take effect
|
-| [INLONG-9194](https://github.com/apache/inlong/issues/9194) | [Bug][Agent]
Calc time offset failed if the param is 0
|
-| [INLONG-9200](https://github.com/apache/inlong/issues/9200) | [Bug][Agent]
Duplicate file collect instance
|
-| [INLONG-9207](https://github.com/apache/inlong/issues/9207) | [Bug][Agent]
Task manager stuck
|
-| [INLONG-9214](https://github.com/apache/inlong/issues/9214) |
[Improve][Agent] Limit max file count to collect once
|
-| [INLONG-9215](https://github.com/apache/inlong/issues/9215) |
[Improve][Agent] Add predefine fields
|
-| [INLONG-9233](https://github.com/apache/inlong/issues/9233) | [Bug][Agent]
Fix bug: source, proxy, sender get stuck
|
-| [INLONG-9237](https://github.com/apache/inlong/issues/9237) |
[Improve][Agent] Move addictive fields to package attributes
|
-| [INLONG-9241](https://github.com/apache/inlong/issues/9241) |
[Improve][Agent] Print task and instance detail every ten seconds
|
-| [INLONG-9244](https://github.com/apache/inlong/issues/9244) | [Bug][Agent]
Fix bug: miss file from next data time
|
-| [INLONG-9253](https://github.com/apache/inlong/issues/9253) | [Bug][Agent]
Get byte position of file by line count offset failed
|
-| [INLONG-9263](https://github.com/apache/inlong/issues/9263) |
[Improve][Agent] Print the statistics of task and instance not detail
|
-| [INLONG-9265](https://github.com/apache/inlong/issues/9265) |
[Improve][Agent] Add audit of agent send success
|
-| [INLONG-9267](https://github.com/apache/inlong/issues/9267) | [Bug][Agent]
Data loss when there are many files to read once
|
-| [INLONG-9284](https://github.com/apache/inlong/issues/9284) |
[Improve][Agent] Report audit by data time not real time
|
-| [INLONG-9286](https://github.com/apache/inlong/issues/9286) |
[Improve][Agent] Adjust the time offset calculation function
|
-| [INLONG-9289](https://github.com/apache/inlong/issues/9289) |
[Improve][Agent] Improve the completion judgment logic of collecting instances
|
-| [INLONG-9300](https://github.com/apache/inlong/issues/9300) |
[Improve][Agent] Divide data time into source time and sink time
|
-| [INLONG-9308](https://github.com/apache/inlong/issues/9308) |
[Improve][Agent] The sink end of the file instance supports sending data with
different streamIds |
-| [INLONG-9310](https://github.com/apache/inlong/issues/9310) |
[Improve][Agent] Add extended handler in file source
|
-| [INLONG-9312](https://github.com/apache/inlong/issues/9312) |
[Improve][Agent] Add data content style
|
-| [INLONG-9315](https://github.com/apache/inlong/issues/9315) |
[Improve][Agent] Convert data time from source time zone to sink time zone.
|
-| [INLONG-9317](https://github.com/apache/inlong/issues/9317) |
[Improve][Agent] Print basic info of hearbeat
|
-| [INLONG-9335](https://github.com/apache/inlong/issues/9335) |
[Improve][Agent] Bring cycle parameters when creating an instance
|
-| [INLONG-9338](https://github.com/apache/inlong/issues/9338) |
[Improve][Agent] Real time file collection uses the current time as the data
time |
-| [INLONG-9347](https://github.com/apache/inlong/issues/9347) |
[Improve][Agent] Check task profile before save into db
|
-| [INLONG-9364](https://github.com/apache/inlong/issues/9364) |
[Improve][Agent] Remove expired instance from db
|
-| [INLONG-9366](https://github.com/apache/inlong/issues/9366) |
[Improve][Agent] Remove useless offset record
|
-| [INLONG-9369](https://github.com/apache/inlong/issues/9369) |
[Improve][Agent] Increase sending failure audit and real-time audit
|
-| [INLONG-9375](https://github.com/apache/inlong/issues/9375) |
[Improve][Agent] Modify the agent's real-time audit id to prevent duplication
|
-| [INLONG-9390](https://github.com/apache/inlong/issues/9390) |
[Improve][Agent] Collect supplementary data in chronological order
|
-| [INLONG-9397](https://github.com/apache/inlong/issues/9397) |
[Improve][Agent] Do not directly delete the instance records of the local db
when stopping the instances |
-
-### Audit
-| ISSUE | Summary
|
-|:-----------------------------------------------------------:|:------------------------------------------------------------------------|
-| [INLONG-9225](https://github.com/apache/inlong/issues/9225) |
[Improve][Audit] Automatically create audit topic after service startup |
+| ISSUE | Summary
|
+|:-----------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------|
+| [INLONG-9457](https://github.com/apache/inlong/issues/9457) |
[Improve][Agent] Add task and instance heartbeat audit
|
+| [INLONG-9481](https://github.com/apache/inlong/issues/9481) |
[Improve][Agent] Add unit test of reading with offset
|
+| [INLONG-9580](https://github.com/apache/inlong/issues/9580) |
[Improve][Agent] Add unit testing to taskmanager to test their ability to
recover tasks from DB |
+| [INLONG-9614](https://github.com/apache/inlong/issues/9614) |
[Improve][Agent] Change folder name
|
+| [INLONG-9467](https://github.com/apache/inlong/issues/9467) |
[Improve][Agent] Improve code exception detection to ensure task and instance
state transitions |
+| [INLONG-9454](https://github.com/apache/inlong/issues/9454) |
[Improve][Agent] Increase exit conditions to prevent dead loops
|
+| [INLONG-9556](https://github.com/apache/inlong/issues/9556) |
[Improve][Agent] Prevent thread freeze caused by deleting data sources when the
backend cannot send out |
+| [INLONG-9572](https://github.com/apache/inlong/issues/9572) |
[Improve][Agent] Set data time of message cache by sink data time
|
+| [INLONG-9548](https://github.com/apache/inlong/issues/9548) |
[Improve][Agent] Supports HTTPS and can determine whether to enable it through
configuration |
+| [INLONG-9600](https://github.com/apache/inlong/issues/9600) |
[Improve][Agent]Adjust the sinks directory for code consistency
|
### Dashboard
-| ISSUE | Summary
|
-|:-----------------------------------------------------------:|:------------------------------------------------------------------------------------------|
-| [INLONG-8983](https://github.com/apache/inlong/issues/8983) |
[Improve][Dashboard] Log component query optimization
|
-| [INLONG-9016](https://github.com/apache/inlong/issues/9016) |
[Improve][Dashboard] Change the wrapWithInlongMsg to wrapType in data stream
|
-| [INLONG-9053](https://github.com/apache/inlong/issues/9053) |
[Improve][Dashboard] Query list shows creators and modifiers
|
-| [INLONG-9055](https://github.com/apache/inlong/issues/9055) |
[Improve][Dashboard] The approval management list displays the name of the
consumer group |
-| [INLONG-9107](https://github.com/apache/inlong/issues/9107) |
[Improve][Dashboard] Navigation widget optimization
|
-| [INLONG-9114](https://github.com/apache/inlong/issues/9114) |
[Improve][Dashboard] Stream log query parameter optimization
|
-| [INLONG-9185](https://github.com/apache/inlong/issues/9185) |
[Feature][Dashboard] Cluster management supports sort_cls, sort_es, sort_pulsar
types |
-| [INLONG-9196](https://github.com/apache/inlong/issues/9196) |
[Improve][Dashboard] Navigation widget user manual optimization
|
-| [INLONG-9219](https://github.com/apache/inlong/issues/9219) |
[Improve][Dashboard] Stream advanced options parameter optimization
|
-| [INLONG-9229](https://github.com/apache/inlong/issues/9229) |
[Improve][Dashboard] Data access transmission delay optimization
|
-| [INLONG-9256](https://github.com/apache/inlong/issues/9256) |
[Improve][Dashboard] Data synchronization iceberg sink supports append Mode
|
-| [INLONG-9260](https://github.com/apache/inlong/issues/9260) |
[Improve][Dashboard] Support batch import in Synchronize dashboard and detail
page |
-| [INLONG-9302](https://github.com/apache/inlong/issues/9302) |
[Improve][Dashboard] Elasticsearch sink optimization
|
-| [INLONG-9322](https://github.com/apache/inlong/issues/9322) |
[Improve][Dashboard] Sink field mapping title format is unified
|
-| [INLONG-9354](https://github.com/apache/inlong/issues/9354) |
[Improve][Dashboard] Data access File sources optimization
|
-| [INLONG-9368](https://github.com/apache/inlong/issues/9368) |
[Improve][Dashboard] Creation time or other time display in an easily readable
format |
-| [INLONG-9383](https://github.com/apache/inlong/issues/9383) |
[Improve][Dashboard] Resource details display cluster label information
|
-| [INLONG-9385](https://github.com/apache/inlong/issues/9385) |
[Improve][Dashboard] Create a new cluster and remove the agent and dataproxy
types |
-| [INLONG-9427](https://github.com/apache/inlong/issues/9427) |
[Improve][Dashboard] Data access supports viewing operation logs
|
-
+| ISSUE | Summary
|
+|:-----------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------|
+| [INLONG-9627](https://github.com/apache/inlong/issues/9627) |
[Improve][Dashboard] Audit and transmission delay filtering query optimization
|
+| [INLONG-9543](https://github.com/apache/inlong/issues/9543) |
[Improve][Dashboard] Cls, Pulsar and es sink support saving sortTaskName and
sortConsumerGroup |
+| [INLONG-9610](https://github.com/apache/inlong/issues/9610) |
[Improve][Dashboard] Cluster creation type optimization
|
+| [INLONG-9495](https://github.com/apache/inlong/issues/9495) |
[Improve][Dashboard] Data synchronization basic information page optimization
|
+| [INLONG-9663](https://github.com/apache/inlong/issues/9663) |
[Improve][Dashboard] Data synchronization doris sink supports append Mode
|
+| [INLONG-9530](https://github.com/apache/inlong/issues/9530) |
[Improve][Dashboard] Dataproxy cluster nodes support adding the enabledOnline
parameter |
+| [INLONG-9505](https://github.com/apache/inlong/issues/9505) |
[Improve][Dashboard] Pulsar source parameter optimization
|
+| [INLONG-9516](https://github.com/apache/inlong/issues/9516) |
[Improve][Dashboard] Remove useless dependencies
|
+| [INLONG-8393](https://github.com/apache/inlong/issues/8393) |
[Improve][DataProxy] Optimize the HeartbeatManager class
|
+| [INLONG-9657](https://github.com/apache/inlong/issues/9657) |
[Feature][Dashboard] Support management of Doris data node
|
+| [INLONG-9439](https://github.com/apache/inlong/issues/9439) |
[Feature][Dashboard] Support module reconciliation function
|
+| [INLONG-9550](https://github.com/apache/inlong/issues/9550) |
[Feature][Dashboard] System operation and maintenance supports query and audit
through Gorupid and Stream id |
+| [INLONG-9489](https://github.com/apache/inlong/issues/9489) |
[Bug][Dashboard] Transform remove missing stream id
|
+
### Manager
-| ISSUE | Summary
|
+| ISSUE | Summary
|
|:-----------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------------------------------------|
-| [INLONG-8958](https://github.com/apache/inlong/issues/8958) |
[Bug][Manager]Create cls topic fail
|
-| [INLONG-8960](https://github.com/apache/inlong/issues/8960) |
[Feature][Manager] Automatically assign sort cluster after creating stream
sinks |
-| [INLONG-8964](https://github.com/apache/inlong/issues/8964) |
[Feature][Manager] Support Sortstandalone cluster management
|
-| [INLONG-8975](https://github.com/apache/inlong/issues/8975) |
[Improve][Manager] The manager issues an audit IDs based on the group mode
|
-| [INLONG-8986](https://github.com/apache/inlong/issues/8986) | [Bug][Manager]
Sort standalone get params from manager error
|
-| [INLONG-8988](https://github.com/apache/inlong/issues/8988) |
[Improve][Manager] Supports multiple wrap types for message body
|
-| [INLONG-8990](https://github.com/apache/inlong/issues/8990) |
[Improve][Manager][DataProxy][SDK] Rename DataProxyMsgEncType to Message
WrapType |
-| [INLONG-8992](https://github.com/apache/inlong/issues/8992) | [Bug][Manager]
NPE caused by not using transform
|
-| [INLONG-8995](https://github.com/apache/inlong/issues/8995) |
[Improve][Manager] Add an interface for querying used task information for
agent |
-| [INLONG-9003](https://github.com/apache/inlong/issues/9003) |
[Feature][DataProxy][Manager] Support extend fields
|
-| [INLONG-9017](https://github.com/apache/inlong/issues/9017) |
[Improve][Manager] Add stop interface in stream source API
|
-| [INLONG-9023](https://github.com/apache/inlong/issues/9023) | [Bug][Manager]
Failed to stop job task
|
-| [INLONG-9027](https://github.com/apache/inlong/issues/9027) | [Bug][Manager]
Fix SQL error in ClusterSetMapper.selectInlongStreamId
|
-| [INLONG-9036](https://github.com/apache/inlong/issues/9036) |
[Improve][Manager] Support create tables for dataSync
|
-| [INLONG-9041](https://github.com/apache/inlong/issues/9041) |
[Improve][Manager] Support saving schema information when saving iceberg source
|
-| [INLONG-9051](https://github.com/apache/inlong/issues/9051) |
[Improve][Manager] Add consumer group in the approval form
|
-| [INLONG-9060](https://github.com/apache/inlong/issues/9060) | [Bug][Manager]
Manager return wrong sink configuration to sort standalone
|
-| [INLONG-9062](https://github.com/apache/inlong/issues/9062) |
[Improve][Manager] Add default values for stream related interface parameters
|
-| [INLONG-9066](https://github.com/apache/inlong/issues/9066) |
[Improve][Manager] Renaming group related states
|
-| [INLONG-9069](https://github.com/apache/inlong/issues/9069) |
[Improve][Manager] Filter out invalid configs when organize SortStandalone
configuration |
-| [INLONG-9070](https://github.com/apache/inlong/issues/9070) |
[Improve][Manager] Add MessageWrapType.forType method for MessageWrapType
|
-| [INLONG-9073](https://github.com/apache/inlong/issues/9073) |
[Improve][Manager] Add getStreamBriefInfo method for InlongStreamClient
|
-| [INLONG-9092](https://github.com/apache/inlong/issues/9092) |
[Improve][Manager] Tube supports inlong-msg format
|
-| [INLONG-9098](https://github.com/apache/inlong/issues/9098) |
[Improve][Manager] Support to save additional info for the Iceberg field
|
-| [INLONG-9106](https://github.com/apache/inlong/issues/9106) |
[Improve][Manager] Support configuring multiple job tasks under a group
|
-| [INLONG-9109](https://github.com/apache/inlong/issues/9109) | [Bug][Manager]
Incorrect URL address for getbrief mapping in streamApi
|
-| [INLONG-9147](https://github.com/apache/inlong/issues/9147) |
[Improve][Manager] The group details are displayed with the tag of the cluster
to which the group belongs |
-| [INLONG-9192](https://github.com/apache/inlong/issues/9192) |
[Feature][Manager] Flat Sort Cluster types
|
-| [INLONG-9203](https://github.com/apache/inlong/issues/9203) |
[Bug][Manager][Sort] Failed to use Iceberg sink
|
-| [INLONG-9205](https://github.com/apache/inlong/issues/9205) | [Bug][Manager]
Failed to use Hudi sink
|
-| [INLONG-9209](https://github.com/apache/inlong/issues/9209) |
[Improve][Manager] Support configuring predefined fields and issuing agents
|
-| [INLONG-9211](https://github.com/apache/inlong/issues/9211) | [Bug][Manager]
Redis cannot get the clusterMode from sink
|
-| [INLONG-9240](https://github.com/apache/inlong/issues/9240) |
[Improve][Sort][Manager] Add options for Iceberg connector
|
-| [INLONG-9248](https://github.com/apache/inlong/issues/9248) |
[Improve][Manager] Supports configuring builtIn fields for tube source and
pulsar source |
-| [INLONG-9250](https://github.com/apache/inlong/issues/9250) |
[Improve][Manager] Add auditId for tube, pulsar, and mysql
|
-| [INLONG-9259](https://github.com/apache/inlong/issues/9259) |
[Feature][Manager] Optimize Elasticsearch sink and datanode
|
-| [INLONG-9269](https://github.com/apache/inlong/issues/9269) | [Bug][Manager]
Get SortClusterConfig is empty,when sink params include non-string type
|
-| [INLONG-9280](https://github.com/apache/inlong/issues/9280) |
[Feature][Manager] Support different size of extended fields of InlongStream
|
-| [INLONG-9285](https://github.com/apache/inlong/issues/9285) | [Bug][Manager]
When creating KafkaSource, the autoOffsetReset param cannot be empty
|
-| [INLONG-9297](https://github.com/apache/inlong/issues/9297) |
[Feature][Manager] Support configuring multiple sink types of tasks under a
single stream |
-| [INLONG-9303](https://github.com/apache/inlong/issues/9303) |
[Feature][Manager]Support Tube MQ sink
|
-| [INLONG-9314](https://github.com/apache/inlong/issues/9314) |
[Feature][Manager] Support cluster switch for InlongGroup
|
-| [INLONG-9318](https://github.com/apache/inlong/issues/9318) |
[Improve][Manager] ManagerClient supports pulling clusters based on tenant
roles |
-| [INLONG-9328](https://github.com/apache/inlong/issues/9328) |
[Improve][Manager] Add parameters validation for the updateAuditSource method
|
-| [INLONG-9330](https://github.com/apache/inlong/issues/9330) |
[Improve][Manager] Add encoding check to the StarRocks JDBC URL
|
-| [INLONG-9337](https://github.com/apache/inlong/issues/9337) |
[Improve][Manager] Support querying operation records
|
-| [INLONG-9343](https://github.com/apache/inlong/issues/9343) |
[Improve][Manager] Support configuring timeZone related parameters for
fileSource |
-| [INLONG-9351](https://github.com/apache/inlong/issues/9351) |
[Improve][Manager] Support querying audit data size
|
-| [INLONG-9358](https://github.com/apache/inlong/issues/9358) | [Bug][Manager]
The creation time of the information in the database differs from the creation
time in the returned information by eight hours |
-| [INLONG-9362](https://github.com/apache/inlong/issues/9362) |
[Improve][Manager] Support the configuration of parameters related to the
migration of the entire Iceberg database |
-| [INLONG-9373](https://github.com/apache/inlong/issues/9373) | [Bug][Manager]
Failed to create namespace
|
-| [INLONG-9400](https://github.com/apache/inlong/issues/9400) | [Bug][Manager]
Error obtaining sort task type
|
-| [INLONG-9433](https://github.com/apache/inlong/issues/9433) | [Bug][Manager]
NPE exception encountered while querying audit information
|
-| [INLONG-9444](https://github.com/apache/inlong/issues/9444) | [Bug][Manager]
ES sink unsuccessful flow status configuration successful
|
-| [INLONG-9447](https://github.com/apache/inlong/issues/9447) | [Bug][Manager]
Suspend group failed
|
+| [INLONG-9508](https://github.com/apache/inlong/issues/9508) |
[Feature][Manager] Add Iceberg field type mapping strategy to improve usability
|
+| [INLONG-9634](https://github.com/apache/inlong/issues/9634) |
[Feature][Manager] Auto assgin sort task and consumer group of standalone
export |
+| [INLONG-9056](https://github.com/apache/inlong/issues/9056) |
[Feature][Manager] Configuration change detection
|
+| [INLONG-9524](https://github.com/apache/inlong/issues/9524) |
[Feature][Manager] Manager client support migrate group tenant
|
+| [INLONG-9452](https://github.com/apache/inlong/issues/9452) |
[Improve][Manager] Add audit items for file agent
|
+| [INLONG-9484](https://github.com/apache/inlong/issues/9484) |
[Improve][Manager] Improve logic of sortstandalone sink auto-assigned cluster
|
+| [INLONG-9441](https://github.com/apache/inlong/issues/9441) |
[Improve][Manager] MySQL data source supports both full and incremental modes
|
+| [INLONG-8392](https://github.com/apache/inlong/issues/8392) |
[Improve][Manager] Optimize the HeartbeatMsg class
|
+| [INLONG-9586](https://github.com/apache/inlong/issues/9586) |
[Improve][Manager] Provide installation agent framework
|
+| [INLONG-9528](https://github.com/apache/inlong/issues/9528) |
[Improve][Manager] Support configuring the switch to enable dataproxy nodes
|
+| [INLONG-9591](https://github.com/apache/inlong/issues/9591) |
[Improve][Manager] Support printing thread status before submitting tasks
|
+| [INLONG-9523](https://github.com/apache/inlong/issues/9523) |
[Improve][Manager] Support querying all audit information based on IP address
|
+| [INLONG-9440](https://github.com/apache/inlong/issues/9440) |
[Improve][Manager] Support querying audit information based on ip
|
+| [INLONG-9518](https://github.com/apache/inlong/issues/9518) |
[Improve][Manager] Support resetting the consumption location of the
consumption group used by sort |
+| [INLONG-9475](https://github.com/apache/inlong/issues/9475) |
[Improve][Manager] Support setting dataNode when configuring streamSource for
MYSQL |
+| [INLONG-9533](https://github.com/apache/inlong/issues/9533) |
[Improve][Manager] Support setting dataNode when configuring streamSource for
Pulsar/Iceberg/PostgreSQL |
+| [INLONG-9510](https://github.com/apache/inlong/issues/9510) |
[Improve][Manager] Supports doris database synchronization
|
+| [INLONG-9503](https://github.com/apache/inlong/issues/9503) |
[Improve][Manager] Unified Hashmap Dependency Package
|
+| [INLONG-9577](https://github.com/apache/inlong/issues/9577) | [Bug][Manager]
Datatime field type conversion error
|
+| [INLONG-9204](https://github.com/apache/inlong/issues/9204) | [Bug][Manager]
Failed to use PostgreSQL sink
|
+| [INLONG-9470](https://github.com/apache/inlong/issues/9470) | [Bug][Manager]
Failed to verify if the namespace exists
|
+| [INLONG-9461](https://github.com/apache/inlong/issues/9461) | [Bug][Manager]
Failure of GroupTaskListenerFactoryTest
|
+| [INLONG-9618](https://github.com/apache/inlong/issues/9618) | [Bug][Manager]
HttpUtils did not process 307 status code
|
+| [INLONG-9606](https://github.com/apache/inlong/issues/9606) | [Bug][Manager]
Incorrect flow status when cls sink configuration fails
|
+| [INLONG-9488](https://github.com/apache/inlong/issues/9488) | [Bug][Manager]
Not redirecting post requests
|
+| [INLONG-9552](https://github.com/apache/inlong/issues/9552) | [Bug][Manager]
Sink remains in configuration after standalone cluster allocation failure
|
+| [INLONG-9632](https://github.com/apache/inlong/issues/9632) | [Bug][Manager]
StartupSortListener may miss to build flink job for every stream
|
+| [INLONG-9222](https://github.com/apache/inlong/issues/9222) | [Bug][Manager]
When cluster have multiple cluster tag,manager return wrong metadata info
|
+
### SDK
-| ISSUE | Summary
|
-|:-----------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------|
-| [INLONG-8990](https://github.com/apache/inlong/issues/8990) |
[Improve][Manager][DataProxy][SDK] Rename DataProxyMsgEncType to Message
WrapType |
-| [INLONG-9007](https://github.com/apache/inlong/issues/9007) | [Improve][SDK]
ClientList out of bounds
|
-| [INLONG-9044](https://github.com/apache/inlong/issues/9044) | [Improve][SDK]
Add server response log to facilitate troubleshooting
|
-| [INLONG-9058](https://github.com/apache/inlong/issues/9058) | [Improve][SDK]
Limit the number of inlong-groupid and inlong-streamid of a single SDK instance
|
-| [INLONG-9079](https://github.com/apache/inlong/issues/9079) | [Improve][SDK]
Shaded some dependency to reduce conflicts with other sdk
|
-| [INLONG-9083](https://github.com/apache/inlong/issues/9083) | [Improve][SDK]
Bump up Golang SDK x/net modules
|
-| [INLONG-9167](https://github.com/apache/inlong/issues/9167) | [Improve][SDK]
Use UUID as the batch ID instead of snowflake ID for DataProxy Golang SDK
|
-| [INLONG-9170](https://github.com/apache/inlong/issues/9170) | [Improve][SDK]
Use pointer instead of object for chans in Golang SDK
|
-| [INLONG-9172](https://github.com/apache/inlong/issues/9172) | [Improve][SDK]
comment/delete some debug log in some frequently called methods for Golang SDK
|
-| [INLONG-9174](https://github.com/apache/inlong/issues/9174) | [Improve][SDK]
Improve response attr parsing in Golang SDK
|
-| [INLONG-9176](https://github.com/apache/inlong/issues/9176) | [Improve][SDK]
Fail fast when worker is unavailable in Golang SDK
|
-| [INLONG-9178](https://github.com/apache/inlong/issues/9178) | [Improve][SDK]
Update the default values of the config options of Golang SDK
|
-| [INLONG-9180](https://github.com/apache/inlong/issues/9180) | [Improve][SDK]
Cache up batchReq.dataReqs
|
-| [INLONG-9184](https://github.com/apache/inlong/issues/9184) | [Improve][SDK]
Update README.md in Golang SDK
|
-| [INLONG-9213](https://github.com/apache/inlong/issues/9213) | [Improve][SDK]
Support isolation by inlong groupid
|
-| [INLONG-9228](https://github.com/apache/inlong/issues/9228) | [Improve][SDK]
CPP SDK supports dynamic load balancing
|
-| [INLONG-9277](https://github.com/apache/inlong/issues/9277) | [Feature][SDK]
Optimize multi-region nearby access
|
-| [INLONG-9293](https://github.com/apache/inlong/issues/9293) | [Improve][SDK]
Optimize the problem that the more inlong grouids there are, the more memory is
consumed. |
-| [INLONG-9307](https://github.com/apache/inlong/issues/9307) | [Improve][SDK]
Improve DataProxy SDK code readability
|
-| [INLONG-9320](https://github.com/apache/inlong/issues/9320) | [Improve][SDK]
Support local disaster recovery manager configuration
|
-| [INLONG-9324](https://github.com/apache/inlong/issues/9324) | [Improve][SDK]
Supports automatic creation of custom log directories
|
-| [INLONG-9341](https://github.com/apache/inlong/issues/9341) | [Improve][SDK]
Optimize obtaining local IP information
|
-| [INLONG-9345](https://github.com/apache/inlong/issues/9345) | [Bug][SDK]
DataProxy SDK throws java.lang.NoClassDefFoundErrorException
|
-| [INLONG-9355](https://github.com/apache/inlong/issues/9355) | [Improve][SDK]
Optimize resource isolation for CPP SDK
|
-| [INLONG-9378](https://github.com/apache/inlong/issues/9378) | [Improve][SDK]
Optimize proxy configuration update
|
+| ISSUE | Summary
|
+|:-----------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------------|
+| [INLONG-9554](https://github.com/apache/inlong/issues/9554) | [Bug][SDK]
When close DataProxy SDK sender thread, The shutdownInternalThreads methods
throw the NullPointerException |
+| [INLONG-9624](https://github.com/apache/inlong/issues/9624) | [Improve][SDK]
Adjust code directory structure
|
+| [INLONG-9658](https://github.com/apache/inlong/issues/9658) | [Improve][SDK]
Bump up Golang SDK modules
|
+| [INLONG-9546](https://github.com/apache/inlong/issues/9546) | [Feature][SDK]
DataProxy SDK support request manager by https
|
### Sort
-| ISSUE | Summary
|
+| ISSUE | Summary
|
|:-----------------------------------------------------------:|:----------------------------------------------------------------------------------------------|
-| [INLONG-8959](https://github.com/apache/inlong/issues/8959) |
[Feature][Sort]Add mongodb connector on flink 1.15
|
-| [INLONG-8973](https://github.com/apache/inlong/issues/8973) | [Bug][Sort]
Fix PRIMARY KEY desc error in redis readme.
|
-| [INLONG-8979](https://github.com/apache/inlong/issues/8979) | [Bug][Sort]
Wrong desc about redis-conenctor in flink 1.13 module about command option
|
-| [INLONG-8982](https://github.com/apache/inlong/issues/8982) |
[Feature][Sort] Iceberg sink on flink 1.15
|
-| [INLONG-8997](https://github.com/apache/inlong/issues/8997) |
[Improve][Sort] Keep the logic the same with flink v1.15 mysql in flink v1.13
end to end test |
-| [INLONG-8998](https://github.com/apache/inlong/issues/8998) |
[Improve][Sort] Add sqlserver connector of flink 1.15
|
-| [INLONG-8999](https://github.com/apache/inlong/issues/8999) |
[Feature][Sort] Add sqlserver connector of flink 1.15
|
-| [INLONG-9009](https://github.com/apache/inlong/issues/9009) |
[Feature][Sort] Add HBase connector on flink 1.15
|
-| [INLONG-9038](https://github.com/apache/inlong/issues/9038) | [Bug][Sort]
Fail to parse InlongMessage when exporting Pulsar
|
-| [INLONG-9075](https://github.com/apache/inlong/issues/9075) |
[Improve][Sort] TubeMQSource support InlongMsg format
|
-| [INLONG-9077](https://github.com/apache/inlong/issues/9077) | [Bug][Sort]
TubeMQ connector fail to subscribe streamId
|
-| [INLONG-9084](https://github.com/apache/inlong/issues/9084) | [Bug][Sort]
Fail to parse InlongGroupId when report Inlong Audit
|
-| [INLONG-9087](https://github.com/apache/inlong/issues/9087) |
[Improve][Sort] TubeMQ Connector use latest offset mode
|
-| [INLONG-9128](https://github.com/apache/inlong/issues/9128) | [Bug][Sort]
Failed to init TubeMQ source with InlongMsg type message
|
-| [INLONG-9203](https://github.com/apache/inlong/issues/9203) |
[Bug][Manager][Sort] Failed to use Iceberg sink
|
-| [INLONG-9223](https://github.com/apache/inlong/issues/9223) |
[Feature][Sort] TubeMQ souce support InlongAudit
|
-| [INLONG-9231](https://github.com/apache/inlong/issues/9231) | [Bug][Sort]
Find no audit time field when the filed is in upper case
|
-| [INLONG-9240](https://github.com/apache/inlong/issues/9240) |
[Improve][Sort][Manager] Add options for Iceberg connector
|
-| [INLONG-9246](https://github.com/apache/inlong/issues/9246) |
[Improve][Sort] Pulsar source support audit when the deserialized type is not
InlongMsg |
-| [INLONG-9247](https://github.com/apache/inlong/issues/9247) |
[Improve][Sort] TubeMQ source support audit when the deserialized type is not
InlongMsg |
-| [INLONG-9273](https://github.com/apache/inlong/issues/9273) | [Bug][Sort]
IcebergSingleFileCommiter will throw exception for error code
|
-| [INLONG-9333](https://github.com/apache/inlong/issues/9333) | [Bug][Sort]
Related problem with attribute exceptions when creating 'hudiSink'
|
-| [INLONG-9371](https://github.com/apache/inlong/issues/9371) | [Bug][Sort]
elasticsearch sort shade relocation error
|
-| [INLONG-9377](https://github.com/apache/inlong/issues/9377) | [Bug][Sort]
Failed to init iceberg sink with upsert mode
|
-| [INLONG-9380](https://github.com/apache/inlong/issues/9380) | [Bug][Sort]
Audit lost when stop job immediately after checkpoint
|
-| [INLONG-9388](https://github.com/apache/inlong/issues/9388) |
[Improve][Sort] Updated version of embedded-redis in sort-connector-redis
|
-| [INLONG-9392](https://github.com/apache/inlong/issues/9392) | [Bug][Sort]
MySqlContainer class getJdbcUrl() method splicing querystring error
|
-| [INLONG-9394](https://github.com/apache/inlong/issues/9394) |
[Improve][Sort] Incorrect use of maven plugin on integration test among
sort-end-to-end-tests |
-| [INLONG-9417](https://github.com/apache/inlong/issues/9417) | [Bug][Sort]
Missing MySQL CDC connector for Flink 1.15
|
+| [INLONG-8358](https://github.com/apache/inlong/issues/8358) |
[Feature][Sort] Add Kafka connector on Flink 1.15
|
+| [INLONG-9521](https://github.com/apache/inlong/issues/9521) |
[Feature][Sort] Sort format supports InLongMsg-kv format
|
+| [INLONG-9571](https://github.com/apache/inlong/issues/9571) |
[Feature][sort] Support row way of sort InLong message binlog format
|
+| [INLONG-9597](https://github.com/apache/inlong/issues/9597) |
[Feature][Sort] Support row way of sort InLong message tlog-csv format
|
+| [INLONG-9569](https://github.com/apache/inlong/issues/9569) |
[Feature][Sort] Support rowdata way of sort InLong message csv format
|
+| [INLONG-9563](https://github.com/apache/inlong/issues/9563) |
[Feature][Sort] Support rowdata way of sort message kv format
|
+| [INLONG-9473](https://github.com/apache/inlong/issues/9473) |
[Feature][Sort] Support transform of embedding
|
+| [INLONG-9626](https://github.com/apache/inlong/issues/9626) |
[Improve][Sort] Change the variable name from tid to streamId
|
+| [INLONG-9491](https://github.com/apache/inlong/issues/9491) |
[Improve][Sort] Csv format support ignore trailing unmappable fields
|
+| [INLONG-9479](https://github.com/apache/inlong/issues/9479) |
[Improve][Sort] There are too many flink version definitions
|
+| [INLONG-9616](https://github.com/apache/inlong/issues/9616) | [Bug][Sort]
Failed to create pulsar producer with the same topic
|
+| [INLONG-9501](https://github.com/apache/inlong/issues/9501) | [Bug][Sort]
Modify EncryptFunction
|
+| [INLONG-9499](https://github.com/apache/inlong/issues/9499) | [Bug][Sort]
Typos in FlinkPulsarSource and FlinkPulsarSourceWithoutAdmin
|
+
+### TubeMQ
+| ISSUE | Summary
|
+|:-----------------------------------------------------------:|:-------------------------------------------------------------|
+| [INLONG-9603](https://github.com/apache/inlong/issues/9603) | [Bug][TubeMQ]
Cpp client build failed |
+| [INLONG-9033](https://github.com/apache/inlong/issues/9033) |
[Improve][TubeMQ] Docker container is missing tubectl script |
### Other
-| ISSUE | Summary
|
-|:-----------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------|
-| [INLONG-8961](https://github.com/apache/inlong/issues/8961) | [Improve]
Server-side request forgery attack prevention in some classes
|
-| [INLONG-8967](https://github.com/apache/inlong/issues/8967) | [Feature] Add
Mysql connector on flink 1.15
|
-| [INLONG-8971](https://github.com/apache/inlong/issues/8971) |
[Improve][manager] Missing audit id for MQ
|
-| [INLONG-8977](https://github.com/apache/inlong/issues/8977) | [Feature] Add
tube source connector on flink 1.15
|
-| [INLONG-8994](https://github.com/apache/inlong/issues/8994) | [Feature] Add
hudi connector on flink 1.15
|
-| [INLONG-9013](https://github.com/apache/inlong/issues/9013) |
[Improve][DataProxy] Inconsistent annotations
|
-| [INLONG-9025](https://github.com/apache/inlong/issues/9025) |
[Improve][Build] Avoid deploying the distribution packages to repositories
|
-| [INLONG-9034](https://github.com/apache/inlong/issues/9034) | [Improve] Fix
sort redis test with incorrect use of sleep
|
-| [INLONG-9046](https://github.com/apache/inlong/issues/9046) | [Improve][CVE]
snappy-java's missing upper bound check on chunk length can lead to Denial of
Service (DoS) impact |
-| [INLONG-9064](https://github.com/apache/inlong/issues/9064) | [Feature] Add
Audit report for Pulsar connector in flink 1.15
|
-| [INLONG-9081](https://github.com/apache/inlong/issues/9081) | [Bug] Pulsar
connector in flink 1.15 should running in exclusive mode
|
-| [INLONG-9095](https://github.com/apache/inlong/issues/9095) | [Feature]
Support inlong-msg in pulsar flink 1.15 connector
|
-| [INLONG-9104](https://github.com/apache/inlong/issues/9104) | [Improve][ASF]
Add a protected branches strategy for the master branch
|
-| [INLONG-9202](https://github.com/apache/inlong/issues/9202) | [Bug] Fix
audit report error when running pulsar -> iceberg in flink1.15
|
-| [INLONG-9221](https://github.com/apache/inlong/issues/9221) | [Bug]When sink
is MySQL, there is no 'DataNode' when first selected
|
-| [INLONG-9225](https://github.com/apache/inlong/issues/9225) |
[Improve][Audit] Automatically create audit topic after service startup
|
-| [INLONG-9271](https://github.com/apache/inlong/issues/9271) | [Bug] When
creating 'StreamField', 'isMetaField' must be initialized
|
-| [INLONG-9281](https://github.com/apache/inlong/issues/9281) | [Bug] Fix
pulsar flink connector cannot support batch messages
|
-| [INLONG-9296](https://github.com/apache/inlong/issues/9296) | [Bug] Cluster
type 'DATAPROXY' not supported
|
-| [INLONG-9299](https://github.com/apache/inlong/issues/9299) | [Feature]
Iceberg support all migrate and auto create table
|
-| [INLONG-9359](https://github.com/apache/inlong/issues/9359) | [Bug] Fix
iceberg all migrate connector stack overflow error
|
-| [INLONG-9384](https://github.com/apache/inlong/issues/9384) | [Bug] Fix audi
report loss in pulsar connector
|
+| ISSUE | Summary
|
+|:-----------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------------------|
+| [INLONG-9541](https://github.com/apache/inlong/issues/9541) | [Feature][ASF]
Remove branch protection strategy for the master branch
|
+| [INLONG-8391](https://github.com/apache/inlong/issues/8391) | [Improve]
Optimize the HeartbeatMsg class
|
+| [INLONG-9640](https://github.com/apache/inlong/issues/9640) | [Improve][CVE]
Apache Shiro vulnerable to path traversal
|
+| [INLONG-9048](https://github.com/apache/inlong/issues/9048) | [Improve][CVE]
Authorization Bypass Through User-Controlled Key vulnerability in Apache
ZooKeeper |
+| [INLONG-9465](https://github.com/apache/inlong/issues/9465) | [Improve][CVE]
Authorization Bypass Through User-Controlled Key vulnerability in Apache
ZooKeeper |
+| [INLONG-9666](https://github.com/apache/inlong/issues/9666) | [Improve][CVE]
Domain restrictions bypass via DNS Rebinding in WireMock and WireMock Studio
webhooks, proxy and recorder modes |
+| [INLONG-9644](https://github.com/apache/inlong/issues/9644) | [Improve][CVE]
Guava vulnerable to insecure use of temporary directory
|
+| [INLONG-9477](https://github.com/apache/inlong/issues/9477) | [Improve][CVE]
Observable Discrepancy in Apache Kafka
|
+| [INLONG-9642](https://github.com/apache/inlong/issues/9642) | [Improve][CVE]
TemporaryFolder on unix-like systems does not limit access to created files
|
+| [INLONG-9463](https://github.com/apache/inlong/issues/9463) | [Improve][POM]
Bump curator to 4.2.0
|
+| [INLONG-9525](https://github.com/apache/inlong/issues/9525) |
[Improve][Tools] There is a typo for backup_module_dependencys.sh script
|
+| [INLONG-9493](https://github.com/apache/inlong/issues/9493) | [Bug] Logging
error for the NativeFlinkSqlParser
|
