This is an automated email from the ASF dual-hosted git repository.
yongzao pushed a change to branch addlogicalclockinterface
in repository https://gitbox.apache.org/repos/asf/iotdb.git
from 40328ce5a01 commit to stash
add eab1df34714 Region migration related work (#12259)
add 2865e8a4233 [IOTDB-6308] CFD algorithm for multi-database (#12184)
add edf657301e0 Ignore view number in cluster series limit
add 1b9f4f79de0 Revert the change of integration-test module
add 26dc03b32d9 Pipe: refactor package structure (#12267)
add 2990412b8bb Fix Load TsFile with extend template & add template check
for internalCreateTimeSeriesStatement (#12266)
add d859d5f0c9b Pipe: Fix schema region snapshot may not be listened when
DataNode restarts (#12270)
add eee977c28b9 Subscription: fix null ByteBuffer when transferring
SerializedEnrichedEvent (#12273)
add fd1d6ca0683 remove Repair Data ClusterIT
add 0fa3eb6395c Pipe: Fixed the bug that empty tsfile may not be marked
when already closed & Improved exception.conflict.resolve-strategy parsing &
Improved config/schema region snapshot listenning logger & Refactor (#12265)
add 804ee600cd4 Pipe: Improved handling logic for transferred statements &
Allow root.__system.** schemas to reach the receiver side (#12276)
add fd48ef68254 Pipe: support different load balance strategies for data
sync (#12281)
add 360254be7c7 Fix recover duplicate (#12272)
add b64cf1c7119 Fix mismatched dataType with same name
add d6c9bbc88c8 Subscription: refactor `IoTDBSubscriptionConsumerGroupIT`
to support multi-protocol pipe sync reference (#12288)
add d17d0ef7d92 Pipe: Fix websocket (Flink CDC) connector may report
tsfile event progress in advance (#12284)
add f5213bfb49c Optimize time cost on rewrite pattern by authority pattern
add 8f1242593b4 Fix stop datanode compaction error log (#12178)
add 943eacab300 Pipe & Subscription IT: Enlarge -DDataNodeMaxHeapSize &
-DDataNodeMaxDirectMemorySize. Add StrongConsistencyClusterMode for receiver
tests. (#12289)
add 011e4011d16 Pipe IT: remove StrongConsistencyClusterMode tests from
manual-create-schema IT (#12292)
add 5394aa47fa9 Use UTF-8 to load and store properties file (#12291)
add 90cc430f6f1 Pipe: Added parameters to the snapshot transfer threshold
from last snapshot to queue's tail index (#12290)
add 347e42d59c7 Pipe: Improved the air gap receiver socket close handling
logic (#12285)
add cff2ff15304 Pipe: Fixed the NPE when an emit is triggered by a generic
event in aggregate processor (#12298)
add e8d11ce91b8 Pipe IT: Configured the connection timeout ms parameter to
avoid premature timeout of pipe creation in ITs (#12295)
add 0492b6a9a83 Pipe: Fix receiver can not delete dir on thread exit if
files in dir are not loaded successfully (#12302)
add 917fd4e9b0c Pipe: Added output.measurements and output.database format
check in AggregateProcessor (#12300)
add 688d5e02f3c docs: proofread the readme file (#12296)
add 08b3772a798 Pipe: check metric service before marking pipe metrics to
avoid useless warn logs (#12303)
add eee72fbf3aa [IOTDB-6301] wait leader ready in single replica (#12234)
add e1066549218 fix delete dead lock.
add cbc7ba56b19 Load: support load tsfile with data in partition whose id
is negative (#12307)
add 75b5fa607b4 Subscription: intro node-urls and endpoints syncer for
consumer high availablity (#12275)
add dddedf06260 Fix potential NPE when concurrently aborting a Query
add 40993a2b5b8 Pipe: decrease reference count for untransferred events in
batch when closing & fix parsing alter pipe name (#12305)
add ecdb0566d8d Storage Engine: Fixed inaccurate compression ratio when
writing duplicate data (#12297)
add 80ff23ff5d7 Pipe: Fixed the bug that config receivers may not be
one-to-one match with the sender clients (#12280)
add 503776b3c88 delay estimate memory of InnerSpaceCompactionTask (#12314)
add 78315b3fb45 Pipe: Added get-jar-with-dependencies packaging option for
pipe-opc-ua-sink-example (#12317)
add a4d60b2ae97 Bump tar from 6.1.13 to 6.2.1 in
/iotdb-connector/grafana-plugin (#12319)
add 1c83bc0d5a3 Do not set read only in compaction module (#12311)
add d28417bac6d Subscription: fix parsing topic name with back quote when
using JAVA SDK client (#12322)
add 381948b52f5 Bump org.apache.zeppelin:zeppelin-interpreter from 0.10.1
to 0.11.1 (#12324)
new 5addf4ab764 Merge branch 'master' into addlogicalclockinterface
new 9bec1206ef2 Ready for test
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/pipe-it-2cluster.yml | 8 +-
README.md | 62 +-
example/pipe-opc-ua-sink/pom.xml | 34 +
.../apache/iotdb/SubscriptionSessionExample.java | 18 +-
.../iotdb/it/env/cluster/config/MppBaseConfig.java | 4 +-
.../it/env/cluster/config/MppConfigNodeConfig.java | 6 +
.../iotdb/it/env/cluster/env/AbstractEnv.java | 15 +
.../it/env/cluster/node/AbstractNodeWrapper.java | 11 +
.../env/remote/config/RemoteConfigNodeConfig.java | 6 +
.../iotdb/it/env/remote/env/RemoteServerEnv.java | 10 +
.../java/org/apache/iotdb/itbase/env/BaseEnv.java | 4 +
.../apache/iotdb/itbase/env/ConfigNodeConfig.java | 2 +
...oTDBMultiDBRegionGroupLeaderDistributionIT.java | 154 +++++
...a => IoTDBRegionGroupLeaderDistributionIT.java} | 123 ++--
.../IoTDBRegionMigrateReliabilityITFramework.java} | 431 +++++++-----
.../CoordinatorRemoveRemotePeerCrashIT.java | 51 ++
.../IoTDBRegionMigrateDataNodeCrashIT.java | 72 ++
.../pass/IoTDBRegionMigrateConfigNodeCrashIT.java | 92 +++
.../pass/IoTDBRegionMigrateNormalIT.java | 30 +-
.../pass/IoTDBRegionMigrateOtherIT.java | 33 +-
.../org/apache/iotdb/db/it/IOTDBLoadTsFileIT.java | 67 ++
.../org/apache/iotdb/db/it/IoTDBRepairDataIT.java | 3 +-
.../org/apache/iotdb/db/it/utils/TestUtils.java | 5 +
.../pipe/it/autocreate/AbstractPipeDualAutoIT.java | 4 +
.../pipe/it/autocreate/IoTDBPipeClusterIT.java | 75 ++-
.../pipe/it/autocreate/IoTDBPipeIdempotentIT.java | 4 +
.../pipe/it/autocreate/IoTDBPipeProcessorIT.java | 4 +
.../pipe/it/autocreate/IoTDBPipeProtocolIT.java | 12 +
.../pipe/it/manual/AbstractPipeDualManualIT.java | 4 +
.../pipe/it/manual/IoTDBPipeMetaHistoricalIT.java | 4 +
.../it/manual/IoTDBPipeMetaLeaderChangeIT.java | 4 +
.../iotdb/pipe/it/single/AbstractPipeSingleIT.java | 2 +
.../it/dual/AbstractSubscriptionDualIT.java | 5 +
.../it/dual/IoTDBSubscriptionConsumerGroupIT.java | 725 ++++++++++++++-------
.../it/dual/IoTDBSubscriptionTopicIT.java | 157 ++++-
.../it/local/IoTDBSubscriptionBasicIT.java | 12 +-
.../it/local/IoTDBSubscriptionIdempotentIT.java | 22 +-
.../it/local/IoTDBSubscriptionRestartIT.java | 298 ++++++++-
.../parameter/PipeParameterValidator.java | 22 +-
.../rpc/subscription/config/ConsumerConstant.java | 17 +-
.../exception}/SubscriptionException.java | 2 +-
.../SubscriptionParameterNotValidException.java} | 18 +-
.../SubscriptionPollTimeOutException.java | 16 +-
.../payload/response/PipeSubscribePollResp.java | 24 +-
.../subscription/ConsumerHeartbeatWorker.java | 26 +-
.../subscription/PullConsumerAutoCommitWorker.java | 10 +-
.../session/subscription/SubscriptionConsumer.java | 383 +++++++++--
.../subscription/SubscriptionEndpointsSyncer.java | 131 ++++
.../session/subscription/SubscriptionProvider.java | 48 +-
.../subscription/SubscriptionPullConsumer.java | 99 ++-
.../subscription/SubscriptionPushConsumer.java | 2 +-
.../session/subscription/SubscriptionSession.java | 20 +-
.../SubscriptionSessionConnection.java | 15 -
.../session/subscription/model/Subscription.java | 6 +-
.../iotdb/session/subscription/model/Topic.java | 4 +-
iotdb-connector/grafana-plugin/yarn.lock | 16 +-
.../heartbeat/ConfigNodeHeartbeatHandler.java | 14 +-
.../heartbeat/DataNodeHeartbeatHandler.java | 66 +-
.../iotdb/confignode/conf/ConfigNodeConfig.java | 2 +-
.../confignode/conf/ConfigNodeDescriptor.java | 11 +-
.../confignode/conf/ConfigNodeRemoveCheck.java | 4 +-
.../confignode/conf/ConfigNodeStartupCheck.java | 2 +-
.../confignode/conf/SystemPropertiesUtils.java | 7 +-
.../statemachine/ConfigRegionStateMachine.java | 23 +-
.../iotdb/confignode/manager/ConfigManager.java | 17 +-
.../apache/iotdb/confignode/manager/IManager.java | 7 +
.../iotdb/confignode/manager/load/LoadManager.java | 64 +-
.../manager/load/balancer/RouteBalancer.java | 303 +++++----
.../router/leader/GreedyLeaderBalancer.java | 129 +---
.../balancer/router/leader/ILeaderBalancer.java | 6 +-
.../router/leader/MinCostFlowLeaderBalancer.java | 211 +++---
.../manager/load/cache/AbstractLoadCache.java | 2 +
.../confignode/manager/load/cache/LoadCache.java | 82 +--
.../load/cache/consensus/ConsensusCache.java | 77 +--
.../manager/load/cache/node/BaseNodeCache.java | 4 +-
.../manager/load/cache/region/RegionCache.java | 46 +-
.../manager/load/service/EventService.java | 30 -
.../manager/load/service/HeartbeatService.java | 5 +-
.../manager/load/service/StatisticsService.java | 69 +-
.../load/subscriber/IClusterStatusSubscriber.java | 8 +
...scriber.java => NodeStatisticsChangeEvent.java} | 22 +-
.../RegionGroupStatisticsChangeEvent.java} | 33 +-
.../iotdb/confignode/manager/node/NodeManager.java | 7 +
.../{transfer => }/agent/PipeConfigNodeAgent.java | 10 +-
.../agent/plugin/PipeConfigNodePluginAgent.java | 2 +-
.../PipeConfigRegionConnectorConstructor.java | 6 +-
.../PipeConfigRegionExtractorConstructor.java | 4 +-
.../PipeConfigRegionProcessorConstructor.java | 2 +-
.../receiver/IoTDBConfigNodeReceiverAgent.java | 24 +-
.../agent/runtime/PipeConfigNodeRuntimeAgent.java | 6 +-
.../agent/runtime/PipeConfigRegionListener.java | 6 +-
.../agent/task/PipeConfigNodeTaskAgent.java | 12 +-
.../client/IoTDBConfigNodeSyncClientManager.java | 14 +-
.../PipeTransferConfigNodeHandshakeV1Req.java | 2 +-
.../PipeTransferConfigNodeHandshakeV2Req.java | 2 +-
.../payload}/PipeTransferConfigPlanReq.java | 2 +-
.../PipeTransferConfigSnapshotPieceReq.java | 2 +-
.../PipeTransferConfigSnapshotSealReq.java | 2 +-
.../IoTDBConfigRegionAirGapConnector.java | 12 +-
.../protocol}/IoTDBConfigRegionConnector.java | 16 +-
.../runtime/PipeHeartbeatScheduler.java | 2 +-
.../runtime/PipeLeaderChangeHandler.java | 12 +
.../runtime/PipeRuntimeCoordinator.java | 12 +
.../execution/PipeConfigNodeSubtask.java | 6 +-
.../execution/PipeConfigNodeSubtaskExecutor.java | 2 +-
.../extractor/ConfigRegionListeningFilter.java | 13 +-
.../extractor/ConfigRegionListeningQueue.java | 2 +-
.../extractor/IoTDBConfigRegionExtractor.java | 4 +-
.../protocol}/IoTDBConfigNodeReceiver.java | 58 +-
.../PipeConfigPhysicalPlanExceptionVisitor.java | 2 +-
.../PipeConfigPhysicalPlanTSStatusVisitor.java | 5 +-
.../{transfer => }/task/PipeConfigNodeTask.java | 2 +-
.../task/PipeConfigNodeTaskBuilder.java | 4 +-
.../task/PipeConfigNodeTaskStage.java | 6 +-
.../persistence/executor/ConfigPlanExecutor.java | 2 +-
.../persistence/partition/PartitionInfo.java | 7 +-
.../confignode/persistence/pipe/PipeInfo.java | 2 +-
.../persistence/subscription/SubscriptionInfo.java | 2 +-
.../procedure/env/ConfigNodeProcedureEnv.java | 16 +-
.../procedure/env/RegionMaintainHandler.java | 14 +-
.../impl/region/AddRegionPeerProcedure.java | 4 +
.../impl/region/RegionMigrateProcedure.java | 2 +
.../impl/region/RemoveRegionPeerProcedure.java | 4 +
.../impl/schema/DeleteDatabaseProcedure.java | 3 -
.../AbstractOperateSubscriptionProcedure.java | 2 +-
.../consumer/AlterConsumerGroupProcedure.java | 2 +-
.../runtime/ConsumerGroupMetaSyncProcedure.java | 2 +-
.../subscription/CreateSubscriptionProcedure.java | 2 +-
.../subscription/DropSubscriptionProcedure.java | 2 +-
.../subscription/topic/AlterTopicProcedure.java | 2 +-
.../subscription/topic/CreateTopicProcedure.java | 2 +-
.../subscription/topic/DropTopicProcedure.java | 2 +-
.../topic/runtime/TopicMetaSyncProcedure.java | 2 +-
.../iotdb/confignode/service/ConfigNode.java | 2 +-
.../thrift/ConfigNodeRPCServiceProcessor.java | 8 +-
...alancerTest.java => CFDLeaderBalancerTest.java} | 66 +-
.../router/leader/GreedyLeaderBalancerTest.java | 6 +-
.../leader/LeaderBalancerComparisonTest.java | 4 +-
.../router/priority/GreedyPriorityTest.java | 2 +-
.../priority/LeaderPriorityBalancerTest.java | 2 +-
.../manager/load/cache/ConsensusCacheTest.java | 9 +-
.../manager/load/cache/NodeCacheTest.java | 27 +-
.../manager/load/cache/RegionGroupCacheTest.java | 50 +-
.../connector/IoTDBConfigRegionConnectorTest.java | 2 +-
.../PipeConfigNodeThriftRequestTest.java | 10 +-
.../PipeConfigNodeSubtaskExecutorTest.java | 2 -
.../extractor/IoTDBConfigRegionExtractorTest.java | 1 -
.../ConfigRegionListeningQueueTest.java | 2 +-
.../persistence/node/NodeStatisticsTest.java | 66 --
.../statistics/RegionGroupStatisticsTest.java | 76 ---
.../partition/statistics/RegionStatisticsTest.java | 66 --
.../apache/iotdb/consensus/iot/IoTConsensus.java | 58 +-
.../consensus/iot/IoTConsensusServerImpl.java | 69 +-
.../service/IoTConsensusRPCServiceProcessor.java | 5 +
.../iotdb/consensus/ratis/RatisConsensus.java | 5 +-
.../iotdb/consensus/ratis/RatisConsensusTest.java | 7 +-
.../org/apache/iotdb/db/audit/AuditLogger.java | 2 +-
.../java/org/apache/iotdb/db/conf/IoTDBConfig.java | 25 +-
.../org/apache/iotdb/db/conf/IoTDBDescriptor.java | 10 +-
.../org/apache/iotdb/db/conf/IoTDBStartCheck.java | 17 +-
.../db/conf/rest/IoTDBRestServiceDescriptor.java | 4 +-
.../schemaregion/SchemaRegionStateMachine.java | 16 +-
.../db/exception/PartitionViolationException.java | 6 +-
.../agent/receiver/PipeDataNodeReceiverAgent.java | 6 +-
.../agent/runtime/PipeDataNodeRuntimeAgent.java | 2 +-
.../client/IoTDBDataNodeAsyncClientManager.java | 86 ++-
.../client/IoTDBDataNodeSyncClientManager.java | 5 +-
...IoTDBThriftSyncPipeTransferBatchReqBuilder.java | 2 +-
.../builder/PipeTransferBatchReqBuilder.java | 12 +-
.../connector/payload/legacy/DeletionPipeData.java | 4 +-
.../db/pipe/connector/payload/legacy/PipeData.java | 2 +-
.../connector/payload/legacy/TsFilePipeData.java | 4 +-
.../async/IoTDBDataRegionAsyncConnector.java | 4 +-
.../thrift/sync/IoTDBDataNodeSyncConnector.java | 5 +-
.../protocol/websocket/WebSocketConnector.java | 6 +-
.../common/tablet/PipeRawTabletInsertionEvent.java | 4 +-
.../common/tsfile/PipeTsFileInsertionEvent.java | 42 +-
.../PipeConnectorSubtaskExecutor.java | 2 +-
.../PipeProcessorSubtaskExecutor.java | 2 +-
.../{executor => }/PipeSubtaskExecutorManager.java | 2 +-
.../realtime/PipeRealtimeDataRegionExtractor.java | 2 +-
.../realtime/assigner/PipeDataRegionAssigner.java | 4 +-
.../iotdb/db/pipe/metric/PipeConnectorMetrics.java | 46 +-
.../iotdb/db/pipe/metric/PipeExtractorMetrics.java | 49 +-
.../iotdb/db/pipe/metric/PipeProcessorMetrics.java | 46 +-
.../{matcher => }/CachedSchemaPatternMatcher.java | 2 +-
.../{matcher => }/PipeDataRegionMatcher.java | 2 +-
.../processor/aggregate/AggregateProcessor.java | 62 +-
.../SimpleConsensusProgressIndexAssigner.java | 2 +-
.../{ => protocol}/airgap/IoTDBAirGapReceiver.java | 51 +-
.../airgap/IoTDBAirGapReceiverAgent.java | 2 +-
.../legacy/IoTDBLegacyPipeReceiverAgent.java | 2 +-
.../legacy/loader/DeletionLoader.java | 2 +-
.../{ => protocol}/legacy/loader/ILoader.java | 2 +-
.../{ => protocol}/legacy/loader/TsFileLoader.java | 2 +-
.../thrift/IoTDBDataNodeReceiver.java | 68 +-
.../thrift/IoTDBDataNodeReceiverAgent.java | 20 +-
.../{ => visitor}/PipePlanToStatementVisitor.java | 2 +-
.../PipeStatementExceptionVisitor.java | 29 +-
.../PipeStatementTSStatusVisitor.java | 25 +-
.../resource/tsfile/PipeTsFileResourceManager.java | 1 -
.../pipe/task/builder/PipeDataNodeTaskBuilder.java | 6 +-
.../pipe/task/connection/PipeEventCollector.java | 2 +-
.../db/pipe/task/stage/PipeTaskConnectorStage.java | 2 +-
.../db/pipe/task/stage/PipeTaskProcessorStage.java | 2 +-
.../connector/PipeConnectorSubtaskLifeCycle.java | 2 +-
.../connector/PipeConnectorSubtaskManager.java | 4 +-
.../iotdb/db/protocol/client/ConfigNodeClient.java | 7 +
.../iotdb/db/protocol/client/ConfigNodeInfo.java | 9 +-
.../impl/DataNodeInternalRPCServiceImpl.java | 2 +-
.../execution/exchange/sink/ShuffleSinkHandle.java | 4 +-
.../exchange/source/LocalSourceHandle.java | 9 -
.../queryengine/execution/memory/MemoryPool.java | 14 +-
.../schema/source/TimeSeriesSchemaSource.java | 2 +-
.../execution/operator/source/SeriesScanUtil.java | 12 +-
.../queryengine/plan/analyze/AnalyzeVisitor.java | 11 +-
.../analyze/cache/schema/DataNodeSchemaCache.java | 25 +
.../analyze/cache/schema/SchemaCacheEntry.java | 8 +
.../cache/schema/TimeSeriesSchemaCache.java | 32 +
.../cache/schema/dualkeycache/IDualKeyCache.java | 9 +
.../schema/dualkeycache/impl/DualKeyCacheImpl.java | 59 ++
.../schema/lastcache/DataNodeLastCacheManager.java | 7 +
.../schema/lastcache/ILastCacheContainer.java | 5 +-
.../cache/schema/lastcache/LastCacheContainer.java | 7 +
.../analyze/schema/AutoCreateSchemaExecutor.java | 6 +-
.../config/executor/ClusterConfigTaskExecutor.java | 21 +-
.../config/executor/IConfigTaskExecutor.java | 4 +-
.../db/queryengine/plan/parser/ASTVisitor.java | 2 +-
.../apache/iotdb/db/schemaengine/SchemaEngine.java | 6 +-
.../schemaengine/metric/SchemaRegionMemMetric.java | 2 +-
.../rescon/DataNodeSchemaQuotaManager.java | 30 +-
.../rescon/ISchemaRegionStatistics.java | 2 +-
.../rescon/MemSchemaEngineStatistics.java | 29 +-
.../rescon/MemSchemaRegionStatistics.java | 40 +-
.../schemaregion/impl/SchemaRegionMemoryImpl.java | 23 +-
.../schemaregion/impl/SchemaRegionPBTreeImpl.java | 22 +-
.../java/org/apache/iotdb/db/service/DataNode.java | 66 ++
.../db/storageengine/dataregion/DataRegion.java | 44 +-
.../exception/CompactionExceptionHandler.java | 15 +-
.../execute/recover/CompactionRecoverTask.java | 18 +-
.../execute/task/AbstractCompactionTask.java | 15 +-
.../execute/task/InnerSpaceCompactionTask.java | 6 +-
.../compaction/repair/RepairDataFileScanUtil.java | 4 +
.../repair/RepairTimePartitionScanTask.java | 12 +
.../schedule/CompactionScheduleTaskManager.java | 4 +-
.../compaction/schedule/CompactionScheduler.java | 6 -
.../compaction/schedule/CompactionTaskQueue.java | 52 +-
.../impl/RewriteCrossSpaceCompactionSelector.java | 6 +-
.../memtable/AlignedWritableMemChunk.java | 5 +-
.../dataregion/memtable/TsFileProcessor.java | 163 +++--
.../storageengine/dataregion/tsfile/TsFileID.java | 18 +-
.../dataregion/tsfile/TsFileManager.java | 2 +-
.../tsfile/timeindex/DeviceTimeIndex.java | 64 +-
.../dataregion/tsfile/timeindex/FileTimeIndex.java | 22 +-
.../dataregion/tsfile/timeindex/ITimeIndex.java | 2 -
.../wal/recover/file/TsFilePlanRedoer.java | 8 +-
.../file/UnsealedTsFileRecoverPerformer.java | 12 +-
.../agent/SubscriptionAgentLauncher.java | 2 +-
.../agent/SubscriptionConsumerAgent.java | 2 +-
.../broker/SerializedEnrichedEvent.java | 18 +-
.../executor/SubscriptionSubtaskExecutor.java | 2 +-
.../receiver/SubscriptionReceiverV1.java | 30 +-
.../task/stage/SubscriptionTaskConnectorStage.java | 2 +-
.../SubscriptionConnectorSubtaskLifeCycle.java | 2 +-
.../SubscriptionConnectorSubtaskManager.java | 6 +-
.../cache/dualkeycache/DualKeyCacheTest.java | 114 ++++
.../schemaRegion/SchemaStatisticsTest.java | 12 +-
.../iotdb/db/pipe/connector/PipeReceiverTest.java | 2 +-
.../PipeConnectorSubtaskExecutorTest.java | 1 -
.../PipeProcessorSubtaskExecutorTest.java | 1 -
.../pattern/CachedSchemaPatternMatcherTest.java | 1 -
.../inner/InnerSpaceCompactionExceptionTest.java | 5 +-
.../wal/recover/file/TsFilePlanRedoerTest.java | 36 +-
.../file/UnsealedTsFileRecoverPerformerTest.java | 87 +++
.../resources/conf/iotdb-common.properties | 9 -
.../apache/iotdb/commons/conf/CommonConfig.java | 26 +
.../iotdb/commons/conf/CommonDescriptor.java | 5 +
.../apache/iotdb/commons/conf/IoTDBConstant.java | 13 +-
.../apache/iotdb/commons/path/PathPatternTree.java | 54 ++
.../iotdb/commons/path/PathPatternTreeUtils.java | 22 +-
.../iotdb/commons/pipe/config/PipeConfig.java | 7 +
.../config/constant/PipeConnectorConstant.java | 18 +
.../pipe/connector/PipeReceiverStatusHandler.java | 10 +-
.../pipe/connector/client/IoTDBSyncClient.java | 4 +-
.../connector/client/IoTDBSyncClientManager.java | 107 ++-
.../connector/protocol/IoTDBAirGapConnector.java | 98 ++-
.../pipe/connector/protocol/IoTDBConnector.java | 57 +-
.../connector/protocol/IoTDBSslSyncConnector.java | 6 +-
.../listening/AbstractPipeListeningQueue.java | 6 +-
.../iotdb/commons/pipe/event/EnrichedEvent.java | 6 +-
.../pipe/metric/PipeEventCommitMetrics.java | 2 +-
.../{committer => }/PipeEventCommitManager.java | 2 +-
.../{committer => }/PipeEventCommitter.java | 2 +-
.../commons/pipe/receiver/IoTDBFileReceiver.java | 263 +++++---
.../commons/pipe/receiver/IoTDBReceiverAgent.java | 46 +-
.../meta/consumer/ConsumerGroupMeta.java | 2 +-
.../org/apache/iotdb/commons/utils/FileUtils.java | 10 -
.../utils/{ => KillPoint}/DataNodeKillPoints.java | 13 +-
.../IoTConsensusRemovePeerKillPoints.java} | 13 +-
.../iotdb/commons/utils/KillPoint/KillPoint.java | 80 +++
.../NeverTriggeredKillPoint.java} | 10 +-
.../consumer/ConsumerGroupDeSerTest.java | 2 +-
.../iotdb/tsfile/common/conf/TSFileDescriptor.java | 4 +-
.../src/main/thrift/confignode.thrift | 9 +-
pom.xml | 3 +-
305 files changed, 5625 insertions(+), 2825 deletions(-)
create mode 100644
integration-test/src/test/java/org/apache/iotdb/confignode/it/load/IoTDBMultiDBRegionGroupLeaderDistributionIT.java
rename
integration-test/src/test/java/org/apache/iotdb/confignode/it/load/{IoTDBClusterRegionLeaderBalancingIT.java
=> IoTDBRegionGroupLeaderDistributionIT.java} (74%)
rename
integration-test/src/test/java/org/apache/iotdb/confignode/it/{IoTDBRegionMigrateReliabilityIT.java
=> regionmigration/IoTDBRegionMigrateReliabilityITFramework.java} (50%)
create mode 100644
integration-test/src/test/java/org/apache/iotdb/confignode/it/regionmigration/notpass/datanodecrash/CoordinatorRemoveRemotePeerCrashIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/confignode/it/regionmigration/notpass/datanodecrash/IoTDBRegionMigrateDataNodeCrashIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/confignode/it/regionmigration/pass/IoTDBRegionMigrateConfigNodeCrashIT.java
copy
iotdb-client/service-rpc/src/main/java/org/apache/iotdb/rpc/subscription/SubscriptionException.java
=>
integration-test/src/test/java/org/apache/iotdb/confignode/it/regionmigration/pass/IoTDBRegionMigrateNormalIT.java
(52%)
copy
iotdb-core/confignode/src/test/java/org/apache/iotdb/confignode/manager/load/cache/ConsensusCacheTest.java
=>
integration-test/src/test/java/org/apache/iotdb/confignode/it/regionmigration/pass/IoTDBRegionMigrateOtherIT.java
(50%)
rename
{iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/exception/subscription
=>
iotdb-client/service-rpc/src/main/java/org/apache/iotdb/rpc/subscription/exception}/SubscriptionException.java
(96%)
rename
iotdb-client/service-rpc/src/main/java/org/apache/iotdb/rpc/subscription/{SubscriptionException.java
=> exception/SubscriptionParameterNotValidException.java} (59%)
rename
{iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/exception/subscription
=>
iotdb-client/service-rpc/src/main/java/org/apache/iotdb/rpc/subscription/exception}/SubscriptionPollTimeOutException.java
(69%)
create mode 100644
iotdb-client/session/src/main/java/org/apache/iotdb/session/subscription/SubscriptionEndpointsSyncer.java
copy
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/load/subscriber/{IClusterStatusSubscriber.java
=> NodeStatisticsChangeEvent.java} (56%)
copy
iotdb-core/confignode/src/{test/java/org/apache/iotdb/confignode/manager/load/cache/ConsensusCacheTest.java
=>
main/java/org/apache/iotdb/confignode/manager/load/subscriber/RegionGroupStatisticsChangeEvent.java}
(51%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/agent/PipeConfigNodeAgent.java (86%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/agent/plugin/PipeConfigNodePluginAgent.java (96%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/agent/plugin/PipeConfigRegionConnectorConstructor.java (91%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/agent/plugin/PipeConfigRegionExtractorConstructor.java (92%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/agent/plugin/PipeConfigRegionProcessorConstructor.java (95%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/agent/receiver/IoTDBConfigNodeReceiverAgent.java (64%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/agent/runtime/PipeConfigNodeRuntimeAgent.java (95%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/agent/runtime/PipeConfigRegionListener.java (90%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/agent/task/PipeConfigNodeTaskAgent.java (94%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/connector/client/IoTDBConfigNodeSyncClientManager.java (81%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer/connector/payload/request
=> connector/payload}/PipeTransferConfigNodeHandshakeV1Req.java (96%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer/connector/payload/request
=> connector/payload}/PipeTransferConfigNodeHandshakeV2Req.java (96%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer/connector/payload/request
=> connector/payload}/PipeTransferConfigPlanReq.java (97%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer/connector/payload/request
=> connector/payload}/PipeTransferConfigSnapshotPieceReq.java (96%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer/connector/payload/request
=> connector/payload}/PipeTransferConfigSnapshotSealReq.java (98%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer/connector/config
=> connector/protocol}/IoTDBConfigRegionAirGapConnector.java (91%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer/connector/config
=> connector/protocol}/IoTDBConfigRegionConnector.java (92%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/execution/PipeConfigNodeSubtask.java (96%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/execution/PipeConfigNodeSubtaskExecutor.java (96%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/extractor/ConfigRegionListeningFilter.java (94%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/extractor/ConfigRegionListeningQueue.java (99%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/extractor/IoTDBConfigRegionExtractor.java (96%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer/agent/receiver
=> receiver/protocol}/IoTDBConfigNodeReceiver.java (89%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer/agent/receiver
=> receiver/visitor}/PipeConfigPhysicalPlanExceptionVisitor.java (96%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer/agent/receiver
=> receiver/visitor}/PipeConfigPhysicalPlanTSStatusVisitor.java (98%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/task/PipeConfigNodeTask.java (95%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/task/PipeConfigNodeTaskBuilder.java (94%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/{transfer
=> }/task/PipeConfigNodeTaskStage.java (90%)
rename
iotdb-core/confignode/src/test/java/org/apache/iotdb/confignode/manager/load/balancer/router/leader/{MinCostFlowLeaderBalancerTest.java
=> CFDLeaderBalancerTest.java} (78%)
rename
iotdb-core/confignode/src/test/java/org/apache/iotdb/confignode/manager/pipe/{
=> connector}/PipeConfigNodeThriftRequestTest.java (89%)
delete mode 100644
iotdb-core/confignode/src/test/java/org/apache/iotdb/confignode/persistence/node/NodeStatisticsTest.java
delete mode 100644
iotdb-core/confignode/src/test/java/org/apache/iotdb/confignode/persistence/partition/statistics/RegionGroupStatisticsTest.java
delete mode 100644
iotdb-core/confignode/src/test/java/org/apache/iotdb/confignode/persistence/partition/statistics/RegionStatisticsTest.java
rename
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/execution/{executor
=> }/PipeConnectorSubtaskExecutor.java (96%)
rename
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/execution/{executor
=> }/PipeProcessorSubtaskExecutor.java (95%)
rename
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/execution/{executor
=> }/PipeSubtaskExecutorManager.java (97%)
rename
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/pattern/{matcher =>
}/CachedSchemaPatternMatcher.java (99%)
rename
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/pattern/{matcher =>
}/PipeDataRegionMatcher.java (97%)
rename
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/progress/{assigner
=> }/SimpleConsensusProgressIndexAssigner.java (98%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/{
=> protocol}/airgap/IoTDBAirGapReceiver.java (79%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/{
=> protocol}/airgap/IoTDBAirGapReceiverAgent.java (98%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/{
=> protocol}/legacy/IoTDBLegacyPipeReceiverAgent.java (99%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/{
=> protocol}/legacy/loader/DeletionLoader.java (98%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/{
=> protocol}/legacy/loader/ILoader.java (95%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/{
=> protocol}/legacy/loader/TsFileLoader.java (98%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/{
=> protocol}/thrift/IoTDBDataNodeReceiver.java (86%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/{
=> protocol}/thrift/IoTDBDataNodeReceiverAgent.java (66%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/{
=> visitor}/PipePlanToStatementVisitor.java (99%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/{
=> visitor}/PipeStatementExceptionVisitor.java (77%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/{
=> visitor}/PipeStatementTSStatusVisitor.java (91%)
rename
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/progress/{committer
=> }/PipeEventCommitManager.java (98%)
rename
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/progress/{committer
=> }/PipeEventCommitter.java (98%)
copy iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/utils/{ =>
KillPoint}/DataNodeKillPoints.java (78%)
copy
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/utils/{DataNodeKillPoints.java
=> KillPoint/IoTConsensusRemovePeerKillPoints.java} (81%)
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/utils/KillPoint/KillPoint.java
rename
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/utils/{DataNodeKillPoints.java
=> KillPoint/NeverTriggeredKillPoint.java} (83%)
