This is an automated email from the ASF dual-hosted git repository.
chenyz pushed a change to branch udtf-optimize
in repository https://gitbox.apache.org/repos/asf/iotdb.git
from d2f3471900e save
add ca8482a7bb1 Improve authority control of cluster management (#14924)
add 69a4eb2897b Subscription: avoid null pointer exception when get
current response due to concurrent operations (#14926)
add 82624e21d5f Load: auto detect TsFile's model (tree/table) (#14751)
add 4866f6d2cfa Add logs for PartitionTableAutoCleaner (#14934)
add 57ce941d889 Load: Add mods file metrics count (#14930)
add a864d9fabc4 Fix class name of RPCServiceMBean #14940
add bb8a5f74356 Pipe: Fix the protential resource leak issue of async
client when async manager is closed (#14929)
add 72dd41d62ed Pipe: Add memory control mechanism for TsFile batch mode
in sinks (#14911)
add 9733c7540cf Delete remove node logic in ServerCommandLine #14933
add ab2ab36fa7d Subscription: check if all topic messages have been
consumed when client polling (#14937)
add 5d38f0c251e Fix the missing deletion when concurrent deletion and
insertion compaction (#14955)
add dbe2d37c389 enhance wal compatibility (#14954)
add de10ea78911 [AINode] Optimize the error information when dropping
built-in model (#14943)
add fa9711e1146 IoTConsensusV2: Use custom commitIndex to indicate
synchronization progress instead of pipe's commitIndex (#14624)
add 29cc71b599f Add timestamp suffix to vulnerability check report.
(#14960)
add fb2cb7a394b Fix state setting of AbstractOperatePipeProcedureV2 &
Enhance state checking of StateMachineProcedure #14959
add 9e79d85b7a8 peformance regression of sequential inserting (#14951)
add 95972550d8c Introduce flushing on specific regions & IoTConsensusV2:
Flush old leader when leader transfer & Delay the execution of
invalidateSchemaCache after leader change (#14910)
add f6c3c5da617 Adapt to Mybatis generator (#14936)
add 1e6513b1fc5 IoTConsensusV2: Multi-Dirs balance with sequence rolling
strategy in receiver (#14962)
add e1840d0ea7a [IoTConsensus] More accurate statistics on IoTConsensus
memory management (#14965)
add 56080ee2f58 Revert "Allow to write time column only (#14703)" (#14967)
add b638a70a4cc Pipe: Reduce the frequency of printing logs when
AirGapConnector connection fails (#14949)
add a94ae439dde Fix the support of MQTT with java8 (#14968)
add f1a224e56c1 Subscription: unify tablet push consumer builder return
type (#14971)
add ede623a27d8 Pipe: Implemented OPC DA Sink for local COM & Fixed the
newest value of OPC UA Sink (#14964)
add 2a77b7ab162 Pipe: Optimize the TsFile memory control mechanism of the
disassembly table model (#14890)
add aad2caa9f22 Fix flush old leader NPE when rebanlce #14981
add 3384bd69a92 Subscription: add parameter to the clean up method to
distinguish the force close situation & fix reference count management for
iteration snapshot (#14966)
add a1b9f7938af [Table Model Subquery] Support Exists subquery
add 9ffef99a2ea Pipe: Make client-server the default setting of
opc-ua-sink (#14979)
add c1723158ebc [To Master] Adds extensibility to MQTT's table (#14976)
add 662de3115c5 Pipe: Fixed the NPE caused by creating a new Region during
the execution of Alter Pipe Procedure. (#14982)
add b3e57d29409 Shuffle nodeurls to make sure all connections aren't to
the first node by default #14983
add ee7e8f9d349 [RTO/RPO] Add Phi Accrual for Node failure detection
(#14866)
add 21ad376a2a3 Add -lpf param in ExportData (#14957)
add 5e1bd035dc6 Improved the calculation accuracy of table schema fetch +
partial query & Fixed the bug that the attributes' memory is not calculated
when schema region recovers (#14975)
add 9c66a3cdc83 Fix group by hash when process TsBlock more than 1024
lines (#14989)
add 82e9361c6a6 Implemented max ttl under specific database getter for
table model (#14977)
add 174b2cb968f IoTConsensusV2: Transfer table deletion without any parse
or filter (#14988)
add c5a2e4364f4 Pipe: implement AutoCloseable for insert node event and
raw tablet event & Subscription: add parameter control tablet event batch
estimate & close memory block in tablet event for iteration snapshot (#14991)
add f4c85210eca Pipe: Refactor pipe metrics related packages (#14997)
add 90be866a86e Fix StreamingHashAggOperator when process input TsBlock
with more than maxTsBlockLineNumber unPreGroup values in one preGroup
add a40a0153fed Try remove NormalizeToOuterToInnerJoin
add 0db89873e78 Modified pks, sversion, dbname (#14999)
add 1adc74dffd2 fix: memtable enhancement issues (#14994)
add e8d07c156da Load: detect region migration during second phase (#15005)
add 17f099e03db Fix typo in SimpleNestedLoopJoinOperator
add 5911f231b79 Pipe: Using caching to optimize the verifyTableDataType
method in the Load analysis phase (#15007)
add 9154e7c67c8 revert: page access when initialize statistics and build
TsBlock for aligned memchunk (#15013)
add 83d53722cd3 Make the error message clearer for query operator
add d412a202af6 Reject insert without field column (#15017)
add f9f0574b0f7 Fix frozen IoTConsensus sync lag (#15023)
add 8fe854752de Bump jinja2 from 3.1.5 to 3.1.6 in /iotdb-core/ainode
(#15026)
add 1ab9631cb4b Added comment for table & column
add 93f0795233d IoTConsensusV2: persistent isGeneratedByPipeConsensus
(#14938)
add 1669f503907 [Fix](query)(table model) GroupedAccumulator are not
discovered before because of stream optimize
add b8947ff54fd Delete Maintain Auth
add 809ecd4cad1 Fix (#15027)
add 23068b42bbe Add memory metrics and refact memory allocation (#14710)
add f58ba839f2e Fixed the memory leakage of TableDeviceSchemaCache & The
invalidation logic when filter by SK & The bug that last time may not be
invalidated when the measurement with largest last time is invalidated (#15018)
add fddf0a6eaa2 Fixed the metadata query & Fragment Instance & retry's
timeout
add 93abf64655f Fix overflow when using format in ns timestamp precision
add 25af23d1b19 Added comments to tables and columns (#15033)
add 8608710e89a Fix Memory NPE when use IDEA to debug #15034
add 727ad63f214 Load: Detect 2PC Second Phase and RM Running in Parallel
(#15020)
add c557e3e42fc perf: more adjustment for memtable/tvlist (#15035)
add ee8b308d922 Fix resetPeerListTest for unstable port binding #15038
add ce47273ba7f Subscription: let subscription module fully manage the
parsing process of the insert node event (#15012)
add ea4322722f3 Fix some issue in auth model.
add 5bb6803e999 Pipe: Implemented runtime permission check (#14885)
add 3b246f1f551 [Fix](query) Fix the calc logic of dispatch read time
(#15036)
add 55dc0478376 Fix division by zero error when flush memtable (#15045)
add 59c1a8ef114 Load: Fix memory size counting on cases when query
engine's memory is not sufficient (#15049)
add af11a09648f Pipe: Fix tsfile resource deserialize failed (#15052)
(#15053)
add d7dbf41d95b Pipe: Fixed the pipe parsing bug for logical view (#15055)
add cc0a99a456f Pipe: Optimize realtime performace when pipe starts after
long time stop with heavy data backlog (#15048) (#15057)
add f4fd9666876 Introduce User-defined Polymorphic Table Function
add a7ebfa82873 DAL: Fix deletion buffer oom & enable DAL direct memory
management
add 7f837fde69b resolve conflict
No new revisions were added by this update.
Summary of changes:
.github/workflows/vulnerability-check.yml | 7 +-
dependencies.json | 1 +
.../server/CustomizedJsonPayloadFormatter.java | 8 +-
.../org/apache/iotdb/mqtt/server/MyMessage.java | 80 ---
.../java/org/apache/iotdb/mqtt/MQTTClient.java | 2 +-
.../org/apache/iotdb/ainode/it/AINodeBasicIT.java | 2 +
.../org/apache/iotdb/db/it/IoTDBLoadTsFileIT.java | 73 ---
.../org/apache/iotdb/db/it/auth/IoTDBAuthIT.java | 132 ++++
.../it/auth/IoTDBClusterAuthorityRelationalIT.java | 1 -
.../iotdb/db/it/auth/IoTDBRelationalAuthIT.java | 62 +-
.../iotdb/db/it/auth/IoTDBSystemPermissionIT.java | 2 -
.../org/apache/iotdb/db/it/utils/TestUtils.java | 1 -
.../pipe/it/dual/tablemodel/TableModelUtils.java | 6 +
.../manual/basic/IoTDBPipeDataSinkIT.java | 6 +
.../manual/basic/IoTDBPipeExtractorIT.java | 7 +
.../manual/basic/IoTDBPipeLifeCycleIT.java | 64 +-
.../manual/basic/IoTDBPipePermissionIT.java | 226 +++++++
.../manual/basic/IoTDBPipeProtocolIT.java | 4 +
.../manual/basic/IoTDBPipeSwitchStatusIT.java | 4 +
.../tablemodel/manual/basic/IoTDBPipeSyntaxIT.java | 1 +
.../manual/basic/IoTDBPipeWithLoadIT.java | 4 +
.../manual/basic/IoTDBTablePatternFormatIT.java | 7 +
.../manual/enhanced/IoTDBPipeAutoConflictIT.java | 4 +
.../manual/enhanced/IoTDBPipeAutoDropIT.java | 2 +
.../manual/enhanced/IoTDBPipeClusterIT.java | 13 +
.../enhanced/IoTDBPipeConnectorCompressionIT.java | 12 +-
.../enhanced/IoTDBPipeConnectorParallelIT.java | 2 +
.../manual/enhanced/IoTDBPipeIdempotentIT.java | 13 +
.../manual/enhanced/IoTDBPipeMetaIT.java | 4 +
.../manual/enhanced/IoTDBPipeNullValueIT.java | 1 +
.../pipe/it/single/IoTDBPipePermissionIT.java | 157 +++++
.../it/db/it/IoTDBAuthenticationTableIT.java | 114 +++-
.../it/db/it/IoTDBFlushQueryTableIT.java | 30 +-
.../relational/it/db/it/IoTDBInsertTableIT.java | 47 +-
.../db/it/IoTDBMultiTAGsWithAttributesTableIT.java | 12 +-
.../db/it/udf/IoTDBUserDefinedTableFunctionIT.java | 13 +
.../relational/it/mqtt/IoTDBMQTTServiceIT.java | 2 +-
.../scalar/IoTDBFormatFunctionTableIT.java | 16 +-
.../query/old/query/IoTDBGreatestLeastTableIT.java | 2 +-
.../it/query/recent/IoTDBMaintainAuthIT.java | 89 +--
.../it/query/recent/IoTDBTableAggregationIT.java | 4 +-
.../IoTDBTableAggregationNonStreamIT.java} | 27 +-
.../IoTDBCorrelatedExistsSubqueryIT.java | 428 +++++++++++++
.../IoTDBUncorrelatedExistsSubqueryIT.java | 391 ++++++++++++
.../relational/it/schema/IoTDBDatabaseIT.java | 59 +-
.../iotdb/relational/it/schema/IoTDBTableIT.java | 37 +-
.../it/session/IoTDBSessionRelationalIT.java | 133 ++--
.../iotdb/session/it/IoTDBSessionSimpleIT.java | 48 --
.../it/local/IoTDBSubscriptionBasicIT.java | 38 +-
.../iotdb/udf/api/relational/TableFunction.java | 20 +-
.../relational/table/TableFunctionAnalysis.java | 2 +-
.../specification/TableParameterSpecification.java | 18 +
.../org/apache/iotdb/tool/common/OptionsUtil.java | 54 +-
.../org/apache/iotdb/tool/data/ExportData.java | 4 +-
.../iotdb/jdbc/IoTDBAbstractDatabaseMetadata.java | 88 +--
.../org/apache/iotdb/jdbc/IoTDBConnection.java | 7 +
.../apache/iotdb/jdbc/IoTDBDatabaseMetadata.java | 64 ++
.../org/apache/iotdb/jdbc/IoTDBJDBCResultSet.java | 25 +-
.../apache/iotdb/jdbc/IoTDBPreparedStatement.java | 31 +-
.../IoTDBRelationalDatabaseMetadata.java | 167 ++++-
.../java/org/apache/iotdb/session/Session.java | 17 +-
.../base/AbstractSubscriptionConsumer.java | 29 +-
.../SubscriptionTablePushConsumerBuilder.java | 3 +-
iotdb-core/ainode/poetry.lock | 149 +++--
iotdb-core/confignode/pom.xml | 4 +
.../iotdb/confignode/conf/ConfigNodeConfig.java | 45 ++
.../confignode/conf/ConfigNodeDescriptor.java | 30 +
.../consensus/request/ConfigPhysicalPlan.java | 8 +
.../consensus/request/ConfigPhysicalPlanType.java | 2 +
.../request/ConfigPhysicalPlanVisitor.java | 15 +
...umnPlan.java => SetTableColumnCommentPlan.java} | 26 +-
...bleColumnPlan.java => SetTableCommentPlan.java} | 27 +-
.../iotdb/confignode/manager/ConfigManager.java | 23 +
.../apache/iotdb/confignode/manager/IManager.java | 3 +
.../iotdb/confignode/manager/ModelManager.java | 5 +
.../confignode/manager/PermissionManager.java | 4 +
.../manager/load/balancer/PartitionBalancer.java | 8 +-
.../manager/load/balancer/RouteBalancer.java | 154 +++--
.../manager/load/cache/AbstractLoadCache.java | 26 +-
.../manager/load/cache/IFailureDetector.java} | 24 +-
.../manager/load/cache/detector/FixedDetector.java | 58 ++
.../load/cache/detector/PhiAccrualDetector.java | 181 ++++++
.../load/cache/node/AINodeHeartbeatCache.java | 15 +-
.../load/cache/node/ConfigNodeHeartbeatCache.java | 12 +-
.../load/cache/node/DataNodeHeartbeatCache.java | 11 +-
.../manager/load/cache/region/RegionCache.java | 12 +-
.../iotdb/confignode/manager/node/NodeManager.java | 53 +-
.../pipe/agent/task/PipeConfigNodeSubtask.java | 2 +-
.../pipe/agent/task/PipeConfigNodeTaskAgent.java | 4 +-
.../pipe/event/PipeConfigRegionSnapshotEvent.java | 14 +-
.../pipe/event/PipeConfigRegionWritePlanEvent.java | 26 +-
.../extractor/ConfigRegionListeningFilter.java | 6 +-
.../pipe/extractor/IoTDBConfigRegionExtractor.java | 112 +++-
...ConfigPhysicalPlanTablePatternParseVisitor.java | 22 +
...nfigPhysicalPlanTablePrivilegeParseVisitor.java | 364 +++++++++++
...eConfigPhysicalPlanTreePatternParseVisitor.java | 2 +-
.../manager/pipe/metric/PipeConfigNodeMetrics.java | 9 +
.../PipeConfigNodeRemainingTimeMetrics.java | 2 +-
.../PipeConfigNodeRemainingTimeOperator.java | 2 +-
.../PipeConfigNodeResourceMetrics.java | 2 +-
.../{ => overview}/PipeProcedureMetrics.java | 2 +-
.../metric/{ => overview}/PipeTaskInfoMetrics.java | 2 +-
.../PipeTemporaryMetaInCoordinatorMetrics.java | 2 +-
.../PipeConfigNodeReceiverMetrics.java | 2 +-
.../PipeConfigRegionConnectorMetrics.java | 2 +-
.../PipeConfigNodeListenerMetrics.java | 2 +-
.../PipeConfigRegionExtractorMetrics.java | 2 +-
.../receiver/protocol/IoTDBConfigNodeReceiver.java | 120 +++-
.../PipeConfigPhysicalPlanTSStatusVisitor.java | 36 +-
.../resource/PipeConfigNodeResourceManager.java | 1 +
.../PipeConfigNodeSnapshotResourceManager.java | 2 +-
.../manager/schema/ClusterSchemaManager.java | 52 +-
.../iotdb/confignode/persistence/AuthorInfo.java | 4 +
.../iotdb/confignode/persistence/ModelInfo.java | 2 +-
.../iotdb/confignode/persistence/TTLInfo.java | 2 +-
.../persistence/executor/ConfigPlanExecutor.java | 6 +
.../partition/DatabasePartitionTable.java | 14 +-
.../confignode/persistence/pipe/PipeInfo.java | 2 +-
.../persistence/schema/ClusterSchemaInfo.java | 59 ++
.../confignode/persistence/schema/ConfigMTree.java | 31 +
.../procedure/PartitionTableAutoCleaner.java | 17 +-
.../procedure/impl/StateMachineProcedure.java | 9 +-
.../impl/pipe/AbstractOperatePipeProcedureV2.java | 4 +-
.../impl/pipe/task/AlterPipeProcedureV2.java | 67 +-
.../impl/pipe/task/CreatePipeProcedureV2.java | 97 +++
.../iotdb/confignode/service/ConfigNode.java | 44 +-
.../request/ConfigPhysicalPlanSerDeTest.java | 33 +-
.../manager/load/cache/detector/DetectorTest.java | 179 ++++++
...igPhysicalPlanTablePatternParseVisitorTest.java | 18 +
...figPhysicalPlanTreePatternParseVisitorTest.java | 2 +-
.../common/request/IConsensusRequest.java | 5 +
.../common/request/IndexedConsensusRequest.java | 8 +-
.../iotdb/consensus/config/IoTConsensusConfig.java | 30 +-
.../consensus/config/PipeConsensusConfig.java | 21 +-
.../apache/iotdb/consensus/iot/IoTConsensus.java | 4 +-
.../logdispatcher/IoTConsensusMemoryManager.java | 50 +-
.../consensus/iot/logdispatcher/LogDispatcher.java | 12 +-
.../apache/iotdb/consensus/pipe/PipeConsensus.java | 80 +--
.../consensus/pipe/PipeConsensusServerImpl.java | 25 +-
.../pipe/consensuspipe/ConsensusPipeManager.java | 8 +-
...xManager.java => ReplicateProgressManager.java} | 8 +-
.../pipe/metric/PipeConsensusSyncLagManager.java | 77 ++-
.../apache/iotdb/consensus/iot/StabilityTest.java | 49 +-
iotdb-core/datanode/pom.xml | 8 +
.../org/apache/iotdb/db/auth/AuthorityChecker.java | 11 +
.../apache/iotdb/db/conf/DataNodeMemoryConfig.java | 684 ++++++++++++++++++++
.../java/org/apache/iotdb/db/conf/IoTDBConfig.java | 358 +----------
.../org/apache/iotdb/db/conf/IoTDBDescriptor.java | 313 +--------
.../db/consensus/DataRegionConsensusImpl.java | 15 +-
.../PipeDataRegionConnectorConstructor.java | 4 +
.../runtime/PipeSchemaRegionListenerManager.java | 2 +-
.../db/pipe/agent/task/PipeDataNodeTaskAgent.java | 58 +-
.../pipe/agent/task/connection/EnrichedDeque.java | 2 +-
.../agent/task/connection/PipeEventCollector.java | 34 +-
.../agent/task/stage/PipeTaskProcessorStage.java | 7 +-
.../subtask/connector/PipeConnectorSubtask.java | 4 +-
.../connector/PipeConnectorSubtaskManager.java | 2 +-
.../PipeRealtimePriorityBlockingQueue.java | 51 +-
.../subtask/processor/PipeProcessorSubtask.java | 7 +-
.../client/IoTDBDataNodeAsyncClientManager.java | 4 +
.../evolvable/batch/PipeTabletEventBatch.java | 37 +-
.../evolvable/batch/PipeTabletEventPlainBatch.java | 41 +-
.../batch/PipeTabletEventTsFileBatch.java | 11 +-
.../connector/protocol/opcda/OpcDaConnector.java | 138 ++++
.../pipe/connector/protocol/opcda/OpcDaHeader.java | 200 ++++++
.../protocol/opcda/OpcDaServerHandle.java | 390 ++++++++++++
.../connector/protocol/opcua/OpcUaConnector.java | 50 +-
.../connector/protocol/opcua/OpcUaNameSpace.java | 2 +-
.../pipeconsensus/PipeConsensusAsyncConnector.java | 16 +-
.../pipeconsensus/PipeConsensusSyncConnector.java | 9 +-
.../PipeConsensusTabletInsertionEventHandler.java | 8 +-
.../PipeConsensusTsFileInsertionEventHandler.java | 8 +-
.../PipeConsensusTransferBatchReqBuilder.java | 5 +-
.../async/IoTDBDataRegionAsyncConnector.java | 21 +-
.../protocol/writeback/WriteBackConnector.java | 83 ++-
....java => ReplicateProgressDataNodeManager.java} | 36 +-
.../deletion/DeletionResourceManager.java | 4 +-
.../deletion/persist/PageCacheDeletionBuffer.java | 14 +-
.../db/pipe/event/UserDefinedEnrichedEvent.java | 14 +-
.../db/pipe/event/common/PipeInsertionEvent.java | 30 +-
.../common/deletion/PipeDeleteDataNodeEvent.java | 31 +-
.../event/common/heartbeat/PipeHeartbeatEvent.java | 19 +-
.../schema/PipeSchemaRegionSnapshotEvent.java | 16 +-
.../schema/PipeSchemaRegionWritePlanEvent.java | 18 +-
.../tablet/PipeInsertNodeTabletInsertionEvent.java | 127 +++-
.../common/tablet/PipeRawTabletInsertionEvent.java | 48 +-
.../event/common/terminate/PipeTerminateEvent.java | 13 +-
.../common/tsfile/PipeTsFileInsertionEvent.java | 116 +++-
.../parser/TsFileInsertionEventParserProvider.java | 5 +-
.../scan/TsFileInsertionEventScanParser.java | 3 -
.../table/TsFileInsertionEventTableParser.java | 111 +++-
...ileInsertionEventTableParserTabletIterator.java | 421 ++++++++++---
.../db/pipe/event/realtime/PipeRealtimeEvent.java | 28 +-
.../event/realtime/PipeRealtimeEventFactory.java | 92 ++-
.../dataregion/IoTDBDataRegionExtractor.java | 6 +-
...oricalDataRegionTsFileAndDeletionExtractor.java | 42 +-
.../realtime/PipeRealtimeDataRegionExtractor.java | 22 +-
.../PipeRealtimeDataRegionHybridExtractor.java | 9 +-
.../realtime/assigner/PipeDataRegionAssigner.java | 14 +-
.../dataregion/realtime/epoch/TsFileEpoch.java | 2 +-
.../realtime/epoch/TsFileEpochManager.java | 8 +-
.../listener/PipeInsertionDataNodeListener.java | 18 +-
.../matcher/CachedSchemaPatternMatcher.java | 40 +-
.../realtime/matcher/PipeDataRegionMatcher.java | 3 +
.../schemaregion/IoTDBSchemaRegionExtractor.java | 82 ++-
...ava => PipePlanTablePrivilegeParseVisitor.java} | 46 +-
.../schemaregion/PipeStatementToPlanVisitor.java | 48 ++
.../iotdb/db/pipe/metric/PipeDataNodeMetrics.java | 12 +
.../PipeDataNodeRemainingEventAndTimeMetrics.java | 2 +-
.../PipeDataNodeRemainingEventAndTimeOperator.java | 2 +-
.../{ => overview}/PipeHeartbeatEventMetrics.java | 2 +-
.../metric/{ => overview}/PipeResourceMetrics.java | 2 +-
.../PipeWALInsertNodeCacheMetrics.java | 2 +-
.../{ => processor}/PipeProcessorMetrics.java | 2 +-
.../PipeDataNodeReceiverMetrics.java | 2 +-
.../PipeSchemaRegionConnectorMetrics.java | 2 +-
.../PipeSchemaRegionExtractorMetrics.java | 2 +-
.../PipeSchemaRegionListenerMetrics.java | 2 +-
.../{ => sink}/PipeDataRegionConnectorMetrics.java | 2 +-
.../metric/{ => source}/PipeAssignerMetrics.java | 2 +-
.../{ => source}/PipeDataRegionEventCounter.java | 2 +-
.../PipeDataRegionExtractorMetrics.java | 2 +-
.../pipeconsensus/PipeConsensusProcessor.java | 43 +-
.../pipeconsensus/PipeConsensusReceiver.java | 340 +++++-----
.../protocol/thrift/IoTDBDataNodeReceiver.java | 12 +-
...leStatementDataTypeConvertExecutionVisitor.java | 1 +
.../resource/memory/InsertNodeMemoryEstimator.java | 2 +-
.../db/pipe/resource/memory/PipeMemoryBlock.java | 2 +-
.../db/pipe/resource/memory/PipeMemoryManager.java | 100 +--
.../pipe/resource/memory/PipeMemoryWeightUtil.java | 65 ++
.../db/protocol/mqtt/JSONPayloadFormatter.java | 7 +-
.../db/protocol/mqtt/LinePayloadFormatter.java | 7 +-
.../iotdb/db/protocol/mqtt/MPPPublishHandler.java | 11 +-
.../iotdb/db/protocol/mqtt/PayloadFormatter.java | 6 +
.../iotdb/db/protocol/session/SessionManager.java | 12 +
.../protocol/thrift/impl/ClientRPCServiceImpl.java | 2 +-
.../impl/DataNodeInternalRPCServiceImpl.java | 91 ++-
.../execution/exchange/SharedTsBlockQueue.java | 2 +-
.../execution/exchange/sink/ShuffleSinkHandle.java | 2 +-
.../execution/exchange/sink/SinkChannel.java | 2 +-
.../execution/exchange/source/SourceHandle.java | 2 +-
.../execution/memory/LocalMemoryManager.java | 5 +-
.../queryengine/execution/memory/MemoryPool.java | 42 +-
.../execution/operator/AbstractOperator.java | 5 +-
...owOperator.java => AssignUniqueIdOperator.java} | 75 ++-
.../process/function/PartitionRecognizer.java | 70 +--
.../function/TableFunctionLeafOperator.java | 1 +
.../process/function/TableFunctionOperator.java | 69 +-
.../process/function/partition/PartitionCache.java | 106 ++++
.../operator/process/function/partition/Slice.java | 168 ++---
.../process/function/partition/SliceCache.java | 55 --
.../join/SimpleNestedLoopCrossJoinOperator.java | 2 +-
.../operator/schema/SchemaQueryScanOperator.java | 12 +-
.../operator/schema/source/ISchemaSource.java | 5 +
.../schema/source/TableDeviceFetchSource.java | 21 +
.../schema/source/TableDeviceQuerySource.java | 36 +-
.../InformationSchemaContentSupplierFactory.java | 15 +-
...perator.java => MergeSortLeftJoinOperator.java} | 57 +-
.../aggregation/grouped/GroupedAggregator.java | 4 +-
.../grouped/GroupedFirstAccumulator.java | 11 +-
.../grouped/GroupedFirstByAccumulator.java | 2 +-
.../grouped/GroupedLastAccumulator.java | 1 +
.../grouped/GroupedLastByAccumulator.java | 2 +-
.../grouped/GroupedVarianceAccumulator.java | 2 +-
.../grouped/StreamingHashAggregationOperator.java | 3 +-
.../aggregation/grouped/hash/HashStrategy.java | 2 +-
.../execution/schedule/DriverScheduler.java | 6 +-
.../iotdb/db/queryengine/plan/Coordinator.java | 8 +-
.../queryengine/plan/analyze/AnalyzeVisitor.java | 29 +-
.../plan/analyze/ClusterPartitionFetcher.java | 5 +
.../plan/analyze/IPartitionFetcher.java | 4 +
.../analyze/cache/partition/PartitionCache.java | 16 +-
.../cache/schema/DataNodeDevicePathCache.java | 23 +-
.../schema/dualkeycache/impl/DualKeyCacheImpl.java | 9 +-
.../plan/analyze/load/LoadTsFileAnalyzer.java | 562 +++++++++++++----
.../analyze/load/LoadTsFileTableSchemaCache.java | 24 +-
.../load/LoadTsFileToTableModelAnalyzer.java | 226 -------
.../load/LoadTsFileToTreeModelAnalyzer.java | 187 ------
.../load/TreeSchemaAutoCreatorAndVerifier.java | 4 +-
.../analyze/schema/AutoCreateSchemaExecutor.java | 6 +-
.../analyze/schema/ClusterSchemaFetchExecutor.java | 11 +-
.../queryengine/plan/execution/QueryExecution.java | 4 -
.../execution/config/TableConfigTaskVisitor.java | 218 +++++--
.../config/executor/ClusterConfigTaskExecutor.java | 85 +++
.../config/executor/IConfigTaskExecutor.java | 16 +
.../config/metadata/ShowFunctionsTask.java | 5 +
...nTask.java => AlterTableCommentColumnTask.java} | 13 +-
...esTask.java => AlterTableCommentTableTask.java} | 19 +-
.../relational/DescribeTableDetailsTask.java | 6 +
.../metadata/relational/ShowTablesDetailsTask.java | 7 +
.../execution/config/sys/pipe/ShowPipeTask.java | 2 +-
.../plan/planner/LocalExecutionPlanContext.java | 3 +-
.../plan/planner/LocalExecutionPlanner.java | 124 ++--
.../plan/planner/LogicalPlanVisitor.java | 4 +-
.../plan/planner/TableOperatorGenerator.java | 53 ++
.../SimpleFragmentParallelPlanner.java | 2 +-
.../distribution/WriteFragmentParallelPlanner.java | 3 +-
.../plan/planner/plan/node/PlanGraphPrinter.java | 14 +-
.../plan/planner/plan/node/PlanNodeType.java | 18 +-
.../plan/planner/plan/node/PlanVisitor.java | 9 +-
.../plan/planner/plan/node/write/InsertNode.java | 6 +-
.../planner/plan/node/write/InsertRowNode.java | 3 -
.../plan/node/write/RelationalInsertRowNode.java | 5 -
.../node/write/RelationalInsertTabletNode.java | 8 -
.../relational/analyzer/StatementAnalyzer.java | 31 +-
.../analyzer/StatementAnalyzerFactory.java | 4 +
.../PredicatePushIntoMetadataChecker.java | 7 +-
.../metadata/fetcher/TableDeviceSchemaFetcher.java | 6 +-
.../fetcher/TableDeviceSchemaValidator.java | 6 +-
.../fetcher/TableHeaderSchemaValidator.java | 47 +-
.../fetcher/cache/TableAttributeSchema.java | 6 +-
.../fetcher/cache/TableDeviceLastCache.java | 5 +-
.../fetcher/cache/TableDeviceSchemaCache.java | 19 +-
.../plan/relational/planner/QueryPlanner.java | 4 +-
.../plan/relational/planner/RelationPlanner.java | 3 +-
.../distribute/TableDistributedPlanGenerator.java | 72 +--
.../distribute/TableModelQueryFragmentPlanner.java | 2 +-
.../TableModelTypeProviderExtractor.java | 4 +-
.../iterative/rule/AggregationDecorrelation.java | 83 +++
.../rule/ImplementTableFunctionSource.java | 4 +-
...olumns.java => PruneAssignUniqueIdColumns.java} | 20 +-
.../rule/PruneTableFunctionProcessorColumns.java | 1 -
.../iterative/rule/RemoveRedundantExists.java | 104 +++
...orrelatedDistinctAggregationWithProjection.java | 186 ++++++
...elatedDistinctAggregationWithoutProjection.java | 167 +++++
...mCorrelatedGlobalAggregationWithProjection.java | 318 ++++++++++
...rrelatedGlobalAggregationWithoutProjection.java | 302 +++++++++
...CorrelatedGroupedAggregationWithProjection.java | 252 ++++++++
...relatedGroupedAggregationWithoutProjection.java | 233 +++++++
.../rule/TransformCorrelatedJoinToJoin.java | 99 +++
.../rule/TransformExistsApplyToCorrelatedJoin.java | 214 +++++++
...forceSingleRowNode.java => AssignUniqueId.java} | 55 +-
.../{SortBasedGroupNode.java => GroupNode.java} | 37 +-
.../plan/relational/planner/node/Patterns.java | 27 +-
.../planner/optimizations/JoinUtils.java | 249 +++++---
.../optimizations/LogicalOptimizeFactory.java | 40 +-
.../planner/optimizations/ParallelizeGrouping.java | 20 +-
.../optimizations/PlanNodeDecorrelator.java | 699 +++++++++++++++++++++
.../PushLimitOffsetIntoTableScan.java | 14 +-
.../optimizations/PushPredicateIntoTableScan.java | 158 ++++-
.../optimizations/TransformSortToStreamSort.java | 4 +-
.../optimizations/UnaliasSymbolReferences.java | 21 +-
.../relational/planner/optimizations/Util.java | 19 +
.../plan/relational/security/AccessControl.java | 18 +-
.../relational/security/AccessControlImpl.java | 29 +-
.../relational/security/AllowAllAccessControl.java | 11 +-
.../relational/security/ITableAuthChecker.java | 3 +
.../relational/security/ITableAuthCheckerImpl.java | 18 +
.../relational/security/TableModelPrivilege.java | 5 -
.../plan/relational/sql/ast/AstVisitor.java | 16 +-
.../plan/relational/sql/ast/ColumnDefinition.java | 27 +-
.../plan/relational/sql/ast/CreateTable.java | 8 +
.../relational/sql/ast/EmptyTableTreatment.java | 86 ---
.../plan/relational/sql/ast/InsertRows.java | 3 -
.../plan/relational/sql/ast/LoadTsFile.java | 14 +-
.../ast/{DropColumn.java => SetColumnComment.java} | 26 +-
.../plan/relational/sql/ast/SetProperties.java | 12 -
.../{CountStatement.java => SetTableComment.java} | 60 +-
...onfiguration.java => ShowQueriesStatement.java} | 18 +-
.../sql/ast/TableFunctionInvocation.java | 41 +-
.../plan/relational/sql/parser/AstBuilder.java | 93 +--
.../plan/relational/sql/rewrite/ShowRewrite.java | 26 +-
.../sql/rewrite/StatementRewriteFactory.java | 6 +-
.../plan/relational/sql/util/SqlFormatter.java | 54 +-
.../scheduler/FragmentInstanceDispatcherImpl.java | 54 +-
.../scheduler/load/LoadTsFileDispatcherImpl.java | 22 +-
.../plan/scheduler/load/LoadTsFileScheduler.java | 118 ++--
.../plan/statement/crud/InsertBaseStatement.java | 28 +-
.../plan/statement/crud/InsertRowStatement.java | 3 -
.../plan/statement/crud/LoadTsFileStatement.java | 18 +-
.../metadata/CountTimeSlotListStatement.java | 7 +
.../statement/metadata/GetRegionIdStatement.java | 7 +
.../metadata/GetSeriesSlotListStatement.java | 7 +
.../metadata/GetTimeSlotListStatement.java | 7 +
.../metadata/RemoveConfigNodeStatement.java | 9 +-
.../metadata/RemoveDataNodeStatement.java | 9 +-
.../statement/metadata/ShowClusterIdStatement.java | 7 +
.../statement/metadata/ShowClusterStatement.java | 9 +-
.../metadata/ShowConfigNodesStatement.java | 4 +-
.../statement/metadata/ShowDataNodesStatement.java | 4 +-
.../statement/metadata/ShowRegionStatement.java | 4 +-
.../metadata/model/ShowAINodesStatement.java | 7 +
.../metadata/region/ExtendRegionStatement.java | 9 +-
.../metadata/region/MigrateRegionStatement.java | 9 +-
.../region/ReconstructRegionStatement.java | 9 +-
.../metadata/region/RemoveRegionStatement.java | 9 +-
.../plan/statement/sys/KillQueryStatement.java | 9 +-
.../plan/statement/sys/ShowQueriesStatement.java | 9 +-
.../statement/sys/TestConnectionStatement.java | 3 +-
.../unary/scalar/FormatColumnTransformer.java | 4 +-
.../metric/SchemaEngineCachedMetric.java | 5 +-
.../rescon/ISchemaRegionStatistics.java | 2 +
.../rescon/MemSchemaEngineStatistics.java | 41 +-
.../rescon/MemSchemaRegionStatistics.java | 16 +
.../attribute/DeviceAttributeStore.java | 48 +-
.../attribute/IDeviceAttributeStore.java | 16 +-
.../schemaregion/impl/SchemaRegionMemoryImpl.java | 36 +-
.../ReleaseFlushStrategySizeBasedImpl.java | 6 +-
.../java/org/apache/iotdb/db/service/DataNode.java | 64 +-
.../iotdb/db/service/ExternalRPCService.java | 2 +-
...viceMBean.java => ExternalRPCServiceMBean.java} | 2 +-
.../db/service/metrics/CompactionMetrics.java | 2 +-
.../iotdb/db/service/metrics/WritingMetrics.java | 2 +-
.../metrics/memory/ConsensusMemoryMetrics.java | 50 +-
.../metrics/memory/GlobalMemoryMetrics.java | 82 +--
.../metrics/memory/OffHeapMemoryMetrics.java | 102 +++
.../metrics/memory/QueryEngineMemoryMetrics.java | 281 ++++++---
.../metrics/memory/SchemaEngineMemoryMetrics.java | 159 +++--
.../metrics/memory/StorageEngineMemoryMetrics.java | 361 +++++++----
.../metrics/memory/StreamEngineMemoryMetrics.java | 50 +-
.../iotdb/db/storageengine/StorageEngine.java | 19 +-
.../db/storageengine/buffer/BloomFilterCache.java | 27 +-
.../iotdb/db/storageengine/buffer/ChunkCache.java | 27 +-
.../buffer/TimeSeriesMetadataCache.java | 27 +-
.../db/storageengine/dataregion/DataRegion.java | 11 +-
.../storageengine/dataregion/DataRegionInfo.java | 6 +-
.../execute/task/CrossSpaceCompactionTask.java | 2 +-
.../execute/task/InnerSpaceCompactionTask.java | 2 +-
.../task/RepairUnsortedFileCompactionTask.java | 2 +-
.../compaction/execute/utils/CompactionUtils.java | 12 +-
.../dataregion/memtable/AbstractMemTable.java | 82 ++-
.../memtable/AlignedReadOnlyMemChunk.java | 318 +++-------
.../memtable/AlignedWritableMemChunk.java | 147 ++---
.../memtable/AlignedWritableMemChunkGroup.java | 14 +-
.../dataregion/memtable/IMemTable.java | 2 +-
.../memtable/IWritableMemChunkGroup.java | 2 +-
.../dataregion/memtable/ReadOnlyMemChunk.java | 16 +-
.../dataregion/memtable/TsFileProcessor.java | 43 +-
.../dataregion/memtable/WritableMemChunk.java | 132 ++--
.../dataregion/memtable/WritableMemChunkGroup.java | 18 +-
.../read/reader/chunk/MemAlignedChunkReader.java | 188 ++----
.../read/reader/chunk/MemChunkReader.java | 4 +-
.../read/reader/chunk/MemPageReader.java | 6 +-
.../dataregion/tsfile/TsFileResource.java | 35 +-
.../dataregion/tsfile/TsFileResourceBlockType.java | 3 +
.../dataregion/wal/buffer/IWALBuffer.java | 10 +
.../dataregion/wal/buffer/WALBuffer.java | 13 +
.../storageengine/dataregion/wal/node/WALNode.java | 8 +-
.../wal/utils/MemoryControlledWALEntryQueue.java | 9 +-
.../dataregion/wal/utils/WALInsertNodeCache.java | 12 +-
.../load/config/LoadTsFileConfigurator.java | 24 -
...leStatementDataTypeConvertExecutionVisitor.java | 1 +
.../memory/LoadTsFileAnalyzeSchemaMemoryBlock.java | 2 +-
.../memory/LoadTsFileDataCacheMemoryBlock.java | 4 +-
.../load/memory/LoadTsFileMemoryManager.java | 29 +-
.../rescon/memory/PrimitiveArrayManager.java | 16 +-
.../db/storageengine/rescon/memory/SystemInfo.java | 187 ++----
.../rescon/memory/TimePartitionManager.java | 31 +-
.../rescon/memory/TsFileResourceManager.java | 40 +-
.../broker/SubscriptionPrefetchingQueue.java | 10 +-
.../broker/SubscriptionPrefetchingTabletQueue.java | 12 +-
.../broker/SubscriptionPrefetchingTsFileQueue.java | 12 +-
.../db/subscription/event/SubscriptionEvent.java | 4 +-
.../event/batch/SubscriptionPipeEventBatch.java | 2 +-
.../event/batch/SubscriptionPipeEventBatches.java | 2 +-
.../batch/SubscriptionPipeTabletEventBatch.java | 50 +-
.../SubscriptionPipeTabletIterationSnapshot.java | 44 +-
.../batch/SubscriptionPipeTsFileEventBatch.java | 2 +-
.../event/cache/SubscriptionPollResponseCache.java | 11 +
.../event/pipe/SubscriptionPipeEmptyEvent.java | 2 +-
.../event/pipe/SubscriptionPipeEvents.java | 2 +-
.../pipe/SubscriptionPipeTabletBatchEvents.java | 11 +-
.../pipe/SubscriptionPipeTsFileBatchEvents.java | 4 +-
.../pipe/SubscriptionPipeTsFilePlainEvent.java | 2 +-
.../SubscriptionConnectorSubtaskManager.java | 2 +-
.../db/tools/schema/SRStatementGenerator.java | 25 +-
.../apache/iotdb/db/utils/ErrorHandlingUtils.java | 3 +-
.../db/utils/datastructure/AlignedTVList.java | 108 ++--
.../iotdb/db/utils/datastructure/BinaryTVList.java | 40 +-
.../db/utils/datastructure/BooleanTVList.java | 40 +-
.../iotdb/db/utils/datastructure/DoubleTVList.java | 40 +-
.../datastructure/FixedPriorityBlockingQueue.java | 2 +-
.../iotdb/db/utils/datastructure/FloatTVList.java | 40 +-
.../iotdb/db/utils/datastructure/IntTVList.java | 40 +-
.../iotdb/db/utils/datastructure/LongTVList.java | 40 +-
.../MergeSortAlignedTVListIterator.java | 174 ++---
...tIterator.java => MergeSortTVListIterator.java} | 90 +--
.../utils/datastructure/PageColumnAccessInfo.java | 52 --
.../iotdb/db/utils/datastructure/TVList.java | 74 ++-
.../db/pipe/consensus/DeletionResourceTest.java | 7 +-
.../pipe/event/TsFileInsertionEventParserTest.java | 5 +-
.../db/pipe/extractor/PipeRealtimeExtractTest.java | 5 +
.../pattern/CachedSchemaPatternMatcherTest.java | 53 +-
.../db/protocol/mqtt/PayloadFormatManagerTest.java | 2 +-
.../execution/exchange/LocalSinkChannelTest.java | 7 +-
.../exchange/MPPDataExchangeManagerTest.java | 7 +-
.../execution/exchange/SharedTsBlockQueueTest.java | 4 +-
.../execution/exchange/ShuffleSinkHandleTest.java | 4 +-
.../execution/exchange/SinkChannelTest.java | 7 +-
.../execution/exchange/SourceHandleTest.java | 15 +-
.../execution/memory/MemoryPoolTest.java | 6 +-
.../execution/operator/OperatorMemoryTest.java | 2 -
.../process/tvf/TableFunctionOperatorTest.java | 3 -
.../plan/analyze/FakePartitionFetcherImpl.java | 5 +
.../plan/planner/distribution/Util.java | 5 +
.../plan/planner/distribution/Util2.java | 5 +
.../analyzer/AggregationCornerCaseTest.java | 323 ++++++++++
.../plan/relational/analyzer/AnalyzerTest.java | 4 +-
.../plan/relational/analyzer/TSBSMetadata.java | 7 +
.../relational/analyzer/TableFunctionTest.java | 4 +-
.../plan/relational/analyzer/TestMatadata.java | 7 +
.../fetcher/cache/TableDeviceSchemaCacheTest.java | 21 +-
.../relational/planner/CorrelatedSubqueryTest.java | 153 +++++
.../plan/relational/planner/PlanTester.java | 9 +-
...ueryTest.java => UncorrelatedSubqueryTest.java} | 104 ++-
...liasPresent.java => AssignUniqueIdMatcher.java} | 24 +-
.../planner/assertions/PlanMatchPattern.java | 6 +
.../relational/sql/parser/AuthorStatementTest.java | 5 -
.../compaction/CompactionWorkerTest.java | 16 +-
.../FastCrossCompactionPerformerTest.java | 5 +-
.../cross/CrossSpaceCompactionSelectorTest.java | 5 +-
.../CompactionTableModelTestFileWriter.java | 14 +
.../compaction/utils/CompactionClearUtils.java | 2 +-
.../compaction/utils/CompactionTaskQueueTest.java | 13 +-
.../dataregion/memtable/TsFileProcessorTest.java | 36 +-
.../read/reader/chunk/MemChunkLoaderTest.java | 26 +-
.../rescon/memory/ResourceManagerTest.java | 6 +-
.../rescon/memory/TimePartitionManagerTest.java | 8 +-
.../apache/iotdb/db/utils/EnvironmentUtils.java | 5 +-
.../datastructure/PrimitiveArrayManagerTest.java | 8 +-
.../conf/iotdb-system.properties.template | 25 +-
.../commons/auth/authorizer/BasicAuthorizer.java | 35 +-
.../iotdb/commons/auth/authorizer/IAuthorizer.java | 10 +-
.../iotdb/commons/auth/entity/PrivilegeType.java | 2 +-
.../org/apache/iotdb/commons/auth/entity/Role.java | 4 +
.../iotdb/commons/auth/user/BasicUserManager.java | 12 +-
.../async/AsyncPipeDataTransferServiceClient.java | 14 +
.../iotdb/commons/concurrent/ThreadName.java | 1 +
.../apache/iotdb/commons/conf/CommonConfig.java | 78 ++-
.../iotdb/commons/conf/CommonDescriptor.java | 48 +-
.../commons/memory/AtomicLongMemoryBlock.java | 152 +++++
.../apache/iotdb/commons/memory/IMemoryBlock.java | 138 ++++
.../MemoryBlockType.java} | 11 +-
.../apache/iotdb/commons/memory/MemoryConfig.java} | 26 +-
.../iotdb/commons/memory/MemoryException.java} | 52 +-
.../apache/iotdb/commons/memory/MemoryManager.java | 523 +++++++++++++++
.../commons/partition/DataPartitionTable.java | 10 +-
.../commons/partition/SeriesPartitionTable.java | 20 +-
.../iotdb/commons/path/ExtendedPartialPath.java | 4 +
.../agent/plugin/builtin/BuiltinPipePlugin.java | 5 +
.../OpcDaConnector.java} | 10 +-
.../commons/pipe/agent/task/PipeTaskAgent.java | 2 +-
.../iotdb/commons/pipe/config/PipeConfig.java | 27 +-
.../config/constant/PipeConnectorConstant.java | 12 +-
.../config/constant/PipeExtractorConstant.java | 12 +
.../connector/protocol/IoTDBAirGapConnector.java | 21 +-
.../queue/ConcurrentIterableLinkedQueue.java | 30 +
.../iotdb/commons/pipe/event/EnrichedEvent.java | 45 +-
.../commons/pipe/event/PipeSnapshotEvent.java | 4 +
.../commons/pipe/event/PipeWritePlanEvent.java | 4 +
.../commons/pipe/event/ProgressReportEvent.java | 25 +-
.../commons/pipe/extractor/IoTDBExtractor.java | 48 +-
.../extractor/IoTDBNonDataRegionExtractor.java | 74 ++-
.../schema/column/ColumnHeaderConstant.java | 7 +-
.../table/AlterOrDropTableOperationType.java | 8 +-
.../commons/schema/table/InformationSchema.java | 6 +
.../apache/iotdb/commons/schema/table/TsTable.java | 3 +-
.../apache/iotdb/commons/service/ServiceType.java | 1 +
.../subscription/config/SubscriptionConfig.java | 21 +
.../commons/subscription/meta/topic/TopicMeta.java | 3 +
.../iotdb/commons/udf/access/RecordIterator.java | 146 +++--
.../relational/TableBuiltinTableFunction.java | 8 -
.../builtin/relational/tvf/HOPTableFunction.java | 7 +-
.../iotdb/commons/memory/MemoryBlockTest.java | 67 ++
.../iotdb/commons/memory/MemoryManagerTest.java | 171 +++++
.../ConcurrentIterableLinkedQueueTest.java | 1 +
.../db/relational/grammar/sql/RelationalSql.g4 | 31 +-
.../thrift-commons/src/main/thrift/common.thrift | 1 +
.../src/main/thrift/confignode.thrift | 1 +
.../src/main/thrift/pipeconsensus.thrift | 5 +-
.../src/main/thrift/datanode.thrift | 1 +
pom.xml | 8 +-
572 files changed, 17885 insertions(+), 6264 deletions(-)
delete mode 100644
example/mqtt-customize/src/main/java/org/apache/iotdb/mqtt/server/MyMessage.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/pipe/it/dual/tablemodel/manual/basic/IoTDBPipePermissionIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/pipe/it/single/IoTDBPipePermissionIT.java
copy
integration-test/src/test/java/org/apache/iotdb/relational/it/query/{old/aligned/IoTDBAlignedSeriesQueryTable5IT.java
=> recent/IoTDBTableAggregationNonStreamIT.java} (61%)
create mode 100644
integration-test/src/test/java/org/apache/iotdb/relational/it/query/recent/subquery/correlated/IoTDBCorrelatedExistsSubqueryIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/relational/it/query/recent/subquery/uncorrelated/IoTDBUncorrelatedExistsSubqueryIT.java
copy
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/consensus/request/write/table/{AbstractTableColumnPlan.java
=> SetTableColumnCommentPlan.java} (71%)
copy
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/consensus/request/write/table/{AbstractTableColumnPlan.java
=> SetTableCommentPlan.java} (70%)
copy
iotdb-core/{datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/scheduler/IFragInstanceDispatcher.java
=>
confignode/src/main/java/org/apache/iotdb/confignode/manager/load/cache/IFailureDetector.java}
(60%)
create mode 100644
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/load/cache/detector/FixedDetector.java
create mode 100644
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/load/cache/detector/PhiAccrualDetector.java
create mode 100644
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/extractor/PipeConfigPhysicalPlanTablePrivilegeParseVisitor.java
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/metric/{
=> overview}/PipeConfigNodeRemainingTimeMetrics.java (99%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/metric/{
=> overview}/PipeConfigNodeRemainingTimeOperator.java (98%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/metric/{
=> overview}/PipeConfigNodeResourceMetrics.java (97%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/metric/{
=> overview}/PipeProcedureMetrics.java (98%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/metric/{
=> overview}/PipeTaskInfoMetrics.java (98%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/metric/{
=> overview}/PipeTemporaryMetaInCoordinatorMetrics.java (99%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/metric/{
=> receiver}/PipeConfigNodeReceiverMetrics.java (98%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/metric/{
=> sink}/PipeConfigRegionConnectorMetrics.java (98%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/metric/{
=> source}/PipeConfigNodeListenerMetrics.java (97%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/metric/{
=> source}/PipeConfigRegionExtractorMetrics.java (98%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/resource/{
=> snapshot}/PipeConfigNodeSnapshotResourceManager.java (94%)
create mode 100644
iotdb-core/confignode/src/test/java/org/apache/iotdb/confignode/manager/load/cache/detector/DetectorTest.java
rename
iotdb-core/consensus/src/main/java/org/apache/iotdb/consensus/pipe/consensuspipe/{ProgressIndexManager.java
=> ReplicateProgressManager.java} (81%)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/conf/DataNodeMemoryConfig.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/opcda/OpcDaConnector.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/opcda/OpcDaHeader.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/opcda/OpcDaServerHandle.java
rename
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/consensus/{ProgressIndexDataNodeManager.java
=> ReplicateProgressDataNodeManager.java} (78%)
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/extractor/schemaregion/{PipePlanTablePatternParseVisitor.java
=> PipePlanTablePrivilegeParseVisitor.java} (59%)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/extractor/schemaregion/PipeStatementToPlanVisitor.java
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/metric/{ =>
overview}/PipeDataNodeRemainingEventAndTimeMetrics.java (99%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/metric/{ =>
overview}/PipeDataNodeRemainingEventAndTimeOperator.java (99%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/metric/{ =>
overview}/PipeHeartbeatEventMetrics.java (98%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/metric/{ =>
overview}/PipeResourceMetrics.java (99%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/metric/{ =>
overview}/PipeWALInsertNodeCacheMetrics.java (99%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/metric/{ =>
processor}/PipeProcessorMetrics.java (99%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/metric/{ =>
receiver}/PipeDataNodeReceiverMetrics.java (99%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/metric/{ =>
schema}/PipeSchemaRegionConnectorMetrics.java (99%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/metric/{ =>
schema}/PipeSchemaRegionExtractorMetrics.java (99%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/metric/{ =>
schema}/PipeSchemaRegionListenerMetrics.java (98%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/metric/{ =>
sink}/PipeDataRegionConnectorMetrics.java (99%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/metric/{ =>
source}/PipeAssignerMetrics.java (99%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/metric/{ =>
source}/PipeDataRegionEventCounter.java (98%)
rename iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/metric/{ =>
source}/PipeDataRegionExtractorMetrics.java (99%)
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/execution/operator/process/{EnforceSingleRowOperator.java
=> AssignUniqueIdOperator.java} (55%)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/execution/operator/process/function/partition/PartitionCache.java
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/execution/operator/process/function/partition/SliceCache.java
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/execution/operator/source/relational/{MergeSortInnerJoinOperator.java
=> MergeSortLeftJoinOperator.java} (80%)
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/analyze/load/LoadTsFileToTableModelAnalyzer.java
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/analyze/load/LoadTsFileToTreeModelAnalyzer.java
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/execution/config/metadata/relational/{AlterTableDropColumnTask.java
=> AlterTableCommentColumnTask.java} (83%)
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/execution/config/metadata/relational/{AlterTableSetPropertiesTask.java
=> AlterTableCommentTableTask.java} (77%)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/planner/iterative/rule/AggregationDecorrelation.java
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/planner/iterative/rule/{PruneFillColumns.java
=> PruneAssignUniqueIdColumns.java} (71%)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/planner/iterative/rule/RemoveRedundantExists.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/planner/iterative/rule/TransformCorrelatedDistinctAggregationWithProjection.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/planner/iterative/rule/TransformCorrelatedDistinctAggregationWithoutProjection.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/planner/iterative/rule/TransformCorrelatedGlobalAggregationWithProjection.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/planner/iterative/rule/TransformCorrelatedGlobalAggregationWithoutProjection.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/planner/iterative/rule/TransformCorrelatedGroupedAggregationWithProjection.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/planner/iterative/rule/TransformCorrelatedGroupedAggregationWithoutProjection.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/planner/iterative/rule/TransformCorrelatedJoinToJoin.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/planner/iterative/rule/TransformExistsApplyToCorrelatedJoin.java
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/planner/node/{EnforceSingleRowNode.java
=> AssignUniqueId.java} (62%)
rename
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/planner/node/{SortBasedGroupNode.java
=> GroupNode.java} (76%)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/planner/optimizations/PlanNodeDecorrelator.java
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/sql/ast/EmptyTableTreatment.java
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/sql/ast/{DropColumn.java
=> SetColumnComment.java} (82%)
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/sql/ast/{CountStatement.java
=> SetTableComment.java} (60%)
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/sql/ast/{LoadConfiguration.java
=> ShowQueriesStatement.java} (69%)
rename
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/service/{RPCServiceMBean.java
=> ExternalRPCServiceMBean.java} (96%)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/service/metrics/memory/OffHeapMemoryMetrics.java
rename
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/utils/datastructure/{MergeSortTvListIterator.java
=> MergeSortTVListIterator.java} (58%)
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/utils/datastructure/PageColumnAccessInfo.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/plan/relational/analyzer/AggregationCornerCaseTest.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/plan/relational/planner/CorrelatedSubqueryTest.java
rename
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/plan/relational/planner/{SubqueryTest.java
=> UncorrelatedSubqueryTest.java} (85%)
copy
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/plan/relational/planner/assertions/{AliasPresent.java
=> AssignUniqueIdMatcher.java} (72%)
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/memory/AtomicLongMemoryBlock.java
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/memory/IMemoryBlock.java
copy
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/{pipe/datastructure/visibility/Visibility.java
=> memory/MemoryBlockType.java} (86%)
copy
iotdb-core/{datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/execution/config/metadata/UnSetTTLTask.java
=>
node-commons/src/main/java/org/apache/iotdb/commons/memory/MemoryConfig.java}
(58%)
copy
iotdb-core/{datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/sql/ast/RemoveConfigNode.java
=>
node-commons/src/main/java/org/apache/iotdb/commons/memory/MemoryException.java}
(50%)
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/memory/MemoryManager.java
copy
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/agent/plugin/builtin/connector/{opcua/OpcUaConnector.java
=> opcda/OpcDaConnector.java} (86%)
create mode 100644
iotdb-core/node-commons/src/test/java/org/apache/iotdb/commons/memory/MemoryBlockTest.java
create mode 100644
iotdb-core/node-commons/src/test/java/org/apache/iotdb/commons/memory/MemoryManagerTest.java
