This is an automated email from the ASF dual-hosted git repository.
chrisdutz pushed a change to branch fix/query-terminate-on-dispatch-failure
in repository https://gitbox.apache.org/repos/asf/iotdb.git
omit ba964d8dcd3 [Query] Cancel dispatched fragment instances right away
when the dispatch fails
add 1b2158fec35 Fix active LOAD worker retirement leaving files pending
(#19076)
add 76d573a4e3d Fix deletion recovery and table last-cache correctness
(#19081)
add 88f85321744 Allow heartbeat retries while a realtime TsFile is in
flight (#19075)
add 64667478a0d [IT] Force English locale for integration test JVMs
(#19068)
add cebe6639993 Fix hybrid pipe queue memory admission across data regions
(#19080)
add 24fd30e1ac6 Stabilize query execution concurrency unit tests (#19079)
add e6b44b57e49 Fix table DELETE filters with mixed-case columns (#19087)
add b8765eda64f Fix ConfigNode procedure snapshot loading with MD5 files
(#19101)
add dda1e45d513 Fix LOAD snapshot races and stabilize cluster sync tests
(#19031)
add ca8074d15c8 Stabilize IT observation periods and restart cache checks
(#19095)
add c515756e93b [Pipe] Improve fair TsFile parser admission (#19106)
add e09005e87d0 Preserve JDBC session diagnostics across locales (#19102)
add 814b77028ad Fix historical TsFile filtering and reference acquisition
(#19096)
add 2fd7d838cba [IT] Read the address column of lsof when checking port
occupation (#19070)
add 65ef92f60a0 Fix Prepared Table-Model INSERT VALUES Execution (#19078)
add 3ffe2958758 Fix automatic LOAD retries during region recovery (#19098)
add ee347f403d7 Ensure Session.close() closes all connections after
failures (#19104)
add 150a14c38cb [IT] Make integrationTest.dataRegionPerDataNode reach the
ConfigNode (#19121)
add dfce814dad6 Fix pipe task start failures: report, roll back and
recover (#19119)
add 1c709913143 [IT] Wait for asynchronous DROP TABLE before flushing in
table deletion IT (#19123)
add 9f0bc18d700 Retry peer-list reset during AddRegionPeer rollback
(#19118)
add 03a28bace35 [Pipe] Make two pipe fields thread-safe for SonarCloud's
reliability gate (#19109)
add 4a801718276 Fixed the insertion NPE bug with out of ttl and pipe
(#19124)
add b896b6f5186 [Doc] Avoid global database counts in integration tests
(#19127)
add ef9e799f50a [Bugfix] Disable Subscription and Pipes containing data
insertion under Ratis (#19053)
add 2bfb3a5fe10 [IT] Wait for all Regions to be Running after a cluster
restart (#19114)
add 888f169f652 Fix concurrent subscription batch snapshots (#19116)
add e92ecf1d5d6 Fix table TTL reset propagation to DataNodes (#19110)
add a2d83f7abe0 Reduce WAL directory scans during subscription replay
refresh (#19129)
add 4b80fa56a99 Fix subscription prefetch retries under delivery
backpressure (#19137)
add 6a3e9d214a7 Fall back to a current replica when the cached region
leader is stale (#19135)
add c4086c5df64 Fix LOAD rate limiting to account for source TsFile bytes
(#19141)
add ad94d2b68cd Fix WAL roll file test flush wait (#17904)
add dbc4fb74f23 Fix cached nullable table attribute filtering (#19133)
add 51748ae1fde Fix subscription connection fencing during consumer
reconnect (#19130)
add 24e1203a4dc Fix table schema map registration for table-model TsFiles
(#19100)
add 219d2ea3bc7 [IT] Pin the DataRegions per DataNode in
IoTDBMultiTAGsWithAttributesTableIT (#19086)
add 3413b8a9867 [Query] Cancel dispatched fragment instances right away
when the dispatch fails
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (ba964d8dcd3)
\
N -- N -- N refs/heads/fix/query-terminate-on-dispatch-failure
(3413b8a9867)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
integration-test/AGENTS.md | 5 +
integration-test/pom.xml | 12 +-
.../org/apache/iotdb/it/env/cluster/EnvUtils.java | 5 +-
.../iotdb/it/env/cluster/config/MppJVMConfig.java | 15 +
.../it/env/cluster/node/AbstractNodeWrapper.java | 1 +
.../it/env/cluster/node/ConfigNodeWrapper.java | 8 +
.../iotdb/db/it/IoTDBLoadTsFileActiveScanIT.java | 275 ++++++++++
.../iotdb/db/it/IoTDBLoadTsFileClusterIT.java | 113 +++-
.../org/apache/iotdb/db/it/IoTDBRestartIT.java | 124 ++++-
.../iotdb/db/it/utils/DeletionTestUtils.java | 119 ++++
.../apache/iotdb/db/it/utils/IoTDBTestUtilsIT.java | 47 ++
.../org/apache/iotdb/db/it/utils/TestUtils.java | 244 +++++----
.../manual/enhanced/IoTDBPipeMetaIT.java | 9 +-
.../relational/it/db/it/IoTDBDeletionTableIT.java | 567 ++++++++++++++++++-
.../relational/it/db/it/IoTDBInsertTableIT.java | 24 +-
.../it/IoTDBLoadStorageTsFileWithCompactionIT.java | 269 +++++++++
.../it/db/it/IoTDBLoadTableSchemaCompletionIT.java | 265 +++++++++
.../db/it/IoTDBMultiTAGsWithAttributesTableIT.java | 6 +
.../db/it/IoTDBRegionReadyAfterRestartTableIT.java | 94 ++++
.../relational/it/db/it/IoTDBRestartTableIT.java | 153 ++++--
.../it/db/it/IoTDBSetSystemStatusTableIT.java | 35 ++
.../it/schema/IoTDBNullableAttributeCacheIT.java | 261 +++++++++
.../iotdb/relational/it/schema/IoTDBTableIT.java | 89 +++
.../it/schema/IoTDBTableTagSchemaMigrationIT.java | 386 +++++++++++++
.../schema/TableMetadataPropagationTestBase.java | 450 ++++++++++++++++
.../it/schema/fault/MetadataFaultAgent.java | 600 +++++++++++++++++++++
.../it/schema/fault/MetadataFaultController.java | 244 +++++++++
.../iotdb/session/it/IoTDBSessionSimpleIT.java | 23 +-
.../org/apache/iotdb/jdbc/IoTDBConnection.java | 53 +-
.../org/apache/iotdb/jdbc/IoTDBConnectionTest.java | 150 ++++++
.../java/org/apache/iotdb/rpc/TSStatusCode.java | 1 +
.../java/org/apache/iotdb/session/Session.java | 47 +-
.../java/org/apache/iotdb/session/SessionTest.java | 75 +++
.../base/AbstractSubscriptionConsumer.java | 18 +-
.../base/AbstractSubscriptionProvider.java | 10 +-
.../base/AbstractSubscriptionProviders.java | 2 +-
.../SubscriptionConsumerMultiProviderPollTest.java | 73 +++
.../SubscriptionProviderConnectionTimeoutTest.java | 25 +-
.../base/SubscriptionProviderStatusTest.java | 12 +
.../iotdb/confignode/manager/ConfigManager.java | 36 +-
.../manager/pipe/agent/PipeConfigNodeAgent.java | 34 ++
.../pipe/agent/task/PipeConfigNodeTaskAgent.java | 5 +
.../pipe/coordinator/task/PipeTaskCoordinator.java | 46 +-
.../manager/schema/ClusterSchemaManager.java | 30 +-
.../subscription/SubscriptionCoordinator.java | 7 +-
.../runtime/SubscriptionLeaderChangeHandler.java | 9 +-
.../confignode/persistence/ProcedureInfo.java | 4 +-
.../confignode/persistence/pipe/PipeTaskInfo.java | 27 +-
.../impl/region/AddRegionPeerProcedure.java | 17 +
.../impl/schema/DataNodeRegionGroupUtil.java | 7 +-
.../schema/table/SetTablePropertiesProcedure.java | 16 +-
.../manager/ClusterSchemaManagerTest.java | 179 ++++++
.../agent/task/PipeConfigNodeTaskAgentTest.java | 111 ++++
.../coordinator/task/PipeTaskCoordinatorTest.java | 157 ++++++
.../confignode/persistence/ProcedureInfoTest.java | 38 ++
.../persistence/pipe/PipeTaskInfoRatisTest.java | 149 +++++
.../impl/region/AddRegionPeerProcedureTest.java | 122 +++++
.../impl/schema/DataNodeRegionGroupUtilTest.java | 54 ++
.../table/SetTablePropertiesProcedureTest.java | 78 +++
.../apache/iotdb/db/i18n/DataNodePipeMessages.java | 5 +
.../iotdb/db/i18n/DataNodeQueryMessages.java | 6 +
.../apache/iotdb/db/i18n/DataNodePipeMessages.java | 5 +
.../iotdb/db/i18n/DataNodeQueryMessages.java | 6 +
.../iotdb/db/pipe/agent/PipeDataNodeAgent.java | 34 ++
.../db/pipe/agent/task/PipeDataNodeTaskAgent.java | 25 +-
.../task/execution/PipeSubtaskExecutorManager.java | 31 +-
.../subtask/processor/PipeProcessorSubtask.java | 6 +
.../processor/PipeProcessorSubtaskWorker.java | 6 +-
.../common/tsfile/PipeTsFileInsertionEvent.java | 27 +-
.../pipe/metric/overview/PipeResourceMetrics.java | 48 +-
.../legacy/IoTDBLegacyPipeReceiverAgent.java | 14 +
.../protocol/thrift/IoTDBDataNodeReceiver.java | 48 ++
.../db/pipe/resource/memory/PipeMemoryManager.java | 190 +++++--
.../builder/PipeTableModelTsFileBuilderV2.java | 4 +
...istoricalDataRegionTsFileAndDeletionSource.java | 34 +-
.../PipeRealtimeDataRegionTsFileSource.java | 31 +-
.../realtime/epoch/TsFileEpochManager.java | 5 +-
.../protocol/thrift/impl/ClientRPCServiceImpl.java | 13 +-
.../impl/DataNodeInternalRPCServiceImpl.java | 25 +-
.../execution/fragment/DataNodeQueryContext.java | 2 +-
.../relational/LastQueryAggTableScanOperator.java | 78 ++-
.../iotdb/db/queryengine/plan/Coordinator.java | 10 +-
.../db/queryengine/plan/analyze/AnalyzeUtils.java | 14 +-
.../plan/analyze/load/LoadTsFileAnalyzer.java | 31 +-
.../analyze/load/LoadTsFileTableSchemaCache.java | 60 ++-
.../load/TreeSchemaAutoCreatorAndVerifier.java | 19 +
.../config/executor/ClusterConfigTaskExecutor.java | 30 ++
.../planner/DataNodeTableOperatorGenerator.java | 29 +-
.../fetcher/DeviceInCacheFilterVisitor.java | 8 +-
.../metadata/fetcher/TableDeviceSchemaFetcher.java | 2 +-
.../fetcher/cache/TableDeviceCacheEntry.java | 8 +
.../fetcher/cache/TableDeviceLastCache.java | 20 +-
.../fetcher/cache/TableDeviceSchemaCache.java | 14 +
.../plan/relational/sql/ast/InsertRows.java | 45 ++
.../plan/statement/crud/InsertBaseStatement.java | 22 +-
.../plan/statement/crud/InsertRowsStatement.java | 6 +-
.../java/org/apache/iotdb/db/service/DataNode.java | 6 +-
.../db/storageengine/dataregion/DataRegion.java | 5 +-
.../impl/ReadChunkCompactionPerformer.java | 4 +
.../compaction/io/CompactionTsFileWriter.java | 11 +
.../dataregion/memtable/TsFileProcessor.java | 17 +
.../utils/TsFileTableSchemaRegistrationUtils.java | 110 ++++
.../wal/recover/file/TsFilePlanRedoer.java | 60 ++-
.../file/UnsealedTsFileRecoverPerformer.java | 25 +-
.../db/storageengine/load/LoadTsFileProgress.java | 73 +--
.../db/storageengine/load/LoadTsFileSnapshot.java | 59 +-
.../load/active/ActiveLoadTsFileLoader.java | 74 ++-
.../agent/SubscriptionReceiverAgent.java | 42 +-
.../agent/SubscriptionRuntimeAgent.java | 4 +-
.../consensus/ConsensusPrefetchingQueue.java | 7 +-
.../ConsensusSubscriptionSetupHandler.java | 7 +-
.../broker/consensus/ProgressWALIterator.java | 98 +++-
.../event/batch/SubscriptionPipeEventBatches.java | 8 +-
.../receiver/SubscriptionReceiver.java | 5 +
.../receiver/SubscriptionReceiverV1.java | 38 +-
...nsensusSubscriptionPrefetchExecutorManager.java | 8 +-
.../dataregion/IoTConsensusShutdownTest.java | 10 +-
.../task/PipeDataNodeTaskAgentMemoryTest.java | 186 +++++++
.../pipe/agent/task/PipeDataNodeTaskAgentTest.java | 135 +++++
.../agent/task/PipeSinkSubtaskExecutorTest.java | 182 +++++++
.../pipe/agent/task/PipeSubtaskExecutorTest.java | 24 +
.../execution/PipeSubtaskExecutorManagerTest.java | 66 +++
.../PipeProcessorSubtaskExecutionGuardTest.java | 249 ++++++++-
.../processor/PipeProcessorSubtaskWorkerTest.java | 181 +++++++
.../pipe/event/PipeTsFileInsertionEventTest.java | 32 ++
.../metric/overview/PipeResourceMetricsTest.java | 81 +++
.../legacy/IoTDBLegacyPipeReceiverAgentTest.java | 72 +++
.../protocol/thrift/IoTDBDataNodeReceiverTest.java | 202 +++++++
.../resource/memory/PipeMemoryManagerTest.java | 415 +++++++++++++-
.../db/pipe/source/PipeRealtimeExtractTest.java | 54 ++
...ricalDataRegionTsFileAndDeletionSourceTest.java | 268 +++++++++
.../realtime/epoch/TsFileEpochManagerTest.java | 11 -
.../execution/exchange/SharedTsBlockQueueTest.java | 165 ++----
.../fragment/FragmentInstanceExecutionTest.java | 5 +-
.../source/SeriesScanUtilCancellationTest.java | 56 +-
.../schedule/queue/L1PriorityQueueTest.java | 45 +-
.../schedule/queue/L2PriorityQueueTest.java | 44 +-
.../queue/MultilevelPriorityQueueTest.java | 43 +-
.../load/LoadTsFileAnalyzerDiagnosticsTest.java | 126 ++++-
.../plan/analyze/load/LoadTsFileAnalyzerTest.java | 49 ++
.../fetcher/cache/TableDeviceLastCacheTest.java | 33 ++
.../relational/sql/AstMemoryEstimatorTest.java | 168 ++++++
.../storageengine/dataregion/DataRegionTest.java | 55 ++
.../TsFileTableSchemaRegistrationUtilsTest.java | 204 +++++++
.../wal/node/WALNodeWaitForRollFileTest.java | 101 ++--
.../wal/recover/WALRecoverManagerTest.java | 6 +-
...ncryptedUnsealedTsFileRecoverPerformerTest.java | 10 +-
.../wal/recover/file/TsFilePlanRedoerTest.java | 124 +++++
.../file/UnsealedTsFileRecoverPerformerTest.java | 13 +-
.../storageengine/load/LoadTsFileProgressTest.java | 149 +++++
.../storageengine/load/LoadTsFileSnapshotTest.java | 420 +++++++++++++--
.../load/active/ActiveLoadTsFileLoaderTest.java | 157 ++++++
.../agent/SubscriptionReceiverAgentTest.java | 54 ++
...nsensusPrefetchingQueueWalBackpressureTest.java | 195 +++++++
.../broker/consensus/ProgressWALIteratorTest.java | 325 ++++++++++-
...ubscriptionPipeEventBatchesConcurrencyTest.java | 144 +++++
.../receiver/SubscriptionReceiverV1Test.java | 23 +
.../apache/iotdb/commons/i18n/PipeMessages.java | 21 +
.../apache/iotdb/commons/i18n/PipeMessages.java | 20 +
.../commons/pipe/agent/task/PipeTaskAgent.java | 47 +-
.../agent/task/execution/PipeSubtaskExecutor.java | 29 +-
.../task/subtask/PipeAbstractSinkSubtask.java | 33 +-
.../options/PipeInclusionOptions.java | 11 +
.../iotdb/commons/service/metric/enums/Metric.java | 1 +
.../options/PipeInclusionOptionsTest.java | 41 ++
165 files changed, 11869 insertions(+), 873 deletions(-)
create mode 100644
integration-test/src/test/java/org/apache/iotdb/db/it/IoTDBLoadTsFileActiveScanIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/db/it/utils/DeletionTestUtils.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/relational/it/db/it/IoTDBLoadStorageTsFileWithCompactionIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/relational/it/db/it/IoTDBLoadTableSchemaCompletionIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/relational/it/db/it/IoTDBRegionReadyAfterRestartTableIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/relational/it/schema/IoTDBNullableAttributeCacheIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/relational/it/schema/IoTDBTableTagSchemaMigrationIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/relational/it/schema/TableMetadataPropagationTestBase.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/relational/it/schema/fault/MetadataFaultAgent.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/relational/it/schema/fault/MetadataFaultController.java
create mode 100644
iotdb-core/confignode/src/test/java/org/apache/iotdb/confignode/manager/pipe/agent/task/PipeConfigNodeTaskAgentTest.java
create mode 100644
iotdb-core/confignode/src/test/java/org/apache/iotdb/confignode/manager/pipe/coordinator/task/PipeTaskCoordinatorTest.java
create mode 100644
iotdb-core/confignode/src/test/java/org/apache/iotdb/confignode/persistence/pipe/PipeTaskInfoRatisTest.java
create mode 100644
iotdb-core/confignode/src/test/java/org/apache/iotdb/confignode/procedure/impl/schema/DataNodeRegionGroupUtilTest.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/dataregion/utils/TsFileTableSchemaRegistrationUtils.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/pipe/agent/task/PipeDataNodeTaskAgentMemoryTest.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/pipe/agent/task/execution/PipeSubtaskExecutorManagerTest.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/pipe/metric/overview/PipeResourceMetricsTest.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/storageengine/dataregion/utils/TsFileTableSchemaRegistrationUtilsTest.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/subscription/event/batch/SubscriptionPipeEventBatchesConcurrencyTest.java