This is an automated email from the ASF dual-hosted git repository.
sunzesong pushed a change to branch tsfile_v4
in repository https://gitbox.apache.org/repos/asf/iotdb.git
omit 3d4240d693 Fix server tests
omit 6c242366fa Merge remote-tracking branch 'origin/rel/0.13' into
tsfile_v4
omit 7e6718627f Merge master
omit 66d9abe658 Merge remote-tracking branch 'origin/master' into tsfile_v4
omit 0c5f6024c0 Fix readAllChunkMetadata
omit 24dec77874 Remove useless method
omit 878f445a35 Merge remote-tracking branch 'origin/master' into tsfile_v4
omit dd1f364e13 Merge master
omit cbee49a23b Merge remote-tracking branch 'origin/master' into tsfile_v4
omit e41ec31f0b Fix more tests
omit 60da0c3c32 Merge remote-tracking branch 'origin/tsfile_v4' into
tsfile_v4
omit 57438a2d34 Fix more tests
omit c61d67a99f Fix output
omit 0f333dbd65 Merge master
omit 613c583f62 Init commit
add b558beb565 [To rel/0.13][IOTDB-2820]Update Userguide SQL about Trigger
(#5373)
add 67a7cf8e5a [To rel/0.13][IOTDB-2824] fix stop-server.sh that wrongly
kill process (#5381)
add 6ec9bf6aa4 [To rel/0.13] Update python client doc and code for
NumpyTablet (#5389)
add ca5fb172c3 [IOTDB-2671][IOTDB-2672][IOTDB-2777] Modify the name of
dropwizard, update the implementation of IoTDBReporter and fix NPE error.
(#5358)
add 5bcdd4d4f8 [IOTDB-2855] Fix DeletionFileNodeTest error (#5435) (#5439)
add 1c6b6922c6 [To rel/0.13][IOTDB-2826]Unmark storage group among
templates when deleted (#5431)
add a26f9234b7 [IOTDB-2839] Add Python client CI (#5407)
add 5b6485f00b [IoTDB-2837] Add check and sort for NumpyTablet to make
sure timestamps are ordered (#5434)
add 79b03bdc5a Fix sonar-coveralls aways be cancelled (#5283)
add 9b1d0822ef [IOTDB-2859] Fix python tablet with None value is incorrect
(#5441)
add 5ff8133586 [IOTDB-2862] Fix SQL injection risks of grafana-connector
(#5450) (#5452)
add 344605cbbc [To rel/0.13][IOTDB-2864] Fix Read-only occurred when
insert Text values to aligned timeseries (#5461)
add 4445d453b6 [IOTDB-2838] Check and auto correct endian type for
NumpyTablet (#5448) (#5468)
add 72e21c9ffb Cherry pick compaction from master to rel/0.13 (#5480)
add 5a30d37871 [IOTDB-2754] SessionPool auto redirect IoTDB instance
(#5267) (#5313)
add ca6337628b Bump airline from 0.8 to 0.9 (#4110) (#5487)
add e7505cc4bb [To rel/0.13][IOTDB-2903] Fix last value fetch failure
during show timesereis (#5505)
add 2509b9c46a [To rel/0.13][IOTDB-2910] Fix Count aggregate is not right
after delete sg bug (#5526)
add b5ce503348 [IOTDB-2828] Update system_version in system.properties
after upgrading finished (#5385) (#5542)
add c790e62a6f [To rel/0.13][IOTDB-2915]MLogTxtWriter error while parsing
CreateAlignedTimeseriesPlan (#5533)
add ea2285d847 [IOTDB-2861]Fix Cross compaction selector bug (#5539)
add 56e1251a48 [To rel/0.13] [IOTDB-2852] the import-csv tool can not
import the data to nonaligned device (#5421)
add c325cc8235 fix metric related dependency. (#5551)
add d1abcc8772 [IOTDB-2902] Handling user privileges for aligned
timeseries related features (#5556) (#5567)
add 2846818d5e [IOTDB-2924] UDF Framework: index overflow while iterating
sliding windows (#5555) (#5568)
add 4cf34a115a V2
add 42ced63073 Fix TsFileSketchTool
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (3d4240d693)
\
N -- N -- N refs/heads/tsfile_v4 (42ced63073)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/{client.yml => client-cpp.yml} | 2 +-
.../workflows/{client-go.yml => client-python.yml} | 23 +-
.github/workflows/sonar-coveralls.yml | 7 -
.../main/java/org/apache/iotdb/tool/ImportCsv.java | 6 +-
client-cpp/pom.xml | 4 +-
client-py/README.md | 290 +++++++--
client-py/SessionAlignedTimeseriesExample.py | 16 +-
client-py/SessionAlignedTimeseriesTest.py | 280 ---------
client-py/SessionExample.py | 50 +-
client-py/SessionTest.py | 336 -----------
client-py/iotdb/Session.py | 104 +++-
client-py/iotdb/utils/IoTDBConstants.py | 11 +
client-py/iotdb/utils/IoTDBRpcDataSet.py | 2 +-
client-py/iotdb/utils/NumpyTablet.py | 32 +-
client-py/iotdb/utils/Tablet.py | 31 +-
client-py/requirements_dev.txt | 2 +-
client-py/tests/tablet_performance_comparison.py | 8 +-
client-py/tests/test_aligned_timeseries.py | 294 +++++++++
client-py/tests/test_dataframe.py | 6 +-
client-py/tests/test_numpy_tablet.py | 147 +++++
client-py/tests/test_session.py | 362 +++++++++++
client-py/tests/test_tablet.py | 109 ++++
client-py/tests/test_todf.py | 16 +-
.../apache/iotdb/cluster/RemoteTsFileResource.java | 5 +-
compile-tools/pom.xml | 6 +-
.../tests/tools/importCsv/ImportCsvTestIT.java | 31 +
distribution/pom.xml | 2 +-
docs/UserGuide/API/Programming-Java-Native-API.md | 1 +
.../UserGuide/API/Programming-Python-Native-API.md | 52 +-
docs/UserGuide/Maintenance-Tools/Metric-Tool.md | 12 +-
docs/UserGuide/Process-Data/Alerting.md | 2 +-
.../UserGuide/API/Programming-Java-Native-API.md | 3 +-
.../UserGuide/API/Programming-Python-Native-API.md | 49 +-
docs/zh/UserGuide/Maintenance-Tools/Metric-Tool.md | 14 +-
docs/zh/UserGuide/Process-Data/Alerting.md | 2 +-
example/client-cpp-example/pom.xml | 2 +-
.../java/org/apache/iotdb/SessionPoolExample.java | 42 +-
example/trigger/pom.xml | 2 +-
example/tsfile/pom.xml | 32 +
.../java/org/apache/iotdb/tsfile/TsFileRead.java | 111 ++--
.../java/org/apache/iotdb/tsfile/TsFileWrite.java | 128 ++++
.../iotdb/tsfile/TsFileWriteWithTSRecord.java | 99 ---
example/udf/pom.xml | 2 +-
grafana-connector/pom.xml | 2 +-
.../controller/DatabaseConnectController.java | 3 +-
.../iotdb/web/grafana/dao/impl/BasicDaoImpl.java | 43 +-
integration/pom.xml | 13 +-
.../db/integration/IoTDBDeleteStorageGroupIT.java | 23 +
.../iotdb/db/integration/IoTDBMetadataFetchIT.java | 38 ++
...luesIT.java => IoTDBInsertAlignedValuesIT.java} | 21 +-
.../session/IoTDBSessionDisableMemControlIT.java | 0
.../session/IoTDBSessionVectorABDeviceIT.java | 0
.../session/IoTDBSessionVectorAggregationIT.java | 0
.../IoTDBSessionVectorAggregationWithUnSeqIT.java | 0
.../iotdb/session/IoTDBSessionVectorInsertIT.java | 0
.../java/org/apache/iotdb/session/SessionTest.java | 0
.../apache/iotdb/session/pool/SessionPoolTest.java | 0
.../apache/iotdb/session/template/TemplateUT.java | 0
jdbc/pom.xml | 2 +-
metrics/dropwizard-metrics/pom.xml | 3 +-
.../iotdb/metrics/dropwizard/MetricName.java | 60 +-
.../reporter/DropwizardIoTDBReporter.java | 5 +-
.../reporter/DropwizardMetricsExporter.java | 169 ++----
.../metrics/dropwizard/reporter/IoTDBReporter.java | 204 ++++---
.../org.apache.iotdb.metrics.reporter.Reporter | 3 +-
metrics/interface/pom.xml | 5 +
.../main/assembly/resources/conf/iotdb-metric.yml | 14 +-
.../org/apache/iotdb/metrics/MetricService.java | 22 +-
.../apache/iotdb/metrics/config/MetricConfig.java | 133 ++++-
.../iotdb/metrics/reporter/CompositeReporter.java | 14 +-
.../apache/iotdb/metrics/utils/MetricsUtils.java | 33 +-
.../interface/src/test/resources/iotdb-metric.yml | 14 +-
.../micrometer/reporter}/IoTDBMeterRegistry.java | 114 ++--
.../micrometer/reporter}/IoTDBRegistryConfig.java | 23 +-
.../{IoTDBJmxConfig.java => JmxConfig.java} | 6 +-
.../reporter/MicrometerIoTDBReporter.java | 4 +-
.../micrometer/reporter/MicrometerJmxReporter.java | 2 +-
.../org.apache.iotdb.metrics.reporter.Reporter | 3 +-
pom.xml | 25 +-
server/pom.xml | 16 +-
.../resources/conf/iotdb-engine.properties | 6 +
server/src/assembly/resources/sbin/stop-server.sh | 13 +-
.../org/apache/iotdb/db/auth/AuthorityChecker.java | 4 +
.../org/apache/iotdb/db/concurrent/ThreadName.java | 1 +
.../java/org/apache/iotdb/db/conf/IoTDBConfig.java | 14 +
.../org/apache/iotdb/db/conf/IoTDBConfigCheck.java | 3 +-
.../org/apache/iotdb/db/conf/IoTDBDescriptor.java | 7 +
.../engine/compaction/CompactionTaskManager.java | 31 +-
.../db/engine/compaction/CompactionUtils.java | 124 ++--
.../cross/AbstractCrossSpaceCompactionTask.java | 29 +-
.../compaction/cross/CrossCompactionStrategy.java | 21 -
.../selector/RewriteCompactionFileSelector.java | 15 +-
.../task/RewriteCrossCompactionRecoverTask.java | 5 +-
.../task/RewriteCrossSpaceCompactionTask.java | 26 +-
.../cross/rewrite/task/SubCompactionTask.java | 101 ++++
.../inner/AbstractInnerSpaceCompactionTask.java | 21 +-
.../compaction/inner/InnerCompactionStrategy.java | 25 -
.../SizeTieredCompactionRecoverTask.java | 5 +-
.../sizetiered/SizeTieredCompactionSelector.java | 4 +-
.../inner/sizetiered/SizeTieredCompactionTask.java | 51 +-
.../inner/utils/InnerSpaceCompactionUtils.java | 14 +-
.../compaction/task/AbstractCompactionTask.java | 15 +-
.../CompactionExceptionHandler.java} | 124 ++--
...overTask.java => CompactionRecoverManager.java} | 92 +--
.../compaction/task/CompactionRecoverTask.java | 519 +++++++++++++---
.../compaction/utils/log/CompactionLogger.java | 7 +-
.../writer/AbstractCompactionWriter.java | 64 +-
.../writer/CrossSpaceCompactionWriter.java | 80 +--
.../writer/InnerSpaceCompactionWriter.java | 27 +-
.../db/engine/storagegroup/TsFileResource.java | 89 +--
.../engine/storagegroup/TsFileResourceStatus.java | 12 +-
.../storagegroup/VirtualStorageGroupProcessor.java | 109 +---
.../org/apache/iotdb/db/metadata/MManager.java | 5 +
.../db/metadata/lastCache/LastCacheManager.java | 6 +-
.../iotdb/db/metadata/logfile/MLogTxtWriter.java | 11 +-
.../iotdb/db/metadata/template/Template.java | 4 +
.../apache/iotdb/db/qp/executor/PlanExecutor.java | 7 +-
.../layer/MultiInputColumnIntermediateLayer.java | 14 +
...InputColumnMultiReferenceIntermediateLayer.java | 14 +
...nputColumnSingleReferenceIntermediateLayer.java | 14 +
.../java/org/apache/iotdb/db/service/IoTDB.java | 3 +
.../iotdb/db/service/metrics/MetricsService.java | 4 +-
.../apache/iotdb/db/tools/TsFileRewriteTool.java | 3 +-
.../apache/iotdb/db/tools/TsFileSelfCheckTool.java | 19 +-
.../apache/iotdb/db/tools/TsFileSketchTool.java | 36 +-
.../org/apache/iotdb/db/tools/TsFileSplitTool.java | 3 +-
.../db/tools/settle/TsFileAndModSettleTool.java | 9 +-
.../apache/iotdb/db/utils/EnvironmentUtils.java | 2 +
.../org/apache/iotdb/db/utils/FileLoaderUtils.java | 3 +-
.../org/apache/iotdb/db/utils/UpgradeUtils.java | 3 +-
.../db/utils/datastructure/AlignedTVList.java | 12 +-
.../org.apache.iotdb.metrics.reporter.Reporter | 19 -
.../iotdb/db/engine/cache/ChunkCacheTest.java | 5 +-
.../engine/compaction/AbstractCompactionTest.java | 3 +-
.../compaction/CompactionTaskComparatorTest.java | 38 +-
.../compaction/CompactionTaskManagerTest.java | 1 +
.../db/engine/compaction/CompactionUtilsTest.java | 321 +++++++++-
.../cross/CrossSpaceCompactionExceptionTest.java | 31 +-
.../compaction/cross/CrossSpaceCompactionTest.java | 10 +-
.../db/engine/compaction/cross/MergeTest.java | 7 +-
.../cross/RewriteCompactionFileSelectorTest.java | 71 ++-
.../RewriteCrossSpaceCompactionRecoverTest.java | 74 +--
.../cross/RewriteCrossSpaceCompactionTest.java | 2 +
.../inner/AbstractInnerSpaceCompactionTest.java | 5 +-
.../inner/InnerCompactionMoreDataTest.java | 7 +-
.../inner/InnerCompactionSchedulerTest.java | 4 +-
.../compaction/inner/InnerCompactionTest.java | 11 +-
.../inner/InnerSpaceCompactionExceptionTest.java | 64 +-
.../SizeTieredCompactionRecoverTest.java | 121 +---
.../inner/sizetiered/SizeTieredCompactionTest.java | 11 +-
...eCrossSpaceCompactionRecoverCompatibleTest.java | 19 +-
.../SizeTieredCompactionRecoverCompatibleTest.java | 59 +-
.../recover/SizeTieredCompactionRecoverTest.java | 117 +---
.../engine/modification/DeletionFileNodeTest.java | 6 +-
.../engine/storagegroup/FakedTsFileResource.java | 20 +-
.../org/apache/iotdb/db/metadata/TemplateTest.java | 18 +
.../query/reader/series/SeriesReaderTestUtil.java | 7 +-
.../iotdb/db/rescon/ResourceManagerTest.java | 15 +-
.../iotdb/db/tools/TsFileSelfCheckToolTest.java | 15 +-
session/pom.xml | 13 -
.../java/org/apache/iotdb/session/Session.java | 67 ++-
.../org/apache/iotdb/session/pool/SessionPool.java | 178 +++++-
testcontainer/src/tool/parser.py | 4 +-
.../iotdb/tsfile/common/conf/TSFileConfig.java | 11 -
.../MetadataIndexConstructor.java | 3 +-
.../{metadataIndex => }/MetadataIndexEntry.java | 2 +-
.../{metadataIndex => }/MetadataIndexNode.java | 10 +-
.../iotdb/tsfile/file/metadata/TsFileMetadata.java | 15 +-
.../metadataIndex/BPlusTreeConstructor.java | 134 -----
.../file/metadata/metadataIndex/BPlusTreeNode.java | 148 -----
.../metadata/metadataIndex/MetadataIndexType.java | 25 -
.../iotdb/tsfile/read/TsFileDeviceIterator.java | 8 +-
.../iotdb/tsfile/read/TsFileSequenceReader.java | 662 +++++++--------------
.../org/apache/iotdb/tsfile/read/common/Path.java | 7 +-
.../tsfile/read/controller/IMetadataQuerier.java | 2 +-
.../read/controller/MetadataQuerierByFileImpl.java | 65 +-
.../tsfile/read/query/executor/TsFileExecutor.java | 2 +-
.../v2/file/metadata/MetadataIndexEntryV2.java | 2 +-
.../v2/file/metadata/MetadataIndexNodeV2.java | 4 +-
.../tsfile/v2/read/TsFileSequenceReaderForV2.java | 17 +-
.../write/writer/ForceAppendTsFileWriter.java | 24 +-
.../write/writer/RestorableTsFileIOWriter.java | 52 +-
.../iotdb/tsfile/write/writer/TsFileIOWriter.java | 90 +--
.../{metadataIndex => }/MetadataIndexNodeTest.java | 2 +-
.../tsfile/file/metadata/utils/TestHelper.java | 4 +-
.../iotdb/tsfile/file/metadata/utils/Utils.java | 2 +-
...easurementChunkMetadataListMapIteratorTest.java | 8 +-
.../apache/iotdb/tsfile/read/TsFileReaderTest.java | 2 -
.../tsfile/read/TsFileRestorableReaderTest.java | 2 +-
.../tsfile/read/TsFileSequenceReaderTest.java | 40 +-
.../apache/iotdb/tsfile/utils/FileGenerator.java | 113 +---
.../write/BPlusTreeIndexConstructorTest.java | 311 ----------
.../tsfile/write/MetadataIndexConstructorTest.java | 141 ++++-
.../write/writer/ForceAppendTsFileWriterTest.java | 2 +-
.../write/writer/RestorableTsFileIOWriterTest.java | 31 +-
.../tsfile/write/writer/ValueChunkWriterTest.java | 5 +-
196 files changed, 4951 insertions(+), 3920 deletions(-)
rename .github/workflows/{client.yml => client-cpp.yml} (98%)
copy .github/workflows/{client-go.yml => client-python.yml} (65%)
delete mode 100644 client-py/SessionAlignedTimeseriesTest.py
delete mode 100644 client-py/SessionTest.py
create mode 100644 client-py/tests/test_aligned_timeseries.py
create mode 100644 client-py/tests/test_numpy_tablet.py
create mode 100644 client-py/tests/test_session.py
create mode 100644 client-py/tests/test_tablet.py
create mode 100644
example/tsfile/src/main/java/org/apache/iotdb/tsfile/TsFileWrite.java
delete mode 100644
example/tsfile/src/main/java/org/apache/iotdb/tsfile/TsFileWriteWithTSRecord.java
rename
integration/src/test/java/org/apache/iotdb/db/integration/aligned/{IOTDBInsertAlignedValuesIT.java
=> IoTDBInsertAlignedValuesIT.java} (92%)
rename {session =>
integration}/src/test/java/org/apache/iotdb/session/IoTDBSessionDisableMemControlIT.java
(100%)
rename {session =>
integration}/src/test/java/org/apache/iotdb/session/IoTDBSessionVectorABDeviceIT.java
(100%)
rename {session =>
integration}/src/test/java/org/apache/iotdb/session/IoTDBSessionVectorAggregationIT.java
(100%)
rename {session =>
integration}/src/test/java/org/apache/iotdb/session/IoTDBSessionVectorAggregationWithUnSeqIT.java
(100%)
rename {session =>
integration}/src/test/java/org/apache/iotdb/session/IoTDBSessionVectorInsertIT.java
(100%)
rename {session =>
integration}/src/test/java/org/apache/iotdb/session/SessionTest.java (100%)
rename {session =>
integration}/src/test/java/org/apache/iotdb/session/pool/SessionPoolTest.java
(100%)
rename {session =>
integration}/src/test/java/org/apache/iotdb/session/template/TemplateUT.java
(100%)
rename {server/src/main/java/org/apache/iotdb/db =>
metrics/dropwizard-metrics/src/main/java/org/apache/iotdb}/metrics/dropwizard/reporter/DropwizardIoTDBReporter.java
(92%)
rename {server/src/main/java/org/apache/iotdb/db =>
metrics/dropwizard-metrics/src/main/java/org/apache/iotdb}/metrics/dropwizard/reporter/IoTDBReporter.java
(53%)
rename server/src/main/java/org/apache/iotdb/db/metrics/metricsUtils.java =>
metrics/interface/src/main/java/org/apache/iotdb/metrics/utils/MetricsUtils.java
(69%)
rename {server/src/main/java/org/apache/iotdb/db/metrics/micrometer/registry
=>
metrics/micrometer-metrics/src/main/java/org/apache/iotdb/metrics/micrometer/reporter}/IoTDBMeterRegistry.java
(60%)
rename {server/src/main/java/org/apache/iotdb/db/metrics/micrometer/registry
=>
metrics/micrometer-metrics/src/main/java/org/apache/iotdb/metrics/micrometer/reporter}/IoTDBRegistryConfig.java
(63%)
rename
metrics/micrometer-metrics/src/main/java/org/apache/iotdb/metrics/micrometer/reporter/{IoTDBJmxConfig.java
=> JmxConfig.java} (88%)
rename {server/src/main/java/org/apache/iotdb/db =>
metrics/micrometer-metrics/src/main/java/org/apache/iotdb}/metrics/micrometer/reporter/MicrometerIoTDBReporter.java
(93%)
create mode 100644
server/src/main/java/org/apache/iotdb/db/engine/compaction/cross/rewrite/task/SubCompactionTask.java
rename
server/src/main/java/org/apache/iotdb/db/engine/compaction/{cross/CrossSpaceCompactionExceptionHandler.java
=> task/CompactionExceptionHandler.java} (62%)
copy
server/src/main/java/org/apache/iotdb/db/engine/compaction/task/{CompactionRecoverTask.java
=> CompactionRecoverManager.java} (52%)
copy
cluster/src/main/java/org/apache/iotdb/cluster/server/member/DataGroupMemberMBean.java
=>
server/src/main/java/org/apache/iotdb/db/engine/storagegroup/TsFileResourceStatus.java
(84%)
delete mode 100644
server/src/main/resources/META-INF/services/org.apache.iotdb.metrics.reporter.Reporter
rename
tsfile/src/main/java/org/apache/iotdb/tsfile/file/metadata/{metadataIndex =>
}/MetadataIndexConstructor.java (98%)
rename
tsfile/src/main/java/org/apache/iotdb/tsfile/file/metadata/{metadataIndex =>
}/MetadataIndexEntry.java (96%)
rename
tsfile/src/main/java/org/apache/iotdb/tsfile/file/metadata/{metadataIndex =>
}/MetadataIndexNode.java (95%)
delete mode 100644
tsfile/src/main/java/org/apache/iotdb/tsfile/file/metadata/metadataIndex/BPlusTreeConstructor.java
delete mode 100644
tsfile/src/main/java/org/apache/iotdb/tsfile/file/metadata/metadataIndex/BPlusTreeNode.java
delete mode 100644
tsfile/src/main/java/org/apache/iotdb/tsfile/file/metadata/metadataIndex/MetadataIndexType.java
rename
tsfile/src/test/java/org/apache/iotdb/tsfile/file/metadata/{metadataIndex =>
}/MetadataIndexNodeTest.java (97%)
delete mode 100644
tsfile/src/test/java/org/apache/iotdb/tsfile/write/BPlusTreeIndexConstructorTest.java
