This is an automated email from the ASF dual-hosted git repository.
tanxinyu pushed a change to branch master_performance
in repository https://gitbox.apache.org/repos/asf/iotdb.git.
discard d361696 add node
discard f63dc2d fix slot num
discard cef2f82 disable influxdb_protocol
discard 997ec44 try support balance multi raft
discard c7d79bd fix report
discard 641bba8 add group report
discard 744f0bc balance
discard 89fff32 add send log timer
discard 71725b5 open more timer
discard 6873754 add split log timer
discard 6807304 add info logs (#4464)
discard 0a8bf44 increase timeout
discard 0698bb9 add report log
add 6e5e209 Fix dead lock in setDataTTL method (#4738)
add aa108f3 [IOTDB-2267] UDF: Error code 500 caused by user logic (#4744)
add c295263 [IOTDB-2273] Trigger doc: quotation marks are required on the
id (#4746)
add 2a9af0b [IOTDB-2322] Provide a new interface to get
AlignedChunkMetadata of device (#4742)
add e3b385b [IOTDB-1297] Refactor the memory control when enabling time
partitions (#4743)
add 8a51c42 [IOTDB-2295][IOTDB-2299] Fix Timeseries count group by level
Bug & Fix Wrong SQL instance (#4727)
add acdcf9f [IOTDB-2256][IOTDB-2318] Fix permission check bug while query
with non timeseries & Fix doc (#4734)
add 618a913 [IOTDB-2284] Trigger: Multiple triggers can be registered on
the same timeseries (#4745)
add 50a3bc7 [IOTDB-2334] Unreasonable debug log level of python client
Session (#4751)
add ed93a7d [IOTDB-2222] bugs of Spark Connector (#4679)
add f42ff83 [IOTDB-2333] Python client: the todf method throws exception
(#4754)
add fb77b02 Fix JenkinsCI (#4758)
add 45050cb [IOTDB-2274] TriggerExample: deadlock between trigger
recovery and MQTT service starting (#4748)
add 18e0ae4 [IOTDB-2317] Deadlock between set ttl and create new
TsFileProcessor (#4750)
add 6203966 [IOTDB-2262][Aligned timeseries] support in select ... into
... clauses (#4757)
add fc2889e [IOTDB-1801] Python APIs for aligned timeseries (#4747)
add d7360bc Fix JenkinsCI deploying error (#4761)
add 9baeae3 [IOTDB-2277] CQ: No warn message when aggregate function and
timeseries types do not match (#4766)
add e6781b0 [IOTDB-1803] Support insert Tablet with null value in c++
client (#4755)
add 2d1e5d3 use default timeout of server (#4737)
add aa511e0 [IOTDB-2264] load tsfile with aligned timeseries failed
(#4719)
add ce16e30 [IOTDB-2312] The SQL statement in the user manual does not
match the legend (#4740)
add f1c167d [IOTDB-2335] Add isAligned column in ResultSet of SHOW
DEVICES statement (#4759)
add 2173678 [IOTDB-2317] Avoid checking TTL when setting TTL (#4765)
add 04622bb [IOTDB-2346] Select INTO Reports NPE for time series
containing binary values of NULL (#4767)
add a2dba1b [IOTDB-2347] Fix aligned timeseries auto create bug (#4770)
add 50f171b [IOTDB-2288] Modify serializing an empty page (#4723)
add 058a07c [IOTDB-2275] Don't compile grafana plugin when execute mvn
clean package -pl distribution -am -DskipTests (#4779)
add c528332 [IOTDB-2142][IOTDB-2281][IOTDB-2286][IOTDB-2258] fix csv bugs
and add a parm to use aligned interface (#4762)
add 16bfac1 [IOTDB-2257] Add consistency checks for measurement lists
size and value lists size in the SELECT statement (#4739)
add 262c5c6 [IOTDB-2349] An exception should be thrown when aggregate
function and data type do not match (#4780)
add e8810dd [IOTDB-2235]Optimize the constructor of
InsertRowsOfOneDevicePlan (#4781)
add ebdf88f [IOTDB-2278][IOTDB-2319] CQ doesn't work in master branch
(#4788)
add 73f80c6 [IOTDB-2332] Clause 'without null' is not supported in nested
expressions (#4789)
add cbc5d2e [IOTDB-2352] Update Session docs for 0.13 (#4777)
add a4f5b0e [IOTDB-2280] Cache configuration order adjustment in
iotdb-rest.properties (#4716)
add e65f4c6 [IOTDB-2298] Refactor SQL of schema template (#4775)
add 899f1c8 [IOTDB-2365] Reduce the iteration times when constrcuting
page data (#4787)
add 37bb7e2 [IOTDB-2205] Optimize unaligned int/long read/write functions
in BytesUtils (#4676)
add 2c1f895 update doc (#4795)
add 47f4923 [IOTDB-2187] Update code of pulsar example with session API
(#4793)
add a198683 [IOTDB-2111] ServiceProvider: Support MQTT / REST protocols
in cluster mode (#4580)
add 5466c5f [IOTDB-2354] row number is not as expected when using nested
expressions in GROUP BY(#4790)
add 3d4bd3d [IOTDB-2356] TTL doesn't work (#4794)
add bcdab51 [IOTDB-2325] Fix config manual which is different with system
config (#4785)
add 6445241 [IOTDB-2366] Change Executors.newXxx to
IoTDBThreadPoolFactory.newXxx (#4791)
add 21acded [IOTDB-1360] Support aligned timeseries in in-space
compaction (#4729)
add e7f50b6 [IOTDB-2381] Fix deadlock caused by incorrect buffer pool
size counter (#4797)
add 39d19de [IOTDB-2350] Select into datatype cast error when writing
back during the nested query (#4801)
add 84a3b01 Add Jprofiler link in Contribute guide (#4806)
add 48e21f2 [IOTDB-2387] Suggest disabling time partition function by
default (#4799)
add 7fea9c8 [IOTDB-2385] Fix write degrade after limit chunk size in
inner space compaction (#4798)
add ab24ce0 [IOTDB-2337] Trigger: Perhaps trigger privileges are better
based on paths (#4802)
add 84a1df3 [IOTDB-2342] Add compatible interface with 0.12.x for
creating template of flat measurements (#4720)
new add63cd add report log
new 390ecec increase timeout
new c13635c add info logs (#4464)
new a2899cd add split log timer
new f38b576 open more timer
new 1d2431b add send log timer
new e4149e3 balance
new 8bab5fa add group report
new 9d712cf fix report
new f3c2d35 try support balance multi raft
new fd0edf5 disable influxdb_protocol
new 5633075 fix slot num
new c0cb765 add node
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (d361696)
\
N -- N -- N refs/heads/master_performance (c0cb765)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 13 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../org/apache/iotdb/db/qp/sql/IoTDBSqlParser.g4 | 20 +-
.../main/java/org/apache/iotdb/tool/ExportCsv.java | 2 +-
.../main/java/org/apache/iotdb/tool/ImportCsv.java | 110 +++-
client-cpp/src/main/Session.cpp | 313 ++++++-----
client-cpp/src/main/Session.h | 198 +++++--
...ample.py => SessionAlignedTimeseriesExample.py} | 94 ++--
...sionTest.py => SessionAlignedTimeseriesTest.py} | 90 +--
client-py/iotdb/Session.py | 211 ++++++-
client-py/iotdb/utils/IoTDBConstants.py | 11 +-
.../org/apache/iotdb/cluster/ClusterIoTDB.java | 19 +-
.../iotdb/cluster/server/ClusterTSServiceImpl.java | 65 +--
.../ClusterServiceProvider.java} | 35 +-
.../cluster/utils/nodetool/ClusterMonitor.java | 5 +-
docs/Development/ContributeGuide.md | 7 +-
docs/UserGuide/API/Programming-Java-Native-API.md | 611 ++++++++++-----------
.../Administration-Management/Administration.md | 8 +-
docs/UserGuide/Advanced-Features/Select-Into.md | 19 +-
docs/UserGuide/Advanced-Features/Triggers.md | 18 +-
docs/UserGuide/Appendix/Config-Manual.md | 29 +-
docs/UserGuide/Appendix/SQL-Reference.md | 26 +-
.../Data-Concept/Data-Model-and-Terminology.md | 19 +-
docs/UserGuide/Data-Concept/Data-Type.md | 10 +-
docs/UserGuide/Data-Concept/Time-Partition.md | 4 +-
.../UserGuide/Ecosystem Integration/Spark IoTDB.md | 39 +-
.../DDL-Data-Definition-Language.md | 64 ++-
.../DML-Data-Manipulation-Language.md | 87 +--
docs/UserGuide/System-Tools/CSV-Tool.md | 10 +-
.../UserGuide/API/Programming-Java-Native-API.md | 404 ++++++++------
.../Administration-Management/Administration.md | 8 +-
docs/zh/UserGuide/Advanced-Features/Select-Into.md | 20 +-
docs/zh/UserGuide/Advanced-Features/Triggers.md | 18 +-
docs/zh/UserGuide/Appendix/Config-Manual.md | 137 ++---
docs/zh/UserGuide/Appendix/SQL-Reference.md | 34 +-
.../Data-Concept/Data-Model-and-Terminology.md | 35 +-
docs/zh/UserGuide/Data-Concept/Data-Type.md | 10 +-
docs/zh/UserGuide/Data-Concept/Time-Partition.md | 4 +-
.../Ecosystem Integration/Grafana Plugin.md | 4 +-
.../UserGuide/Ecosystem Integration/Spark IoTDB.md | 71 +--
.../DDL-Data-Definition-Language.md | 82 +--
.../DML-Data-Manipulation-Language.md | 78 +--
docs/zh/UserGuide/System-Tools/CSV-Tool.md | 14 +-
.../src/AlignedTimeseriesSessionExample.cpp | 45 +-
example/client-cpp-example/src/SessionExample.cpp | 48 +-
example/pulsar/pom.xml | 5 +
.../java/org/apache/iotdb/pulsar/Constant.java | 38 +-
.../org/apache/iotdb/pulsar/PulsarConsumer.java | 69 +--
.../apache/iotdb/pulsar/PulsarConsumerThread.java | 72 ++-
.../org/apache/iotdb/pulsar/PulsarProducer.java | 38 +-
.../org/apache/iotdb/trigger/TriggerExample.java | 28 +-
.../java/org/apache/iotdb/udf/UDTFExample.java | 19 +-
grafana-plugin/pom.xml | 125 +++--
.../iotdb/influxdb/session/InfluxDBSession.java | 8 +-
.../apache/iotdb/db/integration/IOTDBInsertIT.java | 33 +-
.../IoTDBAlignedTimeSeriesCompactionIT.java | 486 ++++++++++++++++
.../{auth => }/IoTDBAuthorizationIT.java | 134 ++++-
.../db/integration/IoTDBContinuousQueryIT.java | 126 +----
.../iotdb/db/integration/IoTDBMetadataFetchIT.java | 153 +++---
.../db/integration/IoTDBQueryMemoryControlIT.java | 20 +-
.../db/integration/IoTDBSchemaTemplateIT.java | 52 +-
.../iotdb/db/integration/IoTDBSelectIntoIT.java | 96 +++-
.../iotdb/db/integration/IoTDBSimpleQueryIT.java | 10 +-
.../db/integration/IoTDBTriggerManagementIT.java | 40 +-
.../aggregation/IoTDBAggregationIT.java | 21 +-
.../aggregation/IoTDBAggregationLargeDataIT.java | 40 +-
.../aggregation/IoTDBAggregationSmallDataIT.java | 33 +-
.../aggregation/IoTDBUDFNestAggregationIT.java | 226 ++++++++
.../IoTDBUserDefinedAggregationFunctionIT.java | 21 +-
.../aligned/IOTDBInsertAlignedValuesIT.java | 115 ++++
.../IoTDBLoadExternalAlignedTsFileIT.java} | 113 ++--
.../iotdb/session/IoTDBSessionIteratorIT.java | 6 +-
.../apache/iotdb/session/IoTDBSessionSimpleIT.java | 19 +-
jenkins.pom | 1 +
pom.xml | 4 +-
.../resources/conf/iotdb-engine.properties | 29 +-
.../assembly/resources/conf/iotdb-rest.properties | 18 +-
.../org/apache/iotdb/db/auth/AuthorityChecker.java | 2 +-
.../apache/iotdb/db/auth/entity/PrivilegeType.java | 3 +-
.../org/apache/iotdb/db/concurrent/ThreadName.java | 8 +
.../java/org/apache/iotdb/db/conf/IoTDBConfig.java | 28 +-
.../org/apache/iotdb/db/conf/IoTDBConstant.java | 1 +
.../org/apache/iotdb/db/conf/IoTDBDescriptor.java | 20 +-
.../apache/iotdb/db/cq/ContinuousQueryService.java | 158 +++---
.../apache/iotdb/db/cq/ContinuousQueryTask.java | 165 +++---
.../db/cq/ContinuousQueryTaskPoolManager.java | 15 +-
.../org/apache/iotdb/db/engine/StorageEngine.java | 26 +-
.../inner/sizetiered/SizeTieredCompactionTask.java | 3 +-
.../utils/AlignedSeriesCompactionExecutor.java | 152 +++++
.../inner/utils/InnerSpaceCompactionUtils.java | 83 +--
.../inner/utils/MultiTsFileDeviceIterator.java | 166 +++++-
.../selectinto/InsertTabletPlanGenerator.java | 16 +-
.../selectinto/InsertTabletPlansIterator.java | 8 +-
.../db/engine/storagegroup/TsFileResource.java | 8 +-
.../storagegroup/VirtualStorageGroupProcessor.java | 82 +--
.../service/TriggerRegistrationService.java | 54 +-
.../db/exception/ContinuousQueryException.java | 6 +
.../org/apache/iotdb/db/metadata/MManager.java | 40 +-
.../org/apache/iotdb/db/metadata/mtree/MTree.java | 16 +-
...er.java => MeasurementGroupByLevelCounter.java} | 45 +-
.../iotdb/db/metadata/template/Template.java | 10 +-
.../iotdb/db/protocol/influxdb/dto/IoTDBPoint.java | 4 +-
.../{MetaManager.java => InfluxDBMetaManager.java} | 43 +-
.../iotdb/db/protocol/mqtt/PublishHandler.java | 24 +-
.../rest/handler/AuthorizationHandler.java | 16 +-
.../protocol/rest/impl/GrafanaApiServiceImpl.java | 25 +-
.../db/protocol/rest/impl/RestApiServiceImpl.java | 29 +-
.../main/java/org/apache/iotdb/db/qp/Planner.java | 11 -
.../apache/iotdb/db/qp/executor/PlanExecutor.java | 88 ++-
.../qp/logical/crud/AggregationQueryOperator.java | 47 +-
.../iotdb/db/qp/logical/crud/InsertOperator.java | 48 +-
.../iotdb/db/qp/logical/crud/SelectComponent.java | 6 +
.../db/qp/logical/crud/SelectIntoOperator.java | 10 +-
.../logical/sys/CreateContinuousQueryOperator.java | 30 +-
.../db/qp/logical/sys/CreateTemplateOperator.java | 16 +-
.../apache/iotdb/db/qp/physical/PhysicalPlan.java | 4 +
.../physical/crud/InsertRowsOfOneDevicePlan.java | 18 +-
.../iotdb/db/qp/physical/crud/SelectIntoPlan.java | 18 +-
.../qp/physical/sys/CreateContinuousQueryPlan.java | 58 +-
.../db/qp/physical/sys/CreateTriggerPlan.java | 5 +
.../iotdb/db/qp/physical/sys/DropTriggerPlan.java | 27 +
.../iotdb/db/qp/physical/sys/StartTriggerPlan.java | 27 +
.../iotdb/db/qp/physical/sys/StopTriggerPlan.java | 27 +
.../apache/iotdb/db/qp/sql/IoTDBSqlVisitor.java | 101 ++--
.../iotdb/db/qp/strategy/LogicalChecker.java | 5 +
.../db/query/control/SessionTimeoutManager.java | 6 +-
.../iotdb/db/query/dataset/ShowDevicesDataSet.java | 16 +-
.../iotdb/db/query/dataset/ShowDevicesResult.java | 31 +-
.../db/query/dataset/UDTFAlignByTimeDataSet.java | 28 +-
.../iotdb/db/query/executor/QueryRouter.java | 5 +-
.../db/query/udf/core/layer/InputRowUtils.java | 19 +
.../query/udf/core/layer/RawQueryInputLayer.java | 11 +-
.../row/ElasticSerializableRowRecordList.java | 16 +-
.../java/org/apache/iotdb/db/service/IoTDB.java | 52 +-
.../org/apache/iotdb/db/service/SettleService.java | 7 +-
...icServiceProvider.java => ServiceProvider.java} | 104 ++--
.../service/basic/StandaloneServiceProvider.java | 55 ++
.../service/thrift/impl/InfluxDBServiceImpl.java | 37 +-
.../db/service/thrift/impl/TSServiceImpl.java | 261 +++++----
.../java/org/apache/iotdb/db/utils/AuthUtils.java | 4 +
.../apache/iotdb/db/utils/ErrorHandlingUtils.java | 47 +-
.../writelog/manager/MultiFileLogNodeManager.java | 38 +-
.../compaction/TestUtilsForAlignedSeries.java | 228 ++++++++
.../compaction/inner/InnerSeqCompactionTest.java | 9 +-
.../inner/InnerSpaceCompactionExceptionTest.java | 14 +-
.../InnerSpaceCompactionUtilsAlignedTest.java | 532 ++++++++++++++++++
.../InnerSpaceCompactionUtilsNoAlignedTest.java | 55 +-
.../inner/InnerSpaceCompactionUtilsOldTest.java | 2 +-
.../compaction/inner/InnerUnseqCompactionTest.java | 3 +-
.../SizeTieredCompactionRecoverTest.java | 34 +-
.../recover/SizeTieredCompactionRecoverTest.java | 16 +-
.../compaction/utils/CompactionCheckerUtils.java | 32 +-
.../iotdb/db/engine/storagegroup/TTLTest.java | 2 +
.../iotdb/db/metadata/MManagerBasicTest.java | 45 ++
.../org/apache/iotdb/db/metadata/MTreeTest.java | 73 +++
.../db/qp/physical/InsertTabletMultiPlanTest.java | 99 ++++
.../iotdb/db/query/dataset/ListDataSetTest.java | 23 +-
.../db/query/dataset/ShowDevicesResultTest.java | 3 +-
.../ElasticSerializableRowRecordListTest.java | 20 +-
server/src/test/resources/iotdb-rest.properties | 18 +-
.../main/java/org/apache/iotdb/rpc/RpcUtils.java | 1 -
.../iotdb/rpc/StatementExecutionException.java | 1 -
.../java/org/apache/iotdb/session/Session.java | 160 ++++--
.../org/apache/iotdb/session/pool/SessionPool.java | 82 +++
.../apache/iotdb/session/util/SessionUtils.java | 15 +-
.../java/org/apache/iotdb/session/SessionTest.java | 122 +++-
.../apache/iotdb/session/template/TemplateUT.java | 27 +-
session/src/test/resources/iotdb-rest.properties | 18 +-
spark-iotdb-connector/pom.xml | 29 +-
.../org/apache/iotdb/spark/db/SQLConstant.java | 28 -
.../org/apache/iotdb/spark/db/DataFrameTools.scala | 131 +++++
.../org/apache/iotdb/spark/db/DefaultSource.scala | 4 +-
.../scala/org/apache/iotdb/spark/db/IoTDBRDD.scala | 9 +-
.../org/apache/iotdb/spark/db/SQLConstant.scala | 9 +-
.../org/apache/iotdb/spark/db/Transformer.scala | 18 +-
.../iotdb/spark/db/tools/DataFrameTools.java | 162 ------
.../org/apache/iotdb/spark/db/IoTDBWriteTest.scala | 30 +-
.../DataFrameToolsTest.scala} | 63 +--
.../encoding/encoder/DeltaBinaryEncoder.java | 10 +-
.../tsfile/file/metadata/enums/TSDataType.java | 18 +
.../read/TsFileAlignedSeriesReaderIterator.java | 79 +++
.../iotdb/tsfile/read/TsFileSequenceReader.java | 121 +++-
.../tsfile/read/reader/page/AlignedPageReader.java | 40 +-
.../tsfile/read/reader/page/TimePageReader.java | 12 +-
.../tsfile/read/reader/page/ValuePageReader.java | 53 +-
.../org/apache/iotdb/tsfile/utils/BytesUtils.java | 127 +++--
.../tsfile/write/chunk/AlignedChunkWriterImpl.java | 33 ++
.../iotdb/tsfile/write/chunk/ValueChunkWriter.java | 7 +-
.../iotdb/tsfile/write/page/ValuePageWriter.java | 3 +
.../apache/iotdb/tsfile/write/record/Tablet.java | 2 +-
.../iotdb/tsfile/write/writer/TsFileIOWriter.java | 18 +-
.../apache/iotdb/tsfile/read/TsFileReaderTest.java | 40 ++
.../iotdb/tsfile/utils/TsFileGeneratorForTest.java | 9 +-
.../zeppelin/iotdb/IoTDBInterpreterTest.java | 9 +-
192 files changed, 7363 insertions(+), 3208 deletions(-)
copy client-py/{SessionExample.py => SessionAlignedTimeseriesExample.py} (67%)
copy client-py/{SessionTest.py => SessionAlignedTimeseriesTest.py} (75%)
copy
cluster/src/main/java/org/apache/iotdb/cluster/server/{ClusterTSServiceImpl.java
=> basic/ClusterServiceProvider.java} (78%)
create mode 100644
integration/src/test/java/org/apache/iotdb/db/integration/IoTDBAlignedTimeSeriesCompactionIT.java
rename integration/src/test/java/org/apache/iotdb/db/integration/{auth =>
}/IoTDBAuthorizationIT.java (90%)
copy
integration/src/test/java/org/apache/iotdb/db/integration/{IoTDBLoadExternalTsfileIT.java
=> aligned/IoTDBLoadExternalAlignedTsFileIT.java} (86%)
create mode 100644
server/src/main/java/org/apache/iotdb/db/engine/compaction/inner/utils/AlignedSeriesCompactionExecutor.java
copy
server/src/main/java/org/apache/iotdb/db/metadata/mtree/traverser/counter/{MNodeLevelCounter.java
=> MeasurementGroupByLevelCounter.java} (56%)
rename
server/src/main/java/org/apache/iotdb/db/protocol/influxdb/meta/{MetaManager.java
=> InfluxDBMetaManager.java} (88%)
rename
server/src/main/java/org/apache/iotdb/db/service/basic/{BasicServiceProvider.java
=> ServiceProvider.java} (74%)
create mode 100644
server/src/main/java/org/apache/iotdb/db/service/basic/StandaloneServiceProvider.java
create mode 100644
server/src/test/java/org/apache/iotdb/db/engine/compaction/TestUtilsForAlignedSeries.java
create mode 100644
server/src/test/java/org/apache/iotdb/db/engine/compaction/inner/InnerSpaceCompactionUtilsAlignedTest.java
delete mode 100644
spark-iotdb-connector/src/main/java/org/apache/iotdb/spark/db/SQLConstant.java
create mode 100644
spark-iotdb-connector/src/main/scala/org/apache/iotdb/spark/db/DataFrameTools.scala
copy cluster/src/test/java/org/apache/iotdb/cluster/utils/Constants.java =>
spark-iotdb-connector/src/main/scala/org/apache/iotdb/spark/db/SQLConstant.scala
(83%)
delete mode 100644
spark-iotdb-connector/src/main/scala/org/apache/iotdb/spark/db/tools/DataFrameTools.java
copy
spark-iotdb-connector/src/test/scala/org/apache/iotdb/spark/db/{IoTDBWriteTest.scala
=> unit/DataFrameToolsTest.scala} (61%)
create mode 100644
tsfile/src/main/java/org/apache/iotdb/tsfile/read/TsFileAlignedSeriesReaderIterator.java
