This is an automated email from the ASF dual-hosted git repository.
jackietien pushed a change to branch force_ci/object_type
in repository https://gitbox.apache.org/repos/asf/iotdb.git
from b4c542dc1e1 Fix queryCostStatWindow process of current queries (#16912)
add fe37a4b5779 Hide password related parameters in show configuration
result (#16675)
add f8ad340df55 Avoid throwing AuthException to the state machine (#16677)
add acaf594ab46 If the client input uses "-usessl", then force interactive
input of trustStore and trustStorePwd. (#16676)
add 993a7839133 Fix process logic of empty TsBlock in InputLayer of
TransformOperator (#16678)
add 26ca344925e Bump logback version to 1.3.16 (#16671)
add 274fc9ed443 Use the correct value in showConfiguration to override the
value read from the configuration file (#16681)
add 685141a6405 Fixed the bug that the attribute update container may add
extra calculated memory to schema engine (#16682)
add 69cda2da662 Add more optimizers for union (#16689)
add 2488001e808 SeriesScanUtil throws exception when using filters that
could not match any time range (#16691)
add 8420beaaf54 Fix wrong push limit down to AggTableScanNode (#16696)
add b6c6c7a1138 More robust IoTDBRegionReconstructForIoTV1IT (#16697)
add f096b8210ff Implemented the alter encoding compression function for
tree model (#16672)
add ababbf337e2 Support SSL-related parameters and interactive password
input in export/import tools (#16698)
add 4ebb89b91e8 implement the intersect (distinct | all ) for table model
(#16700)
add c406a81f53c Fix the error message of ConfigExecution (#16680)
add 9ae8233091f Fixed the null error message of fetch schema failed when
the regions is removing (#16713)
add a9ba7243ba9 Pipe: Fixed the NPE of commit interval (#16714)
add 3ec8979e42a Follow fix for encoding & compressor (#16712)
add 9d4c41092a8 Avoid unnecessary ssl error log caused by jdk bug (#16709)
add 2de3bb6f534 Active Load: Ignore java.io.UncheckedIOException
exceptions thrown during the file scanning process. (#16705)
add f67526420d0 Delete the tsfile and related attachments When only one
table and dat… (#16687)
add 639de5255ce Fixed the potential non-consistency caused by initialize
of DataNodeTableCache & Cleared the storageGroups in compatible codes (#16693)
add ffa9c562c4e Optimize the configuration logic of
dn_thrift_max_frame_size (#16724)
add b4d5b4235e1 Changed the SQL of AlterEncodingCompressor statement &
banned the "root" timeSeries & handled the empty intersection path & refactored
the IT (#16725)
add 8dbf2003cfd chore!: Bind real config address for Thrift and Raft
services (#16717)
add 93b2d1fe999 Make ErrMsg more readable when the predicate has too many
conjunctions because of too many devices #16715
add 93c55577e6f Pipe: Fix unhandled timeout exceptions in Thrift Client
(#16727)
add 468a91a4d2e Fixed the procedure has_more_state bug & Fixed the IT for
encoding & compressor (#16729)
add a6e8493bfc0 Optimized the lock for encoding & compressor's invalidate
cache (#16733)
add d48347cdc8d Pipe: support path exclusion under tree model (#16632)
add 43b89b9a480 Change the privilege of showVersionStatement #16736
add 49c625bb83e [AINode] Package AINode via PyInstaller (#16707)
add 96e8681dd51 Support the JDBC client to prevent SQL injection (#16734)
add b7f9f8d49af Fix that a deletion test may fail due to inconsistency
caused by leader redistribution (#16744)
add 7515568c8e4 Fixed the NPE caused by concurrent "check for
createTimeSeries" and deleteTimeSeries (#16742)
add 6e8748e0256 Pipe: Optimized the default behavior in meta sync for
retries to wait for other regions (#16740)
add f608a2d2e6a Adjust the exception message cause by the WHERE clause,
which uses a range comparison on the same field, specifically when the left
value of the range is greater than the right value of the range. (#16741)
add e53d27c0ad0 Pipe: Trimmed some of the pipe logs (#16747)
add db7c801d846 Active Load: Fixes errors caused by Load copying resource
files. (#16753)
add a6191d916b2 Pipe: Modify the Pipe configuration item log name to be
consistent with the Properties name. (#16732)
add 91e48f07f63 feat: encode load attributes in active load directories
(#16722)
add 1ebb9515767 [AINode] Enable AINode start as background (-d) (#16762)
add 3a6322028cd fix (#16702)
add a7f1527d04c reduce error log when compaction service is stopped & fix
bugs (#16756)
add d49d7dd7711 [AINode] Update AINodeClient for DataNode to borrow
(#16647)
add cd443ba9996 [AINode] Fix bug that AINode cannot compile in Windows
(#16767)
add bd97844bb7f fix (#16773)
add 2c381feda25 Load: Fixed the bug that mods is not deleted in load
tsFile when there are exceptions & Fixed the potential NPE in air gap agent
close() method (#16775)
add 2b47be756ad [AINode] Fix bug of sundial and forecast udf (#16768)
add 9fd9d7e818a Fixed the bugs related to device auto-create alignment
ignorance (#16780)
add f708b966238 Load: Active Load supports ModV2 (#16769)
add 0f2483fbe2e Load: Fixed the issue of TSFile parent directory being
null and TSFile resource being updated during the Load process. (#16751)
add b3509d6d6bf Load: Fixed parameter passing error in MoveFile function
(#16748)
add 0e209e73c21 Refine CN consensus layer API for procedure robustness
(#16303)
add 0ebdb878e57 Pipe: improved the memory calculation for tablets (#16739)
add c76c5fe3d5a Fixed the bug related to "Fixed the bugs related to device
auto-create alignment ignorance" (#16781)
add 9121208304c Load: Remove the getParentFile and exists checks from Load
New File (#16787)
add 36154e50300 Optimized the error message when the column is not
tag/attribute in device related SQLs (#16750)
add fbcb8a2c6ed Avoid connection reset error log printed (#16797)
add 0c23da2551f Fix that settle compaction may lgnore some newly incoming
deletions (#16799)
add 03b60d1390c Fix slowQueryThreshold & optimize encodeBatch (#16765)
add 4525d075867 Pipe: Adjusted the waiting time of temporary unavailable
exceptions (#16798)
add 50f92e48cf6 [AINode] Delete poetry.lock for easier maintain different
operating systems (#16793)
add 1c6a2b02ab9 Bump ratis to apache 3.2.1 (#16801)
add 448592e3c8d Pipe: Fixed the check for no permission 2 (#16804)
add 0431d5abd45 Update ratis-thirdparty-misc version to 1.0.10 (#16807)
add 100c5a3c5c6 Fix window partiton across two TsBlock bugs (#16809)
add d99740860c2 may_fix (#16814)
add fb899b16b92 Fixed the bug of 305 error for unsupported table
opreations #16816
add ddcc64618b5 Fixed the calculation error of schema cache (#16818)
add 03bc2606563 Fixed the concurrency issue of region migrate and load
(#16796)
add c4114b95d94 Add 'show available urls' (#16441)
add 19ebbe31099 Added back the mis-deleted "()" in last cache (#16824)
add 8cb4b9be877 Reduced the auth log when paths are too many (#16825)
add 23be2201b81 perf: Optimize wide table write performance (#16699)
add 85b8f168d7c implement the except (distinct | all ) for table model
#16760
add 85281fac2a3 added support for Blob objects to the length() function,
allowing for calculating the byte size for Blob inputs (#16170)
add bd813d85c62 implement intersect and except related optimization rule:
MergeIntersect, MergeExcept, RemoveEmptyIntersectBranchs,
EvaluateEmptyIntersect, PruneIntersectSourceColumns, PruneExceptSourceColmns
(#16761)
add e3127e6c61f Pipe: Ignore logging when `returnSelf` is called in the
event of an exception in `AsyncClient`. (#16827)
add cb705d17b85 Fixed the schema cache calculation 2 & The potential NPE
caused by concurrent invalidate and update (#16834)
add 8cd141895b1 Fix the check of grant option for tree model (#16845)
add f68c49e349b Pipe: Fixed the bug that lower version tablet may cause
NPE when sent to 2.x version & The temporary exception may be wrongly reported
(#16843)
add 263c23bd69d Pipe: Fixed the auth implementation error (#16847)
add 45f26455926 Fix NPE during compaction when disk space is insufficient
(#16841)
add db02437f00f PipePlugin: Optimized the errorCode && Fixed the
case-sensitive semantic (#16851)
add 5bc4779ba43 Pipe: Fix NullPointerException in concurrent event access
(#16849)
add 5cf60df3afc may-c (#16859)
add f4d628a7d6a Pipe: Prevent duplicate error logging in
AsyncPipeDataTransferServiceClient (#16856)
add 1b2b32bc2a3 perf: Optimize TypeManager allocation in StatementAnalyzer
(#16870)
add 1746cdb28b1 Add system table named connections to resolve the idle
session can be found (#16846)
add 2db7b21bce1 Switch to at.yawk.lz4:lz4-java:1.10.0 (#16871)
add 0bb9e96ece7 Bump at.yawk.lz4:lz4-java from 1.10.0 to 1.10.1 (#16874)
add c560247f8b5 Pipe: Fixed the NPE caused by new regions + history only
logic (#16879)
add a0dbf9b18e0 Pipe: Fixed the bug that reused plugins may not get loader
and visibility (#16877)
add 7436c88304e Implement PreparedStmt on the Server side (#16764) (#16880)
add bc4f8e9bd81 Load: Fix excessive GC caused by loading too many TsFiles
at once (#16853)
add 13b0582dfb1 Pipe: Modify the TableRawReq deserialization method to
support directconversion to TableStatement. (#16844)
add a899c48a09c Optimize memtable region scan (#16883)
add d7898c44343 [AINode] Refactoring of Model Storage, Loading, and
Inference Pipeline (#16819)
add bfa71e00e76 Active Load: Add cleanup for active load listening
directories on DataNode first startup (#16854)
add 4a481f02bf8 Remove the code check port is occupied and resolve the
problem that can't rename file successfully (#16889)
add 5d1efef31da Remove the code check port is occupied, and resolve the
problem that can't rename file successfully. (#16893)
add 94461b06509 Support system table current_queries and
queries_costs_histogram (#16890)
add c722aaf6c8d [AINode] More accurate exception for model management
(#16895)
add 9abac5c2d76 Fix the config 'query_cost_stat_window' cannot be hot
loaded #16896
add fad9bdedada Hotfix concurrent connect error (#16900)
add 7c7b2a6c091 [AINode] More strict concurrent inference IT (#16898)
add 48bd352fb00 Delete audit implementation (#16899)
add 44409934426 Avoid CN OOM by Pulling User/Roles to DN When Cache
Misses. (#16888)
add b71401a4227 fix showQueries (#16855)
add 2710cb3db65 Add state predicate push down for system table
current_queries (#16904)
add c77bb57cb2e Optimized the error message & prevented stack printing of
information_schema selection when the cluster is closing (#16905)
add 1bf79ca4713 Fix folderManager NPE issue in WALNode when starting iotdb
in a disk-full state (#16869)
add 79e10af5fd1 Fixed the warn log of internal/MQTT session's close
session method (#16909)
add c663477e82a Fix queryCostStatWindow process of current queries (#16912)
add 02e3517c536 Fix the issue of SQL conversion in export tool (#16913)
add 664f485ddf8 Add datanode_id column for queries_costs_histogram table
and add memory usage metric for Coordinator (#16918)
add 76d02a58f00 Modify pipeline and automap (#16923)
add b6c13d7e3e8 [AINode] Forecast table function version2 (#16922)
new c82230cb440 Add Object Type
new fe19ae8278e fix ttl deletion
new f408427264f Limit the return size for client instead of always using
fetchSize
new fa17495e8d7 Add compress for geo_penetrate
new baafe259e7b Fix object table split to multi regions (#15927)
new 637902ba068 [To object_type] Fix wrong object value inserted (#15928)
new 67f6b6042d8 fix ttl deletion
new d206aa95fb8 fix ttl deletion
new e85dce6ed49 fix multi measurement name
new f8b356088e6 cpp client datatype OBJECT (#16094)
new c7572ed43e0 make offset of read_object take effective
new 58c4b4f76a8 Print file name while encountering error
new 6b769ea1bf3 Print file name while encountering error
new 59803c23506 Add object type file metric (#16257)
new 69cdbe915a8 modify the log of removing object file
new 39c33d8d016 Add object type in CompatibleResolver
new 38033d5bc78 Support In UDF Record
new 0162c2c07de disable object type in UDTF
new 9dd78387fd4 [To force_ci/object_type] Support insert object by sql &
add IT (#16683)
new f8893408f1a Add IT for session and jdbc query
new bea6b43bad0 Fix compile error in DataRegion
new b23460c57cc fix object functions & add tests for object type & fix
some bugs (#16829)
new 65c96dfa445 Added name check to avoid directory attack (#16720)
new 1db79d2f3f6 Bump tsfile version to 2.2.0-251208-SNAPSHOT
new eb89e08492d Fix compile error caused by `perf: Use enum types for
compression and encoding instead of strings (#640)`
new 533aa6a6053 Fix compile error
new 7aefa75a62a Forbid some interface and add new interface in Record
(#16892)
new d097f7f58a5 Bump tsfile version to 2.2.0-251210-SNAPSHOT
new 3539ec03448 Fix NoSuchFile in Object IT
new 3df70637733 Two Implementation of Object File Path (#16858)
new fb38bd938e3 Throw exception while readObject column is not OBJECT type
new efc633100da Check offset in object related functions
new 8b3a3d42a89 resolve conflicts with master
The 33 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../ainode/it/AINodeConcurrentForecastIT.java | 2 +-
.../apache/iotdb/ainode/it/AINodeForecastIT.java | 100 +++++-
.../informationschema/IoTDBCurrentQueriesIT.java | 2 +
.../org/apache/iotdb/tool/data/ExportData.java | 5 +-
.../ainode/core/inference/inference_request.py | 19 +-
.../core/inference/inference_request_pool.py | 3 +
.../core/inference/pipeline/basic_pipeline.py | 43 ++-
.../iotdb/ainode/core/manager/inference_manager.py | 46 ++-
.../ainode/iotdb/ainode/core/model/model_info.py | 16 +-
.../ainode/iotdb/ainode/core/model/model_loader.py | 17 +-
.../ainode/core/model/sktime/pipeline_sktime.py | 45 ++-
.../ainode/core/model/sundial/modeling_sundial.py | 13 +-
.../ainode/core/model/sundial/pipeline_sundial.py | 30 +-
.../ainode/core/model/timer_xl/modeling_timer.py | 6 +-
.../ainode/core/model/timer_xl/pipeline_timer.py | 29 +-
iotdb-core/ainode/iotdb/ainode/core/util/serde.py | 24 +-
.../InformationSchemaContentSupplierFactory.java | 1 +
.../plan/planner/TableOperatorGenerator.java | 25 +-
.../function/TableBuiltinTableFunction.java | 6 +-
.../function/tvf/ClassifyTableFunction.java | 383 +++++++++++++++++++++
.../function/tvf/ForecastTableFunction.java | 261 ++++----------
.../relational/utils/ResultColumnAppender.java | 145 ++++++++
.../db/queryengine/plan/udf/UDTFForecast.java | 2 +
.../metrics/memory/QueryEngineMemoryMetrics.java | 12 +-
.../relational/analyzer/TableFunctionTest.java | 4 +-
.../informationschema/CurrentQueriesTest.java | 2 +-
.../commons/schema/table/InformationSchema.java | 2 +
27 files changed, 910 insertions(+), 333 deletions(-)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/function/tvf/ClassifyTableFunction.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/relational/utils/ResultColumnAppender.java
