Hi all,
yesterdays' biweekly meeting discussed the ongoing and upcoming features,
performance optimizations, as well as bug fixes of Apache IoTDB.
Below is a short summary:
1. Table Model Design for IoTDB
a) Functional Definition: Outline of the features and design for the
IoTDB table model.
b) Development Progress: Update on the current stage of development.
2. New Features
a) Active Series/Device Statistics (Under Design)
[1] Ability to show or count timeseries/devices specifying a
particular time.
[2] Designing the implementation for querying time series metadata
filters.
b) Expansion of Data Types (Under Functional Definition)
[1] Support for additional data types including VARCHAR
(characters), bytea (binary data), date, and timestamp.
c) Adjustment of WAL Default Write Block Threshold (Under Design)
d) Transparent Encryption (Single-node Version) (Under Design)
e) Device-level TTL (Time To Live) (New and Under Development)
f) Compressed Text Data Type (Under Discussion)
g) Data Subscription Client (Under Testing)
h) Metadata Synchronization (Under Testing)
3. Performance Optimization
a) Permission Verification Optimization (Completed)
[1] Reduced the time for permission checks on SQL queries with
10,000 datapoints from 18 seconds to under 5 milliseconds.
b) ncreased Merge Time after Disabling Biased Locking
[1] Inheritance of a synchronized write method in PublicBAOS from
its superclass caused increased time.
c) Batch Implementation for UDTF Beyond Scalar Functions (Under
Development)
d) Pushdown of Aggregate Queries with Value Filtering Using Statistics
to Accelerate (Under Development)
e) Batch Optimization of WAL (Write-Ahead Logging) (Under Design)
f) Numa-Aware System Deployment Optimization
4. Bug Fixes
a) Fix for Remove Datanode Bug
b) Resolution of Deadlocks During Concurrent delete/load and Read/Write
Operations
c) Error in Compaction Schedule Thread when Dropping Database
Concurrently with Compaction (Fixed)
[1] Additional exception handling required in some scenarios to
prevent error logs.
d) Occasional NPE (NullPointerException) and Memory Release Issues
During Query Timeout (Fixed)
[1] Pending merge of changes in the SessionDataSet.hasNext method,
which moves the cursor.
5. Technical Consolidation
a) Statistics on code volume for time series databases: A summary of
the amount of code developed for time series database functionalities.
The discussions in the biweekly meetings were & will be documented in:
https://apache-iotdb.feishu.cn/docx/NPZSdeiw2o31ZtxcP4rcsen7nKh?open_in_browser=true
Best regards,
Pengcheng Zheng
Am Do., 11. Apr. 2024 um 10:42 Uhr schrieb Yuan Tian <[email protected]
>:
> Hi all,
>
> The biweekly meeting will start at 8pm tonight.
>
> The main content of the meeting is to synchronize with everyone the main
> work directions of the community in the past two weeks (completed and
> ongoing). During the introduction process, everyone is also welcome to
> discuss current work items. If you have anything else you want to discuss
> at the biweekly meeting, you can send it to me in advance and I will list
> it in the document in advance.
>
> The meeting link is:
> https://meeting.tencent.com/dm/6BkPsKOYyzt9
>
> The meeting No. is:
> 706-6364-8152
>
> Best regards,
> -----------------------
> Yuan Tian
>
