[ANNOUNCE] Apache IoTDB 0.12.2 is released
The Apache IoTDB team is pleased to announce the release of Apache IoTDB 0.12.2. Apache IoTDB (Database for Internet of Things) is an IoT native database with high performance for data management and analysis, deployable on the edge and the cloud. This is a bug-fixed version of 0.12.1, which includes a number of improvements: ## New Features * [IOTDB-959] Add create storage group Grammar * [IOTDB-1399] Add a session interface to connect multiple nodes * [IOTDB-1466] Support device template * [IOTDB-1491] UDTF query supported in cluster * [IOTDB-1496] Timed flush memtable * [IOTDB-1536] Support fuzzy query REGEXP * [IOTDB-1561] Support fill by specific value * [IOTDB-1565] Add sql: set system to readonly/writable * [IOTDB-1569] Timed close TsFileProcessor * [IOTDB-1586] Support mysql-style Like clause * [ISSUE-3811] Provide a data type column for the last query dataset * TTL can be set to the prefix path of storage group * add JMX monitor to all ThreadPools in the server module ## Improvements * [IOTDB-1566] Do not restrict concurrent write partitions * [IOTDB-1585] ModificationFile‘s write interface blocking * [IOTDB-1587] SessionPool optimization: a more aggressive Session creation strategy * Use StringCachedPool in TsFileResource to reduce the memory size * write performance optimization when replicaNum == 1 * Optimize Primitive Array Manager * Function Improvement: add overlapped page rate in Tracing ## Bug Fixes * [IOTDB-1282] fix C++ class SessionDataSet mem-leak * [IOTDB-1407] fix Filtering time series based on tags query fails Occasionally * [IOTDB-1437] Fix the TsFileSketchTool NPE * [IOTDB-1442] Time filter & TTL do not take effect in cluster * [IOTDB-1452] remove compaction log/ change logger to daily * [IOTDB-1447] ClientPool is blocking other nodes when one node fails * [IOTDB-1456] Fix Error occurred while executing delete timeseries statement * [IOTDB-1461] Fix compaction conflicts with ttl * [IOTDB-1462] Fix cross space compaction recover null pointer bug * [IOTDB-1464] fix take byte array null pointer * [IOTDB-1469] fix cross space compaction lost data bug * [IOTDB-1471] Fix path not right in "sg may not ready" log * [IOTDB-1475] MeasurementId check while create timeseries or template/ disable time or timestamp in timeseries path * [IOTDB-1488] Fix metaMember's forwarding clientPool timeout in cluster module * [IOTDB-1494] fix compaction block flush bug * [IoTDB-1499] Remove series registration using IoTDBSink * [IoTDB-1501] Fix compaction recover delete tsfile bug * [IOTDB-1529] Fix mlog recover idx bug and synchronize setStorageGroup * [IOTDB-1537] fix insertTablet permission * [IOTDB-1539] Fix delete operation with value filter is abnormal * [IOTDB-1540] Bug Fix: 500 when using IN operator * [IOTDB-1541] Fix query result not right due to non-precise time index of resource * [IOTDB-1542] Cpp client segment fault: char[] buffer overflow caused by long exception message * [IOTDB-1545] Query dataset memory leak on server caused by cpp client * [IOTDB-1546] Optimize the Upgrade Tool rewrite logic to reduce the temp memory cost * [IOTDB-1552] Only allow equivalent filter for TEXT data type * [IOTDB-1556] Abort auto create device when meet exception in setStorageGroup * [IOTDB-1574] Deleted file handler leak * [IOTDB-1580] Error result of order by time desc when enable time partition * [IOTDB-1584] Doesn't support order by time desc in cluster mode * [IOTDB-1588] Bug fix: MAX_TIME is incorrect in cluster mode * [IOTDB-1594] Fix show timeseries returns incorrect tag value * [IOTDB-1600] Fix InsertRowsOfOneDevicePlan being not supported in cluster mode * [IOTDB-1610] Fix TsFileRewriteTool writing incorrect data file * [ISSUE-3116] Bug when using natural month unit in time interval in group by query * [ISSUE-3316] Query result with the same time range is inconsistent in group by query * [ISSUE-3436] Fix query result not right after deleting multiple time interval of one timeseries * [ISSUE-3458] fix load configuration does not take effect * [ISSUE-3545] Fix Time interval value is disorder in group by month * [ISSUE-3653] fix Max_time and last return inconsistent result * [ISSUE-3690] Memory leaks on the server when cpp client invokes checkTimeseriesExists * [ISSUE-3805] OOM caused by Chunk cache * [ISSUE-3865] Meaningless connection reset issues caused by low default value for SOMAXCONN * Fix DataMigrationExample OOM if migrate too many timeseries * Handle false positive cases which may cause NPE of tsfile bloom filter * Fix Windows shell error on JDK11 & fix iotdb-env.bat not working * Fix cluster auto create schema bug when retry locally * Fix thrift out of sequence in cluster module * Skip non exist measurement in where clause in align by device * fix blocking query when selecting TsFile in compaction * Fix redundant data in compaction recover * Fix load tsfile with time partition enable ## Incompatible changes * [IOTDB-1485] Replace tsfile_size_threshold by
[ANNOUNCE] Apache IoTDB 0.12.1 released
The Apache IoTDB team is pleased to announce the release of Apache IoTDB 0.12.1. Apache IoTDB (Database for Internet of Things) is an IoT native database with high performance for data management and analysis, deployable on the edge and the cloud. This is a bug-fixed version of 0.12.0, which includes a number of improvements: ## Bug Fixes * [GITHUB-3373] Remove the broken cached leader connection & optimize the insertRecords method in session * [IOTDB-1433] Fix bug in getMetadataAndEndOffset when querying non-exist device * [IOTDB-1432] fix level compaction loss data * [IOTDB-1427] Fix compaction lock with query * [IOTDB-1420] Fix compaction ttl bug * [IOTDB-1419] Remove redundant clearCompactionStatus, fix continuous compaction doesn't take effect when enablePartition * [IOTDB-1415] Fix OOM caused by ChunkCache * [IOTDB-1414] NPE occurred when call getStorageGroupNodeByPath() method using not exist path * [IOTDB-1412] Unclear exception message thrown when executing empty InsertTabletPlan * [IOTDB-1411] Fix thriftMaxFrameSize and thriftDefaultBufferSize does not in effect * [IOTDB-1398] Do not select unseq files when there are uncompacted old unseq files * [IOTDB-1390] Fix unseq compaction loss data bug * [IOTDB-1384] Fix group by bug * [ISSUE-3378] Fix NPE when clear upgrade folder; Fix some upgraded pageHeader missing statistics * [GITHUB-3339] Try to fix sg dead lock * [GITHUB-3329] Fix upgrade NPE and DeadLock * [GITHUB-3319] Fix upgrade tool cannot close file reader * [IOTDB-1212] Fix The given error message is not right when executing select sin(non_existence) from root.sg1.d1 * [IOTDB-1219] Fix a potential NPE issue in UDF module * [IOTDB-1286] Fix 4 C++ mem-leak points * [IOTDB-1294] Fix delete operation become invalid after compaction * [IOTDB-1313] Fix lossing time precision when import csv with unsupported timestamp format * [IOTDB-1316] The importCsv tool should continue inserting if a part of insertion failed * [IOTDB-1317] Fix log CatchUp always failed due to not check the follower's match index * [IOTDB-1323] Fix return a success message when encounter RuntimeException during the insertion process * [IOTDB-1325] Fix StackOverflow Exception in group by natural month query * [IOTDB-1330] Fix the load tsfile bug when the cross multi partition's tsfile only have one page * [IOTDB-1348] Fix Last plan not work in cluster mode * [IOTDB-1376] Fix BatchProcessException was not correctly handled in BaseApplier * [ISSUE-3277] Fix TotalSeriesNumber in MManager counted twice when recovering * [ISSUE-3116] Fix bug when using natural month unit in time interval in group by query * [ISSUE-3309] Fix InsertRecordsOfOneDevice runs too slow * Fix the plan index is always zero when using insertRecords interface to run the cluster * Add authority check for users create timeseries using executeBatch interface without the privilege * Fix versionInfo NPE when query upgrading 0.11 tsfile * Fix upgrade tool cannot load old tsfile if time partition enabled in 0.11 * Fix import csv throw ArrayOutOfIndexError when the last value in a line is null * Fix upgrade tool cannot close file reader ## Improvements * [GITHUB-3399] Change the default primitive array size to 32 * [IOTDB-1387] Support Without Null ALL in align by device clause, Filter RowRecord automatically if any column in it is null or all columns are null * [IOTDB-1385] Extract the super user to the configuration * [IOTDB-1315] ExportCsvTool should support timestamp `-MM-dd'T'HH:mm:ss.SSSZ` * [IOTDB-1339] optimize TimeoutChangeableTSnappyFramedTransport * [IOTDB-1356] Separate unseq_file_num_in_each_level from selecting candidate file in unseq compaction * [IOTDB-1357] Compaction use append chunk merge strategy when chunk is already large enough * [IOTDB-1380] Automatically close the dataset while there is no more data * Optimize sync leader for meta ## New Features * [GITHUB-3389] TTL can be set to any path * [GITHUB-3387] Add parameter compaction_interval=1ms * [IOTDB-1190] Fully support HTTP URL char set in timeseries path * [IOTDB-1321][IOTDB-1322] Filter RowRecord automatically if any column in it is null or all columns are null * [IOTDB-1357] Compaction use append chunk merge strategy when chunk is already large * [ISSUE-3089] Make it possible for storage groups to have name with hyphen ## Miscellaneous changes * [GITHUB-3346] upgrade netty and claim exclusion for enforcer check * [IOTDB-1259] upgrade libthrift from 0.12.0/0.13.0 to 0.14.1 * Uncomment the less used configurations * Enable the configration `concurrent_writing_time_partition` The full release note is available at: https://raw.githubusercontent.com/apache/iotdb/release/0.12.1/RELEASE_NOTES.md The release is available for download at: http://iotdb.apache.org/Download Maven artifacts for JDBC driver, session SDK, TsFile SDK, Spark-connector, Hadoop-connector, Hive-connector and Flink-connector can be found at: https://search.maven.org/search?q=g:org.apache.iotdb Docker image
[ANNOUNCE] Apache IoTDB 0.11.4 released
The Apache IoTDB team is pleased to announce the release of Apache IoTDB 0.11.4. Apache IoTDB (Database for Internet of Things) is an IoT native database with high performance for data management and analysis, deployable on the edge and the cloud. This is a bug-fixed version of 0.11.3, which includes a number of improvements: * IOTDB-1303 Disable group by without aggregation function in select clause * IOTDB-1306 Fix insertion blocked caused the deadlock in memory control module * IOTDB-1308 Fix users with READ_TIMESERIES permission cannot execute group by fill queries * IOTDB-1344 Fix cannot create timeseries caused by the timeseries count doesn't reset when deleting storage group * IOTDB-1384 Some value will disappear while using group by query * IOTDB-1398 Do not select unseq files when there are uncompacted old unseq files * ISSUE-3316 Fix query result with the same time range is inconsistent in group by query * Fix TotalSeriesNumber in MManager counted twice when recovering * Fix unseq compaction throws a wrong exception if some paths are not in the file * Fix overlapped data should be consumed first exception when query * [IOTDB-1356] Separate unseq_file_num_in_each_level from selecting candidate file in unseq compaction * [IOTDB-1412] Unclear exception message thrown when executing empty InsertTabletPlan * continuous compaction in level compaction strategy when no tsfile is to be closed * support brackets with number in timeseries path The full release note is available at: https://raw.githubusercontent.com/apache/iotdb/release/0.11.4/RELEASE_NOTES.md The release is available for download at: http://iotdb.apache.org/Download Maven artifacts for JDBC driver, session SDK, TsFile SDK, Spark-connector, Hadoop-connector, Hive-connector and Flink-connector can be found at: https://search.maven.org/search?q=g:org.apache.iotdb Docker image of IoTDB server can be found at: https://hub.docker.com/r/apache/iotdb Python API package can be found at: https://pypi.org/project/apache-iotdb/ Regards, The Apache IoTDB team
[ANNOUNCE] Apache IoTDB 0.11.2 released
The Apache IoTDB team is pleased to announce the release of Apache IoTDB 0.11.2. Apache IoTDB (Database for Internet of Things) is an IoT native database with high performance for data management and analysis, deployable on the edge and the cloud. This is a bug-fixed version of 0.11.1, which includes a number of improvements: * IOTDB-1049 Fix Nullpointer exception and a delete bug in Last query * IOTDB-1060 Support full deletion for delete statement without where clause * IOTDB-1068 Fix Time series metadata cache bug * IOTDB-1069 restrict the flushing memtable number to avoid OOM when mem_control is disabled * IOTDB-1077 add insertOneDeviceRecords API in java session * IOTDB-1087 fix compaction block flush: flush do not return until compaction finished * IOTDB-1106 Delete timeseries statement will incorrectly delete other timeseries * Github issue-2137 fix grafana value-time position bug * Github issue-2169 GetObject returns String for all data types * Github issue-2240 fix Sync failed: Socket is closed by peer * Github issue-2387 The deleteData method exists in Session but not in SessionPool. * add thrift_max_frame_size in iotdb-engine.properties * Fix incorrect last result after deleting all data * Fix compaction recover block restart: IoTDB cannot restart until last compaction recover task finished * Fix compaction ignore modification file: delete does not work after compaction * print more insert error message in client * expose enablePartition parameter into iotdb-engines.properpties The full release note is available at: https://raw.githubusercontent.com/apache/iotdb/release/0.11.2/RELEASE_NOTES.md The release is available for download at: http://iotdb.apache.org/Download Maven artifacts for JDBC driver, session SDK, TsFile SDK, Spark-connector, Hadoop-connector, Hive-connector and Flink-connector can be found at: https://search.maven.org/search?q=g:org.apache.iotdb Docker image of IoTDB server can be found at: https://hub.docker.com/r/apache/iotdb Python API package can be found at: https://pypi.org/project/apache-iotdb/ Regards, The Apache IoTDB team
[ANNOUNCE] Apache IoTDB 0.11.0 released
The Apache IoTDB team is pleased to announce the release of Apache IoTDB 0.11.0. Apache IoTDB (Database for Internet of Things) is an IoT native database with high performance for data management and analysis, deployable on the edge and the cloud. This is the first release version after Apache IoTDB graduated from the incubator, which includes two big improvements: * Better memory control for writing data * Data compaction is enabled by default to accelerate queries More: * IOTDB-627 Support range deletion for timeseries * IOTDB-670 Add raw data query interface in Session * IOTDB-716 add lz4 compression * IOTDB-736 Add query performance tracing * IOTDB-776 New memory control strategy * IOTDB-813 Show storage group under given path prefix * IOTDB-848 Support order by time asc/desc * IOTDB-863 add a switch to drop ouf-of-order data * IOTDB-873 Add count devices DDL * IOTDB-876 Add count storage group DDL * IOTDB-926 Support reconnection of Session * IOTDB-941 Support 'delete storage group ' * IOTDB-968 Support time predicate in select last, e.g., select last * from root where time >= t * Support alias if it is used in query (e.g., select s1 as temp from root.a.b) * Add level compaction strategy * Enable partial insert (some failed inserted columns do not impact others) Data file format changes: * IOTDB-778 Support double/single quotation in Path * IOTDB-870 change tags and attributes output to two columns with json values The full release note is available at: https://raw.githubusercontent.com/apache/iotdb/release/0.11.0/RELEASE_NOTES.md The release is available for download at: http://iotdb.apache.org/Download Maven artifacts for JDBC driver, session SDK, TsFile SDK, Spark-connector, Hadoop-connector, Hive-connector and Flink-connector can be found at: https://search.maven.org/search?q=g:org.apache.iotdb Docker image of IoTDB server can be found at: https://hub.docker.com/r/apache/iotdb Python API package can be found at: https://pypi.org/project/apache-iotdb/ Regards, The Apache IoTDB team
[ANNOUNCE] Apache IoTDB (incubating) 0.10.1 released
The Apache IoTDB team is pleased to announce the release of Apache IoTDB (incubating) 0.10.1. Apache IoTDB (incubating) (Database for Internet of Things) is an integrated data management engine designed for timeseries data. It provides users with services for data collection, storage and analysis. The current release is a bug-fix version for IoTDB 0.10.0, which includes: * [IOTDB-797] InsertTablet deserialization from WAL error * [IOTDB-788] Can not upgrade all storage groups * [IOTDB-792] deadlock when insert while show latest timeseries * [IOTDB-794] Rename file or delete file Error in start check in Windows * [IOTDB-795] BufferUnderflowException in Hive-connector * [IOTDB-766] Do not release unclosed file reader, a small memory leak * [IOTDB-796] Concurrent Query throughput is low * Query result is not correct when some unsequence data exists * Change the default fetch size to 1 in session * [IOTDB-798] fix a set rowLimit and rowOffset bug * [IOTDB-800] Add a new config type for those parameters which could not be modified any more after the first start * [IOTDB-802] Improve "group by" query performance * [IOTDB-799] remove log visualizer tool from v0.10 * fix license-binary * [IOTDB-805] Fix BufferUnderflowException when querying TsFile stored in HDFS * python session client ver-0.10.0 * [IOTDB-808] fix bug in selfCheck() truncate * fix doc of MeasurementSchema in Tablet * [IOTDB-811] fix upgrading mlog many times when upgrading system.properties crashed * Improve IoTDB restart process * remove jol-core dependency which is introduced by hive-serde 2.8.4 * remove org.json dependency because of license compatibility * [ISSUE-1551] fix set historical version when loading additional tsfile The full release note is available at: https://raw.githubusercontent.com/ apache/incubator-iotdb/release/0.10.1/RELEASE_NOTES.md The release is available for download at: http://iotdb.apache.org/Download Maven artifacts for JDBC driver, session SDK, TsFile SDK, Spark-connector, Hadoop-connector, Hive-connector and Flink-connector can be found at: https://search.maven.org/search?q=g:org.apache.iotdb Docker image of IoTDB server can be found at: https://hub.docker.com/r/apache/iotdb Python API package can be found at: https://pypi.org/project/apache-iotdb/ Regards, The Apache IoTDB team = *Disclaimer* Apache IoTDB (incubating) is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
[ANNOUNCE] Apache IoTDB (incubating) 0.10.0 released
The Apache IoTDB team is pleased to announce the release of Apache IoTDB (incubating) 0.10.0. Apache IoTDB (incubating) (Database for Internet of Things) is an integrated data management engine designed for timeseries data. It provides users with services for data collection, storage and analysis. The current release is the 3rd major version of IoTDB, which provides many new features and improvements. A part of features are as follows: * IOTDB-217 A new GROUPBY syntax, e.g., select avg(s1) from root.sg.d1.s1 GROUP BY ([1, 50), 5ms) * IOTDB-220 Add hot-load configuration function * IOTDB-292 Add load external tsfile feature * IOTDB-298 Support new Last point query. e.g, select last * from root * IOTDB-305 Add value filter function while executing align by device * IOTDB-396 Support new query clause: disable align, e.g., select * from root disable align * IOTDB-447 Support querying non-existing measurement and constant measurement * IOTDB-448 Add IN operation, e.g., where time in (1,2,3) * IOTDB-456 Support GroupByFill Query, e.g., select last_value(s1) from root.sg.d1 GROUP BY ([1, 10), 2ms) FILL(int32[previousUntilLast]) * IOTDB-497 Support Apache Flink Connector with IoTDB * IOTDB-565 MQTT Protocol Support, disabled by default, open in iotdb-engine.properties * IOTDB-588 Add tags and attributes management * Online upgrade from 0.9.x * Make JDBC OSGi usable and added a feature file * Allow count timeseries group by level=x using default path * IOTDB-700 Add OpenID Connect based JWT Access as alternative to Username / Password * IOTDB-715 Support previous time range in previousuntillast * IOTDB-719 add avg_series_point_number_threshold in config * IOTDB-734 Add Support for NaN in Double / Floats in SQL Syntax. The full release note is available at: https://raw.githubusercontent.com/apache/incubator-iotdb/release/0.10.0/RELEASE_NOTES.md The release is available for download at: http://iotdb.apache.org/Download Maven artifacts for JDBC driver, session SDK, TsFile SDK, Spark-connector, Hadoop-connector, Hive-connector and Flink-connector can be found at: https://search.maven.org/search?q=g:org.apache.iotdb Docker image of IoTDB server can be found at: https://hub.docker.com/r/apache/iotdb Regards, The Apache IoTDB team = *Disclaimer* Apache IoTDB (incubating) is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
[ANNOUNCE] Apache IoTDB (incubating) 0.8.2 released
The Apache IoTDB team is pleased to announce the release of Apache IoTDB (incubating) 0.8.2. Apache IoTDB (incubating) (Database for Internet of Things) is an integrated data management engine designed for timeseries data. It provides users with services for data collection, storage and analysis. The current release is a bug-fix version, which fixes the following bugs: * IOTDB-264 lack checking datatype before writing WAL * IOTDB-317 Fix "flush + wrong aggregation" causes failed query in v0.8.x Visit the Apache IoTDB website [1] for general information or the downloads page [2] for release notes and download information. Regards, The Apache IoTDB team [1] http://iotdb.apache.org [2] http://iotdb.apache.org/#/Download Disclaimer Apache IoTDB (incubating) is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
[ANNOUNCE] Apache IoTDB (incubating) 0.8.1 released
The Apache IoTDB team is pleased to announce the release of Apache IoTDB (incubating) 0.8.1. Apache IoTDB (incubating) (Database for Internet of Things) is an integrated data management engine designed for timeseries data. It provides users with services for data collection, storage and analysis. The current release is a bug-fix version of 0.8.0, which will makes IoTDB more stable: - [IOTDB-172] bug in updating startTime and endTime in TsFileResource. - Abnormal publishing of sequence and unsequence data folders in DirectoryManager. - fix a bug in TimeRange's intersects function. - [IOTDB-202] fix tsfile example data type. - [IOTDB-195] Bug about 'serializedSize' in ChunkGroupMetaData.java (for Chinese string). - [IOTDB-242] fix mvn integration-test failed because the files in the target folder changes. Visit the Apache IoTDB website [1] for general information or the downloads page [2] for release notes and download information. Regards, The Apache IoTDB team [1] http://iotdb.apache.org [2] http://iotdb.apache.org/#/Download Disclaimer Apache IoTDB (incubating) is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
