Wow，so many useful features! Looking forward to the version 0.10.0.
Thanks! [email protected] From: Jialin Qiao Date: 2020-05-25 23:46 To: dev Subject: Re: [Discuss] Release of 0.10.0 Hi, The highly anticipated version 0.10.0 is coming soon! I summarize the release notes, please have a check :) # Apache IoTDB (incubating) 0.10.0 ## New Features * IOTDB-217 A new GROUPBY syntax, e.g., select avg(s1) from root.sg.d1.s1 GROUP BY ([1, 50), 5ms) * IOTDB-220 Add hot-load configuration function * IOTDB-275 allow using user defined JAVA_HOME and allow blank space in the JAVA_HOME * IOTDB-287 Allow domain in JDBC URL * IOTDB-292 Add load external tsfile feature * IOTDB-297 Support "show flush task info" * IOTDB-298 Support new Last point query. e.g, select last * from root * IOTDB-305 Add value filter function while executing align by device * IOTDB-309 add Dockerfiles for 0.8.1, 0.9.0, and 0.9.1 * IOTDB-313 Add RandomOnDiskUsableSpaceStrategy * IOTDB-323 Support insertRecords in session * IOTDB-337 Add timestamp precision properties for grafana * IOTDB-343 Add test method in session * IOTDB-396 Support new query clause: disable align, e.g., select * from root disable align * IOTDB-447 Support querying non-existing measurement and constant measurement * IOTDB-448 Add IN operation, e.g., where time in (1,2,3) * IOTDB-456 Support GroupByFill Query, e.g., select last_value(s1) from root.sg.d1 GROUP BY ([1, 10), 2ms) FILL(int32[previousUntilLast]) * IOTDB-467 The CLI displays query results in a batch manner * IOTDB-497 Support Apache Flink Connector with IoTDB * IOTDB-558 add text support for grafana * IOTDB-560 Support Apache Flink connecter with TsFile * IOTDB-565 MQTT Protocol Support, disabled by default, open in iotdb-engine.properties * IOTDB-574 Specify configuration when start iotdb * IOTDB-588 Add tags and attributes management * IOTDB-607 add batch create timeseries in native interface * IOTDB-612 add limit&offset to show timeseries * IOTDB-617 Support alter one time series's tag/attribute * IOTDB-630 Add a jdbc-like way to fetch data in session * IOTDB-640 Enable system admin sql (flush/merge) in JDBC or Other API * IOTDB-671 Add clear cache command * Support open and close time range in group by, e.g, [), (] * Online upgrade from 0.9.x * Support speical characters in path: -/+&%$#@ * IOTDB-446 Support path start with a digit, e.g., root.sg.12a * enable rpc compression in session pool * Make JDBC OSGi usable and added a feature file * Python: Support pypi distribution for Python Client ## Incompatible changes * IOTDB-138 Move All metadata query to usual query * IOTDB-322 upgrade to thrift 0.12.0-0.13.0 * IOTDB-325 Refactor Statistics in TsFile * IOTDB-419 Refactor the 'last' and 'first' aggregators to 'last_value' and 'first_value' * IOTDB-506 upgrade the rpc protocol to v2 to reject clients or servers that version < 0.10 * IOTDB-587 TsFile is upgraded to version 2 * IOTDB-593 add metaOffset in TsFileMetadata * IOTDB-597 Rename methods in Session: insertBatch to insertTablet, insertInBatch to insertRecords, insert to insertRecord * RPC is incompatible, you can not use client-v0.9 to connect with server-v0.10 * TsFile format is incompatible, will be upgraded when starting 0.10 * Refine exception code in narive api ## Miscellaneous changes * IOTDB-190 upgrade from antlr3 to antlr4 * IOTDB-418 new query engine * IOTDB-429 return empty dataset instead of throw exception, e.g., show child paths root.* * IOTDB-445 Unify the keyword of "timestamp" and "time" * IOTDB-450 Add design documents * IOTDB-498 Support date format "2020-02-10" * IOTDB-503 Add checkTimeseriesExists in java native api * IOTDB-605 Add more levels of index in TsFileMetadata for handling too many series in one device * IOTDB-625 Change default level number: root is level 0 * IOTDB-628 rename client to cli * IOTDB-621 Add Check isNull in Field for querying using session * IOTDB-632 Performance improve for PreviousFill/LinearFill * Allow "count timeseries" without a prefix path * Add max backup log file number * add rpc compression api in client and session module * Continue writing the last unclosed file * Move the vulnera-checks section into the apache-release profile to accelerate compile * Add metaquery in python example ## Bug Fixes * IOTDB-125 Potential Concurrency bug while deleting and inserting happen together * IOTDB-185 fix start-client failed on WinOS if there is blank space in the file path; let start-server.bat suport jdk12,13 etc * IOTDB-304 Fix bug of incomplete HDFS URI * IOTDB-341 Fix data type bug in grafana * IOTDB-346 Fix a bug of renaming tsfile in loading function * IOTDB-370 fix a concurrent problem in parsing sql * IOTDB-376 fix metric to show executeQuery * IOTDB-392 fix export CSV * IOTDB-393 Fix unclear error message for no privilege users * IOTDB-401 Correct the calculation of a chunk if there is no data in the chunk, do not flush empty chunk * IOTDB-412 Paths are not correctly deduplicated * IOTDB-420 Avoid encoding task dying silently * IOTDB-425 fix can't change the root password. * IOTDB-459 Fix calmem tool bug * IOTDB-470fix IllegalArgumentException when there exists 0 byte TsFile * IOTDB-529 Relative times and NOW() operator cannot be used in Group By * IOTDB-531 fix issue when grafana visualize boolean data * IOTDB-546 Fix show child paths statement doesn't show quotation marks * IOTDB-643 Concurrent queries cause BufferUnderflowException when storage in HDFS * IOTDB-663 Fix query cache OOM while executing query * IOTDB-664 Win -e option * IOTDB-669 fix getting two columns bug while ”show devices“ in session * fix concurrent auto create schema conflict bug * fix meet incompatible file error in restart * Fix bugs of set core-site.xml and hdfs-site.xml paths in HDFS storage * fix execute flush command while inserting bug * Fix sync schema pos bug * Fix batch execution bug, the following sqls will all fail after one error sql Thanks, -- Jialin Qiao School of Software, Tsinghua University 乔嘉林 清华大学 软件学院 > -----原始邮件----- > 发件人: "Xiangdong Huang" <[email protected]> > 发送时间: 2020-05-25 23:36:42 (星期一) > 收件人: [email protected] > 抄送: > 主题: Re: [Discuss] Release of 0.10.0 > > Hi all, > > Though we introduced the feature that supporting time-based data partition, > it may have some side-effect for query performance in some cases. > So, I'd like to mark this feature as experimental and disable it by > default. We can enable it by default until we fixed the performance issue > in next version. > > Then, I'd like to start to organize the change list of v0.10 with @Jialin. > > Best, > ----------------------------------- > Xiangdong Huang > School of Software, Tsinghua University > > 黄向东 > 清华大学 软件学院 > > > Xiangdong Huang <[email protected]> 于2020年5月21日周四 上午9:34写道： > > > Hi, > > > > I suggest to run a performance comparison for v0.9 and v0.10 first and > > then start the release. > > We are doing that. > > > > Best, > > ----------------------------------- > > Xiangdong Huang > > School of Software, Tsinghua University > > > > 黄向东 > > 清华大学 软件学院 > > > > > > Xiangdong Huang <[email protected]> 于2020年5月20日周三 下午3:08写道： > > > >> Hi, > >> > >> > Are there any features left that one NEEDS in 0.10 that are currently > >> in work? > >> > >> IMO, we do not need to wait for developing other features anymore before > >> releasing v0.10.0, but we can "merge as many PRs as possible" especially > >> for those bug-fix PRs. > >> > >> Best, > >> > >> ----------------------------------- > >> Xiangdong Huang > >> School of Software, Tsinghua University > >> > >> 黄向东 > >> 清华大学 软件学院 > >> > >> > >> Julian Feinauer <[email protected]> 于2020年5月20日周三 下午2:33写道： > >> > >>> Hi, > >>> > >>> I suggest to always to a release branch as best practice as it always > >>> help you if you need to create a fix release like 0.10.1 (if you want to > >>> keep working on features on master branch). > >>> But yes I agree, we should try to merge as many PRs as possible. > >>> > >>> Are there any features left that one NEEDS in 0.10 that are currently in > >>> work? > >>> > >>> Julian > >>> > >>> Am 20.05.20, 08:29 schrieb "Xiangdong Huang" <[email protected]>: > >>> > >>> Hi, > >>> > >>> The grafana issue has been fixed. > >>> > >>> As we have so many PRs opened now, we need to check when to fork a > >>> new > >>> branch rel/0.10. > >>> > >>> Actually, only one PR needs to be pay attention [1]. > >>> > >>> IMO, I want to merge it into the master ASAP to avoid more conflicts. > >>> Otherwise, there will be too many differences between rel/0.10 and > >>> master. > >>> But as it modified many codes and not all of them are tested, I am > >>> afraid > >>> whether it brings unstable factors. > >>> > >>> [1] https://github.com/apache/incubator-iotdb/pull/1169 > >>> > >>> Best, > >>> ----------------------------------- > >>> Xiangdong Huang > >>> School of Software, Tsinghua University > >>> > >>> 黄向东 > >>> 清华大学 软件学院 > >>> > >>> > >>> Julian Feinauer <[email protected]> 于2020年5月18日周一 > >>> 下午6:44写道： > >>> > >>> > Hey, > >>> > > >>> > that looks pretty cool indeed. > >>> > Has anyone tested the IoTDB Grafana Bridge? > >>> > I had issues with it at some point in master branch, not sure > >>> about the > >>> > latest version? > >>> > > >>> > But sounds really cool! > >>> > > >>> > Julian > >>> > > >>> > Am 18.05.20, 12:08 schrieb "Haonan Hou" <[email protected]>: > >>> > > >>> > Hi, > >>> > > >>> > Right now the upgrade tool for upgrading IoTDB v0.9.x to v0.10 > >>> has > >>> > been developed. We have also finished the tests about it and > >>> everything > >>> > works great. I think it’s the right time to release the v0.10.0. > >>> > > >>> > Anyone hope to be the RM of 0.10.0? > >>> > > >>> > Best, > >>> > Haonan Hou > >>> > > >>> > > >>> > >>> -- > ----------------------------------- > Xiangdong Huang > School of Software, Tsinghua University > > 黄向东 > 清华大学 软件学院
