Re: [Discuss] Release of 0.10.0

2020-06-11 Thread Xiangdong Huang
grade from 0.9.x
>>> > * Support speical characters in path: -/+&%$#@
>>> > * IOTDB-446 Support path start with a digit, e.g., root.sg.12a
>>> > * enable rpc compression in session pool
>>> > * Make JDBC OSGi usable and added a feature file
>>> > * Python: Support pypi distribution for Python Client
>>> >
>>> > ## Incompatible changes
>>> >
>>> > * IOTDB-138 Move All metadata query to usual query
>>> > * IOTDB-322 upgrade to thrift 0.12.0-0.13.0
>>> > * IOTDB-325 Refactor Statistics in TsFile
>>> > * IOTDB-419 Refactor the 'last' and 'first' aggregators to
>>> 'last_value' and 'first_value'
>>> > * IOTDB-506 upgrade the rpc protocol to v2 to reject clients or
>>> servers that version < 0.10
>>> > * IOTDB-587 TsFile is upgraded to version 2
>>> > * IOTDB-593 add metaOffset in TsFileMetadata
>>> > * IOTDB-597 Rename methods in Session: insertBatch to insertTablet,
>>> insertInBatch to insertRecords, insert to insertRecord
>>> > * RPC is incompatible, you can not use client-v0.9 to connect with
>>> server-v0.10
>>> > * TsFile format is incompatible, will be upgraded when starting 0.10
>>> > * Refine exception code in narive api
>>> >
>>> > ## Miscellaneous changes
>>> >
>>> > * IOTDB-190 upgrade from antlr3 to antlr4
>>> > * IOTDB-418 new query engine
>>> > * IOTDB-429 return empty dataset instead of throw exception, e.g.,
>>> show child paths root.*
>>> > * IOTDB-445 Unify the keyword of "timestamp" and "time"
>>> > * IOTDB-450 Add design documents
>>> > * IOTDB-498 Support date format "2020-02-10"
>>> > * IOTDB-503 Add checkTimeseriesExists in java native api
>>> > * IOTDB-605 Add more levels of index in TsFileMetadata for handling
>>> too many series in one device
>>> > * IOTDB-625 Change default level number: root is level 0
>>> > * IOTDB-628 rename client to cli
>>> > * IOTDB-621 Add Check isNull in Field for querying using session
>>> > * IOTDB-632 Performance improve for PreviousFill/LinearFill
>>> > * Allow "count timeseries" without a prefix path
>>> > * Add max backup log file number
>>> > * add rpc compression api in client and session module
>>> > * Continue writing the last unclosed file
>>> > * Move the vulnera-checks section into the apache-release profile to
>>> accelerate compile
>>> > * Add metaquery in python example
>>> >
>>> > ## Bug Fixes
>>> >
>>> > * IOTDB-125 Potential Concurrency bug while deleting and inserting
>>> happen together
>>> > * IOTDB-185 fix start-client failed on WinOS if there is blank space
>>> in the file path; let start-server.bat suport jdk12,13 etc
>>> > * IOTDB-304 Fix bug of incomplete HDFS URI
>>> > * IOTDB-341 Fix data type bug in grafana
>>> > * IOTDB-346 Fix a bug of renaming tsfile in loading function
>>> > * IOTDB-370 fix a concurrent problem in parsing sql
>>> > * IOTDB-376 fix metric to show executeQuery
>>> > * IOTDB-392 fix export CSV
>>> > * IOTDB-393 Fix unclear error message for no privilege users
>>> > * IOTDB-401 Correct the calculation of a chunk if there is no data in
>>> the chunk, do not flush empty chunk
>>> > * IOTDB-412 Paths are not correctly deduplicated
>>> > * IOTDB-420 Avoid encoding task dying silently
>>> > * IOTDB-425 fix can't change the root password.
>>> > * IOTDB-459 Fix calmem tool bug
>>> > * IOTDB-470fix IllegalArgumentException when there exists 0 byte TsFile
>>> > * IOTDB-529 Relative times and NOW() operator cannot be used in Group
>>> By
>>> > * IOTDB-531 fix issue when grafana visualize boolean data
>>> > * IOTDB-546 Fix show child paths statement doesn't show quotation
>>> marks
>>> > * IOTDB-643 Concurrent queries cause BufferUnderflowException when
>>> storage in HDFS
>>> > * IOTDB-663 Fix query cache OOM while executing query
>>> > * IOTDB-664 Win -e option
>>> > * IOTDB-669 fix getting two columns bug while ”show devices“ in session
>>> > * fix concurrent auto create schema conflict bug
>>> > * fix meet incompatible file error in restart
>>> > * Fix bugs of set core-site.xml and hdfs-site.xml paths in HDFS
>>> storage
>>> > * fix execute flu

Re: [Discuss] Release of 0.10.0

2020-05-29 Thread Xiangdong Huang
 insertRecord
>> > * RPC is incompatible, you can not use client-v0.9 to connect with
>> server-v0.10
>> > * TsFile format is incompatible, will be upgraded when starting 0.10
>> > * Refine exception code in narive api
>> >
>> > ## Miscellaneous changes
>> >
>> > * IOTDB-190 upgrade from antlr3 to antlr4
>> > * IOTDB-418 new query engine
>> > * IOTDB-429 return empty dataset instead of throw exception, e.g., show
>> child paths root.*
>> > * IOTDB-445 Unify the keyword of "timestamp" and "time"
>> > * IOTDB-450 Add design documents
>> > * IOTDB-498 Support date format "2020-02-10"
>> > * IOTDB-503 Add checkTimeseriesExists in java native api
>> > * IOTDB-605 Add more levels of index in TsFileMetadata for handling too
>> many series in one device
>> > * IOTDB-625 Change default level number: root is level 0
>> > * IOTDB-628 rename client to cli
>> > * IOTDB-621 Add Check isNull in Field for querying using session
>> > * IOTDB-632 Performance improve for PreviousFill/LinearFill
>> > * Allow "count timeseries" without a prefix path
>> > * Add max backup log file number
>> > * add rpc compression api in client and session module
>> > * Continue writing the last unclosed file
>> > * Move the vulnera-checks section into the apache-release profile to
>> accelerate compile
>> > * Add metaquery in python example
>> >
>> > ## Bug Fixes
>> >
>> > * IOTDB-125 Potential Concurrency bug while deleting and inserting
>> happen together
>> > * IOTDB-185 fix start-client failed on WinOS if there is blank space in
>> the file path; let start-server.bat suport jdk12,13 etc
>> > * IOTDB-304 Fix bug of incomplete HDFS URI
>> > * IOTDB-341 Fix data type bug in grafana
>> > * IOTDB-346 Fix a bug of renaming tsfile in loading function
>> > * IOTDB-370 fix a concurrent problem in parsing sql
>> > * IOTDB-376 fix metric to show executeQuery
>> > * IOTDB-392 fix export CSV
>> > * IOTDB-393 Fix unclear error message for no privilege users
>> > * IOTDB-401 Correct the calculation of a chunk if there is no data in
>> the chunk, do not flush empty chunk
>> > * IOTDB-412 Paths are not correctly deduplicated
>> > * IOTDB-420 Avoid encoding task dying silently
>> > * IOTDB-425 fix can't change the root password.
>> > * IOTDB-459 Fix calmem tool bug
>> > * IOTDB-470fix IllegalArgumentException when there exists 0 byte TsFile
>> > * IOTDB-529 Relative times and NOW() operator cannot be used in Group By
>> > * IOTDB-531 fix issue when grafana visualize boolean data
>> > * IOTDB-546 Fix show child paths statement doesn't show quotation marks
>> > * IOTDB-643 Concurrent queries cause BufferUnderflowException when
>> storage in HDFS
>> > * IOTDB-663 Fix query cache OOM while executing query
>> > * IOTDB-664 Win -e option
>> > * IOTDB-669 fix getting two columns bug while ”show devices“ in session
>> > * fix concurrent auto create schema conflict bug
>> > * fix meet incompatible file error in restart
>> > * Fix bugs of set core-site.xml and hdfs-site.xml paths in HDFS storage
>> > * fix execute flush command while inserting bug
>> > * Fix sync schema pos bug
>> > * Fix batch execution bug, the following sqls will all fail after one
>> error sql
>> >
>> >
>> > Thanks,
>> > --
>> > Jialin Qiao
>> > School of Software, Tsinghua University
>> >
>> > 乔嘉林
>> > 清华大学 软件学院
>> >
>> >> -原始邮件-
>> >> 发件人: "Xiangdong Huang" 
>> >> 发送时间: 2020-05-25 23:36:42 (星期一)
>> >> 收件人: dev@iotdb.apache.org
>> >> 抄送:
>> >> 主题: Re: [Discuss] Release of 0.10.0
>> >>
>> >> Hi all,
>> >>
>> >> Though we introduced the feature that supporting time-based data
>> partition,
>> >> it may have some side-effect for query performance in some cases.
>> >> So, I'd like to mark this feature as experimental and disable it by
>> >> default. We can enable it by default until we fixed the performance
>> issue
>> >> in next version.
>> >>
>> >> Then, I'd like to start to organize the change list of v0.10 with
>> @Jialin.
>> >>
>> >> Best,
>> >> ---
>> >> Xiangdong Huang
>> >> School of Software, Tsinghua University
&

Re: [Discuss] Release of 0.10.0

2020-05-26 Thread Xiangdong Huang
heckTimeseriesExists in java native api
> > * IOTDB-605 Add more levels of index in TsFileMetadata for handling too
> many series in one device
> > * IOTDB-625 Change default level number: root is level 0
> > * IOTDB-628 rename client to cli
> > * IOTDB-621 Add Check isNull in Field for querying using session
> > * IOTDB-632 Performance improve for PreviousFill/LinearFill
> > * Allow "count timeseries" without a prefix path
> > * Add max backup log file number
> > * add rpc compression api in client and session module
> > * Continue writing the last unclosed file
> > * Move the vulnera-checks section into the apache-release profile to
> accelerate compile
> > * Add metaquery in python example
> >
> > ## Bug Fixes
> >
> > * IOTDB-125 Potential Concurrency bug while deleting and inserting
> happen together
> > * IOTDB-185 fix start-client failed on WinOS if there is blank space in
> the file path; let start-server.bat suport jdk12,13 etc
> > * IOTDB-304 Fix bug of incomplete HDFS URI
> > * IOTDB-341 Fix data type bug in grafana
> > * IOTDB-346 Fix a bug of renaming tsfile in loading function
> > * IOTDB-370 fix a concurrent problem in parsing sql
> > * IOTDB-376 fix metric to show executeQuery
> > * IOTDB-392 fix export CSV
> > * IOTDB-393 Fix unclear error message for no privilege users
> > * IOTDB-401 Correct the calculation of a chunk if there is no data in
> the chunk, do not flush empty chunk
> > * IOTDB-412 Paths are not correctly deduplicated
> > * IOTDB-420 Avoid encoding task dying silently
> > * IOTDB-425 fix can't change the root password.
> > * IOTDB-459 Fix calmem tool bug
> > * IOTDB-470fix IllegalArgumentException when there exists 0 byte TsFile
> > * IOTDB-529 Relative times and NOW() operator cannot be used in Group By
> > * IOTDB-531 fix issue when grafana visualize boolean data
> > * IOTDB-546 Fix show child paths statement doesn't show quotation marks
> > * IOTDB-643 Concurrent queries cause BufferUnderflowException when
> storage in HDFS
> > * IOTDB-663 Fix query cache OOM while executing query
> > * IOTDB-664 Win -e option
> > * IOTDB-669 fix getting two columns bug while ”show devices“ in session
> > * fix concurrent auto create schema conflict bug
> > * fix meet incompatible file error in restart
> > * Fix bugs of set core-site.xml and hdfs-site.xml paths in HDFS storage
> > * fix execute flush command while inserting bug
> > * Fix sync schema pos bug
> > * Fix batch execution bug, the following sqls will all fail after one
> error sql
> >
> >
> > Thanks,
> > --
> > Jialin Qiao
> > School of Software, Tsinghua University
> >
> > 乔嘉林
> > 清华大学 软件学院
> >
> >> -原始邮件-
> >> 发件人: "Xiangdong Huang" 
> >> 发送时间: 2020-05-25 23:36:42 (星期一)
> >> 收件人: dev@iotdb.apache.org
> >> 抄送:
> >> 主题: Re: [Discuss] Release of 0.10.0
> >>
> >> Hi all,
> >>
> >> Though we introduced the feature that supporting time-based data
> partition,
> >> it may have some side-effect for query performance in some cases.
> >> So, I'd like to mark this feature as experimental and disable it by
> >> default. We can enable it by default until we fixed the performance
> issue
> >> in next version.
> >>
> >> Then, I'd like to start to organize the change list of v0.10 with
> @Jialin.
> >>
> >> Best,
> >> ---
> >> Xiangdong Huang
> >> School of Software, Tsinghua University
> >>
> >> 黄向东
> >> 清华大学 软件学院
> >>
> >>
> >> Xiangdong Huang  于2020年5月21日周四 上午9:34写道:
> >>
> >>> Hi,
> >>>
> >>> I suggest to run a performance comparison for v0.9 and v0.10 first and
> >>> then start the release.
> >>> We are doing that.
> >>>
> >>> Best,
> >>> ---
> >>> Xiangdong Huang
> >>> School of Software, Tsinghua University
> >>>
> >>> 黄向东
> >>> 清华大学 软件学院
> >>>
> >>>
> >>> Xiangdong Huang  于2020年5月20日周三 下午3:08写道:
> >>>
> >>>> Hi,
> >>>>
> >>>>> Are there any features left that one NEEDS in 0.10 that are currently
> >>>> in work?
> >>>>
> >>>> IMO, we do not need to wait for developing other features anymore
> before
> >>>> releasing v0.10.0, but we can &q

Re: [Discuss] Release of 0.10.0

2020-05-26 Thread Haonan Hou
185 fix start-client failed on WinOS if there is blank space in the 
> file path; let start-server.bat suport jdk12,13 etc
> * IOTDB-304 Fix bug of incomplete HDFS URI 
> * IOTDB-341 Fix data type bug in grafana 
> * IOTDB-346 Fix a bug of renaming tsfile in loading function 
> * IOTDB-370 fix a concurrent problem in parsing sql
> * IOTDB-376 fix metric to show executeQuery 
> * IOTDB-392 fix export CSV
> * IOTDB-393 Fix unclear error message for no privilege users
> * IOTDB-401 Correct the calculation of a chunk if there is no data in the 
> chunk, do not flush empty chunk
> * IOTDB-412 Paths are not correctly deduplicated 
> * IOTDB-420 Avoid encoding task dying silently
> * IOTDB-425 fix can't change the root password.
> * IOTDB-459 Fix calmem tool bug 
> * IOTDB-470fix IllegalArgumentException when there exists 0 byte TsFile
> * IOTDB-529 Relative times and NOW() operator cannot be used in Group By
> * IOTDB-531 fix issue when grafana visualize boolean data
> * IOTDB-546 Fix show child paths statement doesn't show quotation marks 
> * IOTDB-643 Concurrent queries cause BufferUnderflowException when storage in 
> HDFS
> * IOTDB-663 Fix query cache OOM while executing query
> * IOTDB-664 Win -e option
> * IOTDB-669 fix getting two columns bug while ”show devices“ in session
> * fix concurrent auto create schema conflict bug
> * fix meet incompatible file error in restart 
> * Fix bugs of set core-site.xml and hdfs-site.xml paths in HDFS storage 
> * fix execute flush command while inserting bug
> * Fix sync schema pos bug
> * Fix batch execution bug, the following sqls will all fail after one error 
> sql
> 
> 
> Thanks,
> --
> Jialin Qiao
> School of Software, Tsinghua University
> 
> 乔嘉林
> 清华大学 软件学院
> 
>> -原始邮件-
>> 发件人: "Xiangdong Huang" 
>> 发送时间: 2020-05-25 23:36:42 (星期一)
>> 收件人: dev@iotdb.apache.org
>> 抄送: 
>> 主题: Re: [Discuss] Release of 0.10.0
>> 
>> Hi all,
>> 
>> Though we introduced the feature that supporting time-based data partition,
>> it may have some side-effect for query performance in some cases.
>> So, I'd like to mark this feature as experimental and disable it by
>> default. We can enable it by default until we fixed the performance issue
>> in next version.
>> 
>> Then, I'd like to start to organize the change list of v0.10 with @Jialin.
>> 
>> Best,
>> ---
>> Xiangdong Huang
>> School of Software, Tsinghua University
>> 
>> 黄向东
>> 清华大学 软件学院
>> 
>> 
>> Xiangdong Huang  于2020年5月21日周四 上午9:34写道:
>> 
>>> Hi,
>>> 
>>> I suggest to run a performance comparison for v0.9 and v0.10 first and
>>> then start the release.
>>> We are doing that.
>>> 
>>> Best,
>>> ---
>>> Xiangdong Huang
>>> School of Software, Tsinghua University
>>> 
>>> 黄向东
>>> 清华大学 软件学院
>>> 
>>> 
>>> Xiangdong Huang  于2020年5月20日周三 下午3:08写道:
>>> 
>>>> Hi,
>>>> 
>>>>> Are there any features left that one NEEDS in 0.10 that are currently
>>>> in work?
>>>> 
>>>> IMO, we do not need to wait for developing other features anymore before
>>>> releasing v0.10.0, but we can "merge as many PRs as possible" especially
>>>> for those bug-fix PRs.
>>>> 
>>>> Best,
>>>> 
>>>> ---
>>>> Xiangdong Huang
>>>> School of Software, Tsinghua University
>>>> 
>>>> 黄向东
>>>> 清华大学 软件学院
>>>> 
>>>> 
>>>> Julian Feinauer  于2020年5月20日周三 下午2:33写道:
>>>> 
>>>>> Hi,
>>>>> 
>>>>> I suggest to always to a release branch as best practice as it always
>>>>> help you if you need to create a fix release like 0.10.1 (if you want to
>>>>> keep working on features on master branch).
>>>>> But yes I agree, we should try to merge as many PRs as possible.
>>>>> 
>>>>> Are there any features left that one NEEDS in 0.10 that are currently in
>>>>> work?
>>>>> 
>>>>> Julian
>>>>> 
>>>>> Am 20.05.20, 08:29 schrieb "Xiangdong Huang" :
>>>>> 
>>>>>Hi,
>>>>> 
>>>>>The grafana issue has been fixed.
>>>>> 
>>>>>As we have so many PRs opened now, we need to check when to fork a
&

Re: [Discuss] Release of 0.10.0

2020-05-26 Thread Jialin Qiao
Hi,

I prefer to disable the data partition by default in 0.10.0, and do not allowed 
to enabled. So there is only one partition 0 in 0.10.0.

The partition feature has no advantages for a single node IoTDB. We could open 
this feature after refine the memory control or even with the release
 of distributed version.

Thanks,
--
Jialin Qiao
School of Software, Tsinghua University

乔嘉林
清华大学 软件学院

> -原始邮件-
> 发件人: "孙泽嵩" 
> 发送时间: 2020-05-26 09:44:05 (星期二)
> 收件人: dev@iotdb.apache.org
> 抄送: 
> 主题: Re: [Discuss] Release of 0.10.0
> 
> Hi,
> 
> I totally support treat time-based data partition as an experimental feature 
> in 0.10.0.
> 
> Thanks Jialin for organizing such a long feature list!
> 
> Really looking forward to 0.10.0 : )
> 
> Best,
> ---
> Zesong Sun
> School of Software, Tsinghua University
> 
> 孙泽嵩
> 清华大学 软件学院
> 
> > 2020年5月26日 09:20,runhus...@foxmail.com 写道:
> > 
> > Wow,so many useful features! Looking forward to the version 0.10.0.
> > 
> > 
> > 
> > Thanks!
> > 
> > runhus...@foxmail.com 
> > 
> > 
> > From: Jialin Qiao
> > Date: 2020-05-25 23:46
> > To: dev
> > Subject: Re: [Discuss] Release of 0.10.0
> > Hi,
> > 
> > The highly anticipated version 0.10.0 is coming soon!
> > 
> > I summarize the release notes, please have a check :)
> > 
> > # Apache IoTDB (incubating) 0.10.0
> > 
> > ## New Features
> > 
> > * IOTDB-217 A new GROUPBY syntax, e.g., select avg(s1) from root.sg.d1.s1 
> > GROUP BY ([1, 50), 5ms)
> > * IOTDB-220 Add hot-load configuration function
> > * IOTDB-275 allow using user defined JAVA_HOME and allow blank space in the 
> > JAVA_HOME
> > * IOTDB-287 Allow domain in JDBC URL
> > * IOTDB-292 Add load external tsfile feature 
> > * IOTDB-297 Support "show flush task info"
> > * IOTDB-298 Support new Last point query. e.g, select last * from root
> > * IOTDB-305 Add value filter function while executing align by device
> > * IOTDB-309 add Dockerfiles for 0.8.1, 0.9.0, and 0.9.1
> > * IOTDB-313 Add RandomOnDiskUsableSpaceStrategy 
> > * IOTDB-323 Support insertRecords in session
> > * IOTDB-337 Add timestamp precision properties for grafana
> > * IOTDB-343 Add test method in session
> > * IOTDB-396 Support new query clause: disable align, e.g., select * from 
> > root disable align
> > * IOTDB-447 Support querying non-existing measurement and constant 
> > measurement
> > * IOTDB-448 Add IN operation, e.g., where time in (1,2,3)
> > * IOTDB-456 Support GroupByFill Query, e.g., select last_value(s1) from 
> > root.sg.d1 GROUP BY ([1, 10), 2ms) FILL(int32[previousUntilLast])
> > * IOTDB-467 The CLI displays query results in a batch manner 
> > * IOTDB-497 Support Apache Flink Connector with IoTDB 
> > * IOTDB-558 add text support for grafana
> > * IOTDB-560 Support Apache Flink connecter with TsFile
> > * IOTDB-565 MQTT Protocol Support, disabled by default, open in 
> > iotdb-engine.properties
> > * IOTDB-574 Specify configuration when start iotdb 
> > * IOTDB-588 Add tags and attributes management 
> > * IOTDB-607 add batch create timeseries in native interface
> > * IOTDB-612 add limit to show timeseries
> > * IOTDB-617 Support alter one time series's tag/attribute
> > * IOTDB-630 Add a jdbc-like way to fetch data in session
> > * IOTDB-640 Enable system admin sql (flush/merge) in JDBC or Other API
> > * IOTDB-671 Add clear cache command
> > * Support open and close time range in group by, e.g, [), (]
> > * Online upgrade from 0.9.x
> > * Support speical characters in path: -/+&%$#@ 
> > * IOTDB-446 Support path start with a digit, e.g., root.sg.12a
> > * enable rpc compression in session pool 
> > * Make JDBC OSGi usable and added a feature file 
> > * Python: Support pypi distribution for Python Client
> > 
> > ## Incompatible changes
> > 
> > * IOTDB-138 Move All metadata query to usual query
> > * IOTDB-322 upgrade to thrift 0.12.0-0.13.0
> > * IOTDB-325 Refactor Statistics in TsFile
> > * IOTDB-419 Refactor the 'last' and 'first' aggregators to 'last_value' and 
> > 'first_value'
> > * IOTDB-506 upgrade the rpc protocol to v2 to reject clients or servers 
> > that version < 0.10
> > * IOTDB-587 TsFile is upgraded to version 2
> > * IOTDB-593 add metaOffset in TsFileMetadata
> > * IOTDB-597 Rename methods in Session: insertBatch to insertTablet, 
> > insertInBatch to insertRecords, insert to insertRecord
> > * RPC is incompatible, you can not use c

Re: [Discuss] Release of 0.10.0

2020-05-25 Thread 孙泽嵩
Hi,

I totally support treat time-based data partition as an experimental feature in 
0.10.0.

Thanks Jialin for organizing such a long feature list!

Really looking forward to 0.10.0 : )

Best,
---
Zesong Sun
School of Software, Tsinghua University

孙泽嵩
清华大学 软件学院

> 2020年5月26日 09:20,runhus...@foxmail.com 写道:
> 
> Wow,so many useful features! Looking forward to the version 0.10.0.
> 
> 
> 
> Thanks!
> 
> runhus...@foxmail.com 
> 
> 
> From: Jialin Qiao
> Date: 2020-05-25 23:46
> To: dev
> Subject: Re: [Discuss] Release of 0.10.0
> Hi,
> 
> The highly anticipated version 0.10.0 is coming soon!
> 
> I summarize the release notes, please have a check :)
> 
> # Apache IoTDB (incubating) 0.10.0
> 
> ## New Features
> 
> * IOTDB-217 A new GROUPBY syntax, e.g., select avg(s1) from root.sg.d1.s1 
> GROUP BY ([1, 50), 5ms)
> * IOTDB-220 Add hot-load configuration function
> * IOTDB-275 allow using user defined JAVA_HOME and allow blank space in the 
> JAVA_HOME
> * IOTDB-287 Allow domain in JDBC URL
> * IOTDB-292 Add load external tsfile feature 
> * IOTDB-297 Support "show flush task info"
> * IOTDB-298 Support new Last point query. e.g, select last * from root
> * IOTDB-305 Add value filter function while executing align by device
> * IOTDB-309 add Dockerfiles for 0.8.1, 0.9.0, and 0.9.1
> * IOTDB-313 Add RandomOnDiskUsableSpaceStrategy 
> * IOTDB-323 Support insertRecords in session
> * IOTDB-337 Add timestamp precision properties for grafana
> * IOTDB-343 Add test method in session
> * IOTDB-396 Support new query clause: disable align, e.g., select * from root 
> disable align
> * IOTDB-447 Support querying non-existing measurement and constant measurement
> * IOTDB-448 Add IN operation, e.g., where time in (1,2,3)
> * IOTDB-456 Support GroupByFill Query, e.g., select last_value(s1) from 
> root.sg.d1 GROUP BY ([1, 10), 2ms) FILL(int32[previousUntilLast])
> * IOTDB-467 The CLI displays query results in a batch manner 
> * IOTDB-497 Support Apache Flink Connector with IoTDB 
> * IOTDB-558 add text support for grafana
> * IOTDB-560 Support Apache Flink connecter with TsFile
> * IOTDB-565 MQTT Protocol Support, disabled by default, open in 
> iotdb-engine.properties
> * IOTDB-574 Specify configuration when start iotdb 
> * IOTDB-588 Add tags and attributes management 
> * IOTDB-607 add batch create timeseries in native interface
> * IOTDB-612 add limit to show timeseries
> * IOTDB-617 Support alter one time series's tag/attribute
> * IOTDB-630 Add a jdbc-like way to fetch data in session
> * IOTDB-640 Enable system admin sql (flush/merge) in JDBC or Other API
> * IOTDB-671 Add clear cache command
> * Support open and close time range in group by, e.g, [), (]
> * Online upgrade from 0.9.x
> * Support speical characters in path: -/+&%$#@ 
> * IOTDB-446 Support path start with a digit, e.g., root.sg.12a
> * enable rpc compression in session pool 
> * Make JDBC OSGi usable and added a feature file 
> * Python: Support pypi distribution for Python Client
> 
> ## Incompatible changes
> 
> * IOTDB-138 Move All metadata query to usual query
> * IOTDB-322 upgrade to thrift 0.12.0-0.13.0
> * IOTDB-325 Refactor Statistics in TsFile
> * IOTDB-419 Refactor the 'last' and 'first' aggregators to 'last_value' and 
> 'first_value'
> * IOTDB-506 upgrade the rpc protocol to v2 to reject clients or servers that 
> version < 0.10
> * IOTDB-587 TsFile is upgraded to version 2
> * IOTDB-593 add metaOffset in TsFileMetadata
> * IOTDB-597 Rename methods in Session: insertBatch to insertTablet, 
> insertInBatch to insertRecords, insert to insertRecord
> * RPC is incompatible, you can not use client-v0.9 to connect with 
> server-v0.10
> * TsFile format is incompatible, will be upgraded when starting 0.10
> * Refine exception code in narive api
> 
> ## Miscellaneous changes
> 
> * IOTDB-190 upgrade from antlr3 to antlr4 
> * IOTDB-418 new query engine
> * IOTDB-429 return empty dataset instead of throw exception, e.g., show child 
> paths root.*
> * IOTDB-445 Unify the keyword of "timestamp" and "time"
> * IOTDB-450 Add design documents
> * IOTDB-498 Support date format "2020-02-10"
> * IOTDB-503 Add checkTimeseriesExists in java native api
> * IOTDB-605 Add more levels of index in TsFileMetadata for handling too many 
> series in one device
> * IOTDB-625 Change default level number: root is level 0
> * IOTDB-628 rename client to cli
> * IOTDB-621 Add Check isNull in Field for querying using session
> * IOTDB-632 Performance improve for PreviousFill/LinearFill
> * Allow "count timeseries" without a prefix path
> * Add max backup log file number

Re: [Discuss] Release of 0.10.0

2020-05-25 Thread Jialin Qiao
em tool bug 
* IOTDB-470fix IllegalArgumentException when there exists 0 byte TsFile
* IOTDB-529 Relative times and NOW() operator cannot be used in Group By
* IOTDB-531 fix issue when grafana visualize boolean data
* IOTDB-546 Fix show child paths statement doesn't show quotation marks 
* IOTDB-643 Concurrent queries cause BufferUnderflowException when storage in 
HDFS
* IOTDB-663 Fix query cache OOM while executing query
* IOTDB-664 Win -e option
* IOTDB-669 fix getting two columns bug while ”show devices“ in session
* fix concurrent auto create schema conflict bug
* fix meet incompatible file error in restart 
* Fix bugs of set core-site.xml and hdfs-site.xml paths in HDFS storage 
* fix execute flush command while inserting bug
* Fix sync schema pos bug
* Fix batch execution bug, the following sqls will all fail after one error sql


Thanks,
--
Jialin Qiao
School of Software, Tsinghua University

乔嘉林
清华大学 软件学院

> -原始邮件-
> 发件人: "Xiangdong Huang" 
> 发送时间: 2020-05-25 23:36:42 (星期一)
> 收件人: dev@iotdb.apache.org
> 抄送: 
> 主题: Re: [Discuss] Release of 0.10.0
> 
> Hi all,
> 
> Though we introduced the feature that supporting time-based data partition,
> it may have some side-effect for query performance in some cases.
> So, I'd like to mark this feature as experimental and disable it by
> default. We can enable it by default until we fixed the performance issue
> in next version.
> 
> Then, I'd like to start to organize the change list of v0.10 with @Jialin.
> 
> Best,
> ---
> Xiangdong Huang
> School of Software, Tsinghua University
> 
>  黄向东
> 清华大学 软件学院
> 
> 
> Xiangdong Huang  于2020年5月21日周四 上午9:34写道:
> 
> > Hi,
> >
> > I suggest to run a performance comparison for v0.9 and v0.10 first and
> > then start the release.
> > We are doing that.
> >
> > Best,
> > ---
> > Xiangdong Huang
> > School of Software, Tsinghua University
> >
> >  黄向东
> > 清华大学 软件学院
> >
> >
> > Xiangdong Huang  于2020年5月20日周三 下午3:08写道:
> >
> >> Hi,
> >>
> >> > Are there any features left that one NEEDS in 0.10 that are currently
> >> in work?
> >>
> >> IMO, we do not need to wait for developing other features anymore before
> >> releasing v0.10.0, but we can "merge as many PRs as possible" especially
> >> for those bug-fix PRs.
> >>
> >> Best,
> >>
> >> ---
> >> Xiangdong Huang
> >> School of Software, Tsinghua University
> >>
> >>  黄向东
> >> 清华大学 软件学院
> >>
> >>
> >> Julian Feinauer  于2020年5月20日周三 下午2:33写道:
> >>
> >>> Hi,
> >>>
> >>> I suggest to always to a release branch as best practice as it always
> >>> help you if you need to create a fix release like 0.10.1 (if you want to
> >>> keep working on features on master branch).
> >>> But yes I agree, we should try to merge as many PRs as possible.
> >>>
> >>> Are there any features left that one NEEDS in 0.10 that are currently in
> >>> work?
> >>>
> >>> Julian
> >>>
> >>> Am 20.05.20, 08:29 schrieb "Xiangdong Huang" :
> >>>
> >>> Hi,
> >>>
> >>> The grafana issue has been fixed.
> >>>
> >>> As we have so many PRs opened now, we need to check when to fork a
> >>> new
> >>> branch rel/0.10.
> >>>
> >>> Actually, only one PR needs to be pay attention [1].
> >>>
> >>> IMO, I want to merge it into the master ASAP to avoid more conflicts.
> >>> Otherwise, there will be  too many differences between rel/0.10 and
> >>> master.
> >>> But as it modified many codes and not all of them are tested, I am
> >>> afraid
> >>> whether it brings unstable factors.
> >>>
> >>> [1] https://github.com/apache/incubator-iotdb/pull/1169
> >>>
> >>> Best,
> >>> ---
> >>> Xiangdong Huang
> >>> School of Software, Tsinghua University
> >>>
> >>>  黄向东
> >>> 清华大学 软件学院
> >>>
> >>>
> >>> Julian Feinauer  于2020年5月18日周一
> >>> 下午6:44写道:
> >>>
> >>> > Hey,
> >>> >
> >>> > that looks pretty cool indeed.
> >>> > Has anyone tested the IoTDB Grafana Bridge?
> >>> > I had issues with it at some point in master branch, not sure
> >>> about the
> >>> > latest version?
> >>> >
> >>> > But sounds really cool!
> >>> >
> >>> > Julian
> >>> >
> >>> > Am 18.05.20, 12:08 schrieb "Haonan Hou" :
> >>> >
> >>> > Hi,
> >>> >
> >>> > Right now the upgrade tool for upgrading IoTDB v0.9.x to v0.10
> >>> has
> >>> > been developed. We have also finished the tests about it and
> >>> everything
> >>> > works great. I think it’s the right time to release the v0.10.0.
> >>> >
> >>> > Anyone hope to be the RM of 0.10.0?
> >>> >
> >>> > Best,
> >>> > Haonan Hou
> >>> >
> >>> >
> >>>
> >>> --
> ---
> Xiangdong Huang
> School of Software, Tsinghua University
> 
>  黄向东
> 清华大学 软件学院


Re: [Discuss] Release of 0.10.0

2020-05-25 Thread Xiangdong Huang
Hi all,

Though we introduced the feature that supporting time-based data partition,
it may have some side-effect for query performance in some cases.
So, I'd like to mark this feature as experimental and disable it by
default. We can enable it by default until we fixed the performance issue
in next version.

Then, I'd like to start to organize the change list of v0.10 with @Jialin.

Best,
---
Xiangdong Huang
School of Software, Tsinghua University

 黄向东
清华大学 软件学院


Xiangdong Huang  于2020年5月21日周四 上午9:34写道:

> Hi,
>
> I suggest to run a performance comparison for v0.9 and v0.10 first and
> then start the release.
> We are doing that.
>
> Best,
> ---
> Xiangdong Huang
> School of Software, Tsinghua University
>
>  黄向东
> 清华大学 软件学院
>
>
> Xiangdong Huang  于2020年5月20日周三 下午3:08写道:
>
>> Hi,
>>
>> > Are there any features left that one NEEDS in 0.10 that are currently
>> in work?
>>
>> IMO, we do not need to wait for developing other features anymore before
>> releasing v0.10.0, but we can "merge as many PRs as possible" especially
>> for those bug-fix PRs.
>>
>> Best,
>>
>> ---
>> Xiangdong Huang
>> School of Software, Tsinghua University
>>
>>  黄向东
>> 清华大学 软件学院
>>
>>
>> Julian Feinauer  于2020年5月20日周三 下午2:33写道:
>>
>>> Hi,
>>>
>>> I suggest to always to a release branch as best practice as it always
>>> help you if you need to create a fix release like 0.10.1 (if you want to
>>> keep working on features on master branch).
>>> But yes I agree, we should try to merge as many PRs as possible.
>>>
>>> Are there any features left that one NEEDS in 0.10 that are currently in
>>> work?
>>>
>>> Julian
>>>
>>> Am 20.05.20, 08:29 schrieb "Xiangdong Huang" :
>>>
>>> Hi,
>>>
>>> The grafana issue has been fixed.
>>>
>>> As we have so many PRs opened now, we need to check when to fork a
>>> new
>>> branch rel/0.10.
>>>
>>> Actually, only one PR needs to be pay attention [1].
>>>
>>> IMO, I want to merge it into the master ASAP to avoid more conflicts.
>>> Otherwise, there will be  too many differences between rel/0.10 and
>>> master.
>>> But as it modified many codes and not all of them are tested, I am
>>> afraid
>>> whether it brings unstable factors.
>>>
>>> [1] https://github.com/apache/incubator-iotdb/pull/1169
>>>
>>> Best,
>>> ---
>>> Xiangdong Huang
>>> School of Software, Tsinghua University
>>>
>>>  黄向东
>>> 清华大学 软件学院
>>>
>>>
>>> Julian Feinauer  于2020年5月18日周一
>>> 下午6:44写道:
>>>
>>> > Hey,
>>> >
>>> > that looks pretty cool indeed.
>>> > Has anyone tested the IoTDB Grafana Bridge?
>>> > I had issues with it at some point in master branch, not sure
>>> about the
>>> > latest version?
>>> >
>>> > But sounds really cool!
>>> >
>>> > Julian
>>> >
>>> > Am 18.05.20, 12:08 schrieb "Haonan Hou" :
>>> >
>>> > Hi,
>>> >
>>> > Right now the upgrade tool for upgrading IoTDB v0.9.x to v0.10
>>> has
>>> > been developed. We have also finished the tests about it and
>>> everything
>>> > works great. I think it’s the right time to release the v0.10.0.
>>> >
>>> > Anyone hope to be the RM of 0.10.0?
>>> >
>>> > Best,
>>> > Haonan Hou
>>> >
>>> >
>>>
>>> --
---
Xiangdong Huang
School of Software, Tsinghua University

 黄向东
清华大学 软件学院


Re: [Discuss] Release of 0.10.0

2020-05-20 Thread Xiangdong Huang
Hi,

I suggest to run a performance comparison for v0.9 and v0.10 first and then
start the release.
We are doing that.

Best,
---
Xiangdong Huang
School of Software, Tsinghua University

 黄向东
清华大学 软件学院


Xiangdong Huang  于2020年5月20日周三 下午3:08写道:

> Hi,
>
> > Are there any features left that one NEEDS in 0.10 that are currently in
> work?
>
> IMO, we do not need to wait for developing other features anymore before
> releasing v0.10.0, but we can "merge as many PRs as possible" especially
> for those bug-fix PRs.
>
> Best,
>
> ---
> Xiangdong Huang
> School of Software, Tsinghua University
>
>  黄向东
> 清华大学 软件学院
>
>
> Julian Feinauer  于2020年5月20日周三 下午2:33写道:
>
>> Hi,
>>
>> I suggest to always to a release branch as best practice as it always
>> help you if you need to create a fix release like 0.10.1 (if you want to
>> keep working on features on master branch).
>> But yes I agree, we should try to merge as many PRs as possible.
>>
>> Are there any features left that one NEEDS in 0.10 that are currently in
>> work?
>>
>> Julian
>>
>> Am 20.05.20, 08:29 schrieb "Xiangdong Huang" :
>>
>> Hi,
>>
>> The grafana issue has been fixed.
>>
>> As we have so many PRs opened now, we need to check when to fork a new
>> branch rel/0.10.
>>
>> Actually, only one PR needs to be pay attention [1].
>>
>> IMO, I want to merge it into the master ASAP to avoid more conflicts.
>> Otherwise, there will be  too many differences between rel/0.10 and
>> master.
>> But as it modified many codes and not all of them are tested, I am
>> afraid
>> whether it brings unstable factors.
>>
>> [1] https://github.com/apache/incubator-iotdb/pull/1169
>>
>> Best,
>> ---
>> Xiangdong Huang
>> School of Software, Tsinghua University
>>
>>  黄向东
>> 清华大学 软件学院
>>
>>
>> Julian Feinauer  于2020年5月18日周一
>> 下午6:44写道:
>>
>> > Hey,
>> >
>> > that looks pretty cool indeed.
>> > Has anyone tested the IoTDB Grafana Bridge?
>> > I had issues with it at some point in master branch, not sure about
>> the
>> > latest version?
>> >
>> > But sounds really cool!
>> >
>> > Julian
>> >
>> > Am 18.05.20, 12:08 schrieb "Haonan Hou" :
>> >
>> > Hi,
>> >
>> > Right now the upgrade tool for upgrading IoTDB v0.9.x to v0.10
>> has
>> > been developed. We have also finished the tests about it and
>> everything
>> > works great. I think it’s the right time to release the v0.10.0.
>> >
>> > Anyone hope to be the RM of 0.10.0?
>> >
>> > Best,
>> > Haonan Hou
>> >
>> >
>>
>>


Re: [Discuss] Release of 0.10.0

2020-05-20 Thread Xiangdong Huang
Hi,

> Are there any features left that one NEEDS in 0.10 that are currently in
work?

IMO, we do not need to wait for developing other features anymore before
releasing v0.10.0, but we can "merge as many PRs as possible" especially
for those bug-fix PRs.

Best,

---
Xiangdong Huang
School of Software, Tsinghua University

 黄向东
清华大学 软件学院


Julian Feinauer  于2020年5月20日周三 下午2:33写道:

> Hi,
>
> I suggest to always to a release branch as best practice as it always help
> you if you need to create a fix release like 0.10.1 (if you want to keep
> working on features on master branch).
> But yes I agree, we should try to merge as many PRs as possible.
>
> Are there any features left that one NEEDS in 0.10 that are currently in
> work?
>
> Julian
>
> Am 20.05.20, 08:29 schrieb "Xiangdong Huang" :
>
> Hi,
>
> The grafana issue has been fixed.
>
> As we have so many PRs opened now, we need to check when to fork a new
> branch rel/0.10.
>
> Actually, only one PR needs to be pay attention [1].
>
> IMO, I want to merge it into the master ASAP to avoid more conflicts.
> Otherwise, there will be  too many differences between rel/0.10 and
> master.
> But as it modified many codes and not all of them are tested, I am
> afraid
> whether it brings unstable factors.
>
> [1] https://github.com/apache/incubator-iotdb/pull/1169
>
> Best,
> ---
> Xiangdong Huang
> School of Software, Tsinghua University
>
>  黄向东
> 清华大学 软件学院
>
>
> Julian Feinauer  于2020年5月18日周一 下午6:44写道:
>
> > Hey,
> >
> > that looks pretty cool indeed.
> > Has anyone tested the IoTDB Grafana Bridge?
> > I had issues with it at some point in master branch, not sure about
> the
> > latest version?
> >
> > But sounds really cool!
> >
> > Julian
> >
> > Am 18.05.20, 12:08 schrieb "Haonan Hou" :
> >
> > Hi,
> >
> > Right now the upgrade tool for upgrading IoTDB v0.9.x to v0.10
> has
> > been developed. We have also finished the tests about it and
> everything
> > works great. I think it’s the right time to release the v0.10.0.
> >
> > Anyone hope to be the RM of 0.10.0?
> >
> > Best,
> > Haonan Hou
> >
> >
>
>


Re: [Discuss] Release of 0.10.0

2020-05-20 Thread Julian Feinauer
Hi,

I suggest to always to a release branch as best practice as it always help you 
if you need to create a fix release like 0.10.1 (if you want to keep working on 
features on master branch).
But yes I agree, we should try to merge as many PRs as possible.

Are there any features left that one NEEDS in 0.10 that are currently in work?

Julian

Am 20.05.20, 08:29 schrieb "Xiangdong Huang" :

Hi,

The grafana issue has been fixed.

As we have so many PRs opened now, we need to check when to fork a new
branch rel/0.10.

Actually, only one PR needs to be pay attention [1].

IMO, I want to merge it into the master ASAP to avoid more conflicts.
Otherwise, there will be  too many differences between rel/0.10 and master.
But as it modified many codes and not all of them are tested, I am afraid
whether it brings unstable factors.

[1] https://github.com/apache/incubator-iotdb/pull/1169

Best,
---
Xiangdong Huang
School of Software, Tsinghua University

 黄向东
清华大学 软件学院


Julian Feinauer  于2020年5月18日周一 下午6:44写道:

> Hey,
>
> that looks pretty cool indeed.
> Has anyone tested the IoTDB Grafana Bridge?
> I had issues with it at some point in master branch, not sure about the
> latest version?
>
> But sounds really cool!
>
> Julian
>
> Am 18.05.20, 12:08 schrieb "Haonan Hou" :
>
> Hi,
>
> Right now the upgrade tool for upgrading IoTDB v0.9.x to v0.10 has
> been developed. We have also finished the tests about it and everything
> works great. I think it’s the right time to release the v0.10.0.
>
> Anyone hope to be the RM of 0.10.0?
>
> Best,
> Haonan Hou
>
>



Re: [Discuss] Release of 0.10.0

2020-05-20 Thread Xiangdong Huang
Hi,

The grafana issue has been fixed.

As we have so many PRs opened now, we need to check when to fork a new
branch rel/0.10.

Actually, only one PR needs to be pay attention [1].

IMO, I want to merge it into the master ASAP to avoid more conflicts.
Otherwise, there will be  too many differences between rel/0.10 and master.
But as it modified many codes and not all of them are tested, I am afraid
whether it brings unstable factors.

[1] https://github.com/apache/incubator-iotdb/pull/1169

Best,
---
Xiangdong Huang
School of Software, Tsinghua University

 黄向东
清华大学 软件学院


Julian Feinauer  于2020年5月18日周一 下午6:44写道:

> Hey,
>
> that looks pretty cool indeed.
> Has anyone tested the IoTDB Grafana Bridge?
> I had issues with it at some point in master branch, not sure about the
> latest version?
>
> But sounds really cool!
>
> Julian
>
> Am 18.05.20, 12:08 schrieb "Haonan Hou" :
>
> Hi,
>
> Right now the upgrade tool for upgrading IoTDB v0.9.x to v0.10 has
> been developed. We have also finished the tests about it and everything
> works great. I think it’s the right time to release the v0.10.0.
>
> Anyone hope to be the RM of 0.10.0?
>
> Best,
> Haonan Hou
>
>


Re: [Discuss] Release of 0.10.0

2020-05-18 Thread Julian Feinauer
Hey,

that looks pretty cool indeed.
Has anyone tested the IoTDB Grafana Bridge? 
I had issues with it at some point in master branch, not sure about the latest 
version?

But sounds really cool!

Julian

Am 18.05.20, 12:08 schrieb "Haonan Hou" :

Hi, 

Right now the upgrade tool for upgrading IoTDB v0.9.x to v0.10 has been 
developed. We have also finished the tests about it and everything works great. 
I think it’s the right time to release the v0.10.0. 

Anyone hope to be the RM of 0.10.0?

Best,
Haonan Hou



[Discuss] Release of 0.10.0

2020-05-18 Thread Haonan Hou
Hi, 

Right now the upgrade tool for upgrading IoTDB v0.9.x to v0.10 has been 
developed. We have also finished the tests about it and everything works great. 
I think it’s the right time to release the v0.10.0. 

Anyone hope to be the RM of 0.10.0?

Best,
Haonan Hou