Re: [IoTDB-164] Convert Path(String) to ID(Long)

2019-09-10 Thread Lei Rui
Hi, I am also confused about the "six times worse" when creating timeseries. Could you propose a draft pull request to IoTDB so that we can have a look at your code implementation? Sincerely, Lei Rui On 9/11/2019 09:25,安彦哲 wrote: Hi, I'm trying to solve

Re: How to use the new table schema of Spark-Connector

2019-09-10 Thread Lei Rui
Hi, The website page http://iotdb.apache.org/#/Tools/Spark does not link to the latest https://github.com/apache/incubator-iotdb/blob/master/docs/Documentation/UserGuide/9-Tools-spark.md. I'm afraid that the website is not based on the master branch. Can someone validate that? Yes I think

[IoTDB-164] Convert Path(String) to ID(Long)

2019-09-10 Thread 安彦哲
Hi, I'm trying to solve [IoTDB-164](https://issues.apache.org/jira/projects/IOTDB/issues/IOTDB-164?filter=allopenissues). To accomplish the task, I've modified the structure of MTree and replace Path(String) of several Maps with ID(Long), including latestTimeForEachDevice and

??????How to use the new table schema of Spark-Connector

2019-09-10 Thread ??????????????????????
Hi, Thanks for trying this new feature. The document of this feature is in /docs/Documentation/UserGuide/9-Tools-spark but only in scala. Should I add java version? They will be quite similar. Best, Kaifeng Xue -- -- ??: "Xiangdong Huang";

Re: How to use the new table schema of Spark-Connector

2019-09-10 Thread Xiangdong Huang
Hi, Okey.. I read the source code and find a new option called "form" is added: if we want to use the wide table, write Java codes like: ``` Dataset df = spark.read().format("org.apache.iotdb.tsfile").load("TSFILE PATH"); df.show(); ``` If we want to use the narrow table, write Java codes

How to use the new table schema of Spark-Connector

2019-09-10 Thread Xiangdong Huang
Hi, As PR[1] has been merged, but I can not find how to use the new feature from the iotdb.apache.org or even spark/Readme.md. What is more, even I read the introduction about this PR, I can only get how to use it in scala, but how to use it in Java? [1]

Re:Re:Solving jira problem (IOTDB-180) Get rid of JSON format in "show timeseries"

2019-09-10 Thread thss15_yit
I have submitted the pull request of this issue [IOTDB-180]. The link of the pull request is https://github.com/apache/incubator-iotdb/pull/387 Thanks for your checking. Tao Yi At 2019-09-09 11:30:25, "thss15_yit" wrote: >The JIRA link of this issue is

Re: Add bloom filters to TsFile

2019-09-10 Thread Julian Feinauer
Hi, I like the idea. I'm just adding Claude here as we talked yesterday about a bloom filter implementation he has already done. @cla...@apache.org what do you think? : ) Julian From: Tian Jiang Sent: Tuesday, September 10, 2019

Re: (IOTDB-209) Improvement on the Hadoop module

2019-09-10 Thread Yuan Tian
Hi, I’m working on this issue, my plan is to use the query method with partitionStartOffset and partitionEndOffset parameters and store the startOffset and endOffset in the TsInputSplit. Best, -- Yuan Tian School of Software, Tsinghua University 田原 清华大学 软件学院 > 在

[jira] [Created] (IOTDB-209) Improvement on the Hadoop module

2019-09-10 Thread Yuan Tian (Jira)
Yuan Tian created IOTDB-209: --- Summary: Improvement on the Hadoop module Key: IOTDB-209 URL: https://issues.apache.org/jira/browse/IOTDB-209 Project: Apache IoTDB Issue Type: Improvement

Add bloom filters to TsFile

2019-09-10 Thread Tian Jiang
Greetings, The recent readings remind me that the bloom filter is standard equipment in K-VDBs. Although IoTDB is not one of them (at least not typically), the bloom filter still helps a lot in various situations. For example, our recent experiments gave us an illusion that the time series

[jira] [Created] (IOTDB-208) Add bloom filters to TsFile

2019-09-10 Thread Tian Jiang (Jira)
Tian Jiang created IOTDB-208: Summary: Add bloom filters to TsFile Key: IOTDB-208 URL: https://issues.apache.org/jira/browse/IOTDB-208 Project: Apache IoTDB Issue Type: New Feature

[jira] [Created] (IOTDB-207) Bug about the method query(QueryExpression queryExpression, long partitionStartOffset, long partitionEndOffset) in ReadOnlyTsFile

2019-09-10 Thread Yuan Tian (Jira)
Yuan Tian created IOTDB-207: --- Summary: Bug about the method query(QueryExpression queryExpression, long partitionStartOffset, long partitionEndOffset) in ReadOnlyTsFile Key: IOTDB-207 URL: