Hi,

> The write into IoTDB is not implemented yet, but you can write the
dataframe into TsFile using spark-tsfile-connector.

And then.... using the load script can help you load the tsfile into an
IoTDB instance.

@zesong, can we put the minimal version requirement of Spark on our doc or
readme?

@Fernando please look forward to 0.10.0 version (not released now), which
improve the query performance hugely.

Best,
-----------------------------------
Xiangdong Huang
School of Software, Tsinghua University

 黄向东
清华大学 软件学院


Jialin Qiao <qj...@mails.tsinghua.edu.cn> 于2020年3月26日周四 上午9:30写道:

> Hi,
>
> The write into IoTDB is not implemented yet, but you can write the
> dataframe into TsFile using spark-tsfile-connector.
> TsFile is the data file format of IoTDB, just like Parquet and ORC.
>
> Here are some examples:
>
>
> http://iotdb.apache.org/document/V0.9.x/UserGuide/7-Ecosystem%20Integration/3-Spark%20TsFile.html
>
> Thanks,
> --
> Jialin Qiao
> School of Software, Tsinghua University
>
> 乔嘉林
> 清华大学 软件学院
>
> > -----原始邮件-----
> > 发件人: "Fernando Antunes" <fs.antu...@gmail.com>
> > 发送时间: 2020-03-26 02:28:36 (星期四)
> > 收件人: dev@iotdb.apache.org
> > 抄送:
> > 主题: Re: TsFile-Spark-Connector
> >
> > Zesong Sun, It works. Thanks.
> >
> > I have installed IOTDB 0.9.1, Grafana 6.7.1.1, IOTDB-Grafana, and
> Spark-IOTDB Connector.
> >
> > Successfully query IOTBD using Spark using the example into IOTDB web
> page.
> >
> >
> > scala> import org.apache.iotdb.spark.db._
> > import org.apache.iotdb.spark.db._
> >
> > scala> val df =
> spark.read.format("org.apache.iotdb.spark.db").option("url","jdbc:iotdb://xxxxx:6667/").option("sql","select
> * from root").load
> > df: org.apache.spark.sql.DataFrame = [Time: bigint,
> root.ln.wf01.wt01.status: boolean ... 1 more field]
> >
> > scala> df.printSchema()
> > root
> >  |-- Time: long (nullable = false)
> >  |-- root.ln.wf01.wt01.status: boolean (nullable = true)
> >  |-- root.ln.wf01.wt01.temperature: float (nullable = true)
> >
> >
> > scala> df.show()
> > +----+------------------------+-----------------------------+
>
> > |Time|root.ln.wf01.wt01.status|root.ln.wf01.wt01.temperature|
> > +----+------------------------+-----------------------------+
> > | 100|                    true|                         null|
> > | 200|                   false|                        20.71|
> > +----+------------------------+-----------------------------+
> >
> > A question.
> >
> > Can Spark insert data into IOTDB ?
> >
> > Could you provide same example ?
> >
> >
> >
> > > On 29 Feb 2020, at 06:29, Fernando Antunes <fs.antu...@gmail.com>
> wrote:
> > >
> > > Very good. I will try and keep in touch.
> > >
> > > Thanks. Have a ince weekend.
> > >
> > >
> > >> On 28 Feb 2020, at 22:11, 孙泽嵩 <sz...@mails.tsinghua.edu.cn> wrote:
> > >>
> > >> Hi,
> > >>
> > >> Thanks for your concern very much!
> > >>
> > >> You could use spark-iotdb / spark-tsfile connector with 2.3.2
> version. (Actually, only  < 2.2 version is not supported).
> > >>
> > >> If you meet any questions, don’t hesitate to ask and I’d like to help
> you : )
> > >>
> > >>
> > >> Best,
> > >> -----------------------------------
> > >> Zesong Sun
> > >> School of Software, Tsinghua University
> > >>
> > >> 孙泽嵩
> > >> 清华大学 软件学院
> > >>
> > >>> 2020年2月29日 03:50,Fernando Antunes <fs.antu...@gmail.com> 写道:
> > >>>
> > >>> Hi. I’ve seen that Spark 2.4.3 is one of the System Requirements to
> use this connector.
> > >>>
> > >>> I am a user of the HortonWorks/Cloudera software, and the Spark
> version is 2.3.2 and Scala 2.11.12.
> > >>>
> > >>> Give some hope, please !
> > >>>
> > >>> Is it possible to use TSFile or IoTDB with 2.3.2 version? Even with
> some limitations?
> > >>>
> > >>>
> > >>
> > >
> >
>

Reply via email to