Hi, Sorry, I also miss this email..
I read the design doc and it looks good! Just one question, in the "Write Sequence Diagram", the TSRecordConverter and TSRecordCollector issue the write to TsFileWriter. But in the "Batch Write Sequence Diagram", the RowBatchOutputFormat issues the write command to TsFileWriter. What's the difference between them? Intuitively, the Converter is a tool and the collector is a data buffer. So, should the write/flush commands should be issued either by a Writer or the OutputFormat? Thanks, -- Jialin Qiao School of Software, Tsinghua University 乔嘉林 清华大学 软件学院 > -----原始邮件----- > 发件人: "jincheng sun" <[email protected]> > 发送时间: 2020-03-12 10:30:50 (星期四) > 收件人: [email protected] > 抄送: > 主题: Re: [DISCUSS] Add Flink Connector Support for TsFile > > Hi folks, > > I would like to bring up the VOTE thread as there no objections feedback > both in mailing list and design doc for a long time. > > Best, > Jincheng > > > > jincheng sun <[email protected]> 于2020年2月28日周五 下午11:01写道： > > > Hi folks, > > > > TsFile is a columnar storage file format in Apache IoTDB. It is designed > > for time series data and supports efficient compression and query and is > > easy to be integrated into big data processing frameworks. > > > > Apache Flink is a framework and distributed processing engine for stateful > > computations over unbounded and bounded data streams and becoming more and > > more popular in IOT scenes. So, it would be great to integrate IoTDB and > > Flink. > > > > I would like to introduce the TsFile Flink Connector, i.e., allows Flink > > to read, write TsFile, the detail can be found in the design doc [1]. > > > > Welcome any feedback and comments in design doc. > > > > Best, > > Jincheng > > > > [1] > > https://docs.google.com/document/d/1h0_aGboUCqlke-CdSKy1yNCsHTBKhw3JHWlwLBtbmGU/edit?usp=sharing > > > >
