This is an automated email from the ASF dual-hosted git repository.
qiaojialin pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-iotdb.git.
from 5c95b6f [IOTDB-634] Fix merge and flush caused errors for TsFile
storage in HDFS (#1145)
new 99975f7 [IOTDB-560] add TSRecordOutputFormat to write TsFile via
Flink DataSet/DataStream API.
new af8943e address comments
new 023d9a7 address comments
new fd62d4f address comments
The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
example/flink/README.md | 2 +
.../apache/iotdb/flink/FlinkTsFileBatchSink.java | 114 ++++++++++++++
.../apache/iotdb/flink/FlinkTsFileStreamSink.java | 115 +++++++++++++++
.../java/org/apache/iotdb/flink/TsFlieUtils.java | 26 ++++
flink-tsfile-connector/README.md | 86 ++++++++++-
.../iotdb/flink/tsfile/RowTSRecordConverter.java | 163 +++++++++++++++++++++
.../iotdb/flink/tsfile/TSRecordConverter.java | 61 ++++++++
.../iotdb/flink/tsfile/TSRecordOutputFormat.java | 99 +++++++++++++
.../iotdb/flink/tsfile/TsFileOutputFormat.java | 122 +++++++++++++++
.../tsfile/RowTSRecordOutputFormatITCase.java | 56 +++++++
.../flink/tsfile/RowTSRecordOutputFormatTest.java | 77 ++++++++++
.../flink/tsfile/RowTsFileConnectorTestBase.java | 87 +++++++++++
.../flink/tsfile/RowTsFileInputFormatTestBase.java | 72 +--------
.../tsfile/RowTsFileOutputFormatTestBase.java | 117 +++++++++++++++
.../apache/iotdb/flink/util/TsFileWriteUtil.java | 2 +-
.../apache/iotdb/tsfile/write/schema/Schema.java | 4 +-
16 files changed, 1132 insertions(+), 71 deletions(-)
create mode 100644
example/flink/src/main/java/org/apache/iotdb/flink/FlinkTsFileBatchSink.java
create mode 100644
example/flink/src/main/java/org/apache/iotdb/flink/FlinkTsFileStreamSink.java
create mode 100644
flink-tsfile-connector/src/main/java/org/apache/iotdb/flink/tsfile/RowTSRecordConverter.java
create mode 100644
flink-tsfile-connector/src/main/java/org/apache/iotdb/flink/tsfile/TSRecordConverter.java
create mode 100644
flink-tsfile-connector/src/main/java/org/apache/iotdb/flink/tsfile/TSRecordOutputFormat.java
create mode 100644
flink-tsfile-connector/src/main/java/org/apache/iotdb/flink/tsfile/TsFileOutputFormat.java
create mode 100644
flink-tsfile-connector/src/test/java/org/apache/iotdb/flink/tsfile/RowTSRecordOutputFormatITCase.java
create mode 100644
flink-tsfile-connector/src/test/java/org/apache/iotdb/flink/tsfile/RowTSRecordOutputFormatTest.java
create mode 100644
flink-tsfile-connector/src/test/java/org/apache/iotdb/flink/tsfile/RowTsFileConnectorTestBase.java
create mode 100644
flink-tsfile-connector/src/test/java/org/apache/iotdb/flink/tsfile/RowTsFileOutputFormatTestBase.java