[
https://issues.apache.org/jira/browse/CARBONDATA-3557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jacky Li resolved CARBONDATA-3557.
----------------------------------
Resolution: Fixed
> Support write Flink streaming data to Carbon
> --------------------------------------------
>
> Key: CARBONDATA-3557
> URL: https://issues.apache.org/jira/browse/CARBONDATA-3557
> Project: CarbonData
> Issue Type: New Feature
> Components: spark-integration
> Reporter: Zhi Liu
> Priority: Major
> Fix For: 2.0.0
>
> Attachments: Support write flink streaming data to carbon.docx
>
> Time Spent: 12h 50m
> Remaining Estimate: 0h
>
> Sometimes, user need to write flink streaming data to carbon, required high
> concurrency and high throughput.
> The write process is:
> # Write flink streaming data to local file system of flink task node use
> flink StreamingFileSink and carbon SDK;
> # Copy local carbon data file to carbon data store system, such as HDFS, S3;
> # Generate and write segment file to ${tablePath}/load_details;
> Run "alter table ${tableName} collect segments" command on server, to compact
> segment files in ${tablePath}/load_details, and then move the compacted
> segment file to ${tablePath}/Metadata/Segments/，update table status file
> finally.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
