[jira] [Updated] (FLINK-14254) Introduce BatchFileSystemSink

2019-10-01 Thread Robert Metzger (Jira) 


 [ 
https://issues.apache.org/jira/browse/FLINK-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Metzger updated FLINK-14254:
---
Component/s: Table SQL / Planner

> Introduce BatchFileSystemSink
> -
>
> Key: FLINK-14254
> URL: https://issues.apache.org/jira/browse/FLINK-14254
> Project: Flink
>  Issue Type: Sub-task
>  Components: Table SQL / Planner
>Reporter: Jingsong Lee
>Assignee: Jingsong Lee
>Priority: Major
>
> Introduce BatchFileSystemSink to support all table file system connector with 
> partition support.
> BatchFileSystemSink use PartitionWriter to write:
>  # DynamicPartitionWriter
>  # GroupedPartitionWriter
>  # NonPartitionWriter
> BatchFileSystemSink use FileCommitter to commit temporary files.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (FLINK-14254) Introduce BatchFileSystemSink

2019-09-27 Thread Jingsong Lee (Jira) 


 [ 
https://issues.apache.org/jira/browse/FLINK-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jingsong Lee updated FLINK-14254:
-
Description: 
Introduce BatchFileSystemSink to support all table file system connector with 
partition support.

BatchFileSystemSink use PartitionWriter to write:
 # DynamicPartitionWriter
 # GroupedPartitionWriter
 # NonPartitionWriter

BatchFileSystemSink use FileCommitter to commit temporary files.

 

  was:
Introduce FileSystemOutputFormat to support all table file system connector 
with partition support.

FileSystemOutputFormat use PartitionWriter to write:
 # DynamicPartitionWriter
 # GroupedPartitionWriter
 # NonPartitionWriter

FileSystemOutputFormat use FileCommitter to commit temporary files.

 


> Introduce BatchFileSystemSink
> -
>
> Key: FLINK-14254
> URL: https://issues.apache.org/jira/browse/FLINK-14254
> Project: Flink
>  Issue Type: Sub-task
>Reporter: Jingsong Lee
>Priority: Major
>
> Introduce BatchFileSystemSink to support all table file system connector with 
> partition support.
> BatchFileSystemSink use PartitionWriter to write:
>  # DynamicPartitionWriter
>  # GroupedPartitionWriter
>  # NonPartitionWriter
> BatchFileSystemSink use FileCommitter to commit temporary files.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (FLINK-14254) Introduce BatchFileSystemSink

2019-09-27 Thread Jingsong Lee (Jira) 


 [ 
https://issues.apache.org/jira/browse/FLINK-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jingsong Lee updated FLINK-14254:
-
Summary: Introduce BatchFileSystemSink  (was: Introduce 
FileSystemOutputFormat)

> Introduce BatchFileSystemSink
> -
>
> Key: FLINK-14254
> URL: https://issues.apache.org/jira/browse/FLINK-14254
> Project: Flink
>  Issue Type: Sub-task
>Reporter: Jingsong Lee
>Priority: Major
>
> Introduce FileSystemOutputFormat to support all table file system connector 
> with partition support.
> FileSystemOutputFormat use PartitionWriter to write:
>  # DynamicPartitionWriter
>  # GroupedPartitionWriter
>  # NonPartitionWriter
> FileSystemOutputFormat use FileCommitter to commit temporary files.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)