[jira] [Commented] (FLINK-9115) Support addition of part suffix in BucketingSink

2018-04-24 Thread Fabian Hueske (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-9115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16450069#comment-16450069
 ] 

Fabian Hueske commented on FLINK-9115:
--

Thanks for helping to keep the JIRA clean [~glaksh100]! :-)
+1 to close as duplicate

> Support addition of part suffix in BucketingSink
> 
>
> Key: FLINK-9115
> URL: https://issues.apache.org/jira/browse/FLINK-9115
> Project: Flink
>  Issue Type: Improvement
>  Components: filesystem-connector
>Reporter: Lakshmi Rao
>Priority: Minor
>  Labels: usability
>
> Currently the BucketingSink allows addition of part prefix, pending 
> prefix/suffix and in-progress prefix/suffix via setter methods. Can we also 
> support setting part suffixes?
> An instance where this maybe useful: I am currently writing GZIP compressed 
> output to S3 using the BucketingSink and I would want the uploaded files to 
> have a ".gz" or ".zip" extensions . An easy way to do this would be by 
> setting  a part file suffix with the required file extension. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (FLINK-9115) Support addition of part suffix in BucketingSink

2018-04-24 Thread Andrei (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-9115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16450056#comment-16450056
 ] 

Andrei commented on FLINK-9115:
---

OK, no problems

> Support addition of part suffix in BucketingSink
> 
>
> Key: FLINK-9115
> URL: https://issues.apache.org/jira/browse/FLINK-9115
> Project: Flink
>  Issue Type: Improvement
>  Components: filesystem-connector
>Reporter: Lakshmi Rao
>Priority: Minor
>  Labels: usability
>
> Currently the BucketingSink allows addition of part prefix, pending 
> prefix/suffix and in-progress prefix/suffix via setter methods. Can we also 
> support setting part suffixes?
> An instance where this maybe useful: I am currently writing GZIP compressed 
> output to S3 using the BucketingSink and I would want the uploaded files to 
> have a ".gz" or ".zip" extensions . An easy way to do this would be by 
> setting  a part file suffix with the required file extension. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (FLINK-9115) Support addition of part suffix in BucketingSink

2018-04-24 Thread Lakshmi Rao (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-9115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16450027#comment-16450027
 ] 

Lakshmi Rao commented on FLINK-9115:


Hi [~Poluliakh], thanks for offering to work on this. As I was looking into 
another change in the BucketingSink, I realized this feature was introduced 
recently in this PR - [https://github.com/apache/flink/pull/5603] . I will mark 
this ticket as a dupe and close it out. Does that sound good?

> Support addition of part suffix in BucketingSink
> 
>
> Key: FLINK-9115
> URL: https://issues.apache.org/jira/browse/FLINK-9115
> Project: Flink
>  Issue Type: Improvement
>  Components: filesystem-connector
>Reporter: Lakshmi Rao
>Priority: Minor
>  Labels: usability
>
> Currently the BucketingSink allows addition of part prefix, pending 
> prefix/suffix and in-progress prefix/suffix via setter methods. Can we also 
> support setting part suffixes?
> An instance where this maybe useful: I am currently writing GZIP compressed 
> output to S3 using the BucketingSink and I would want the uploaded files to 
> have a ".gz" or ".zip" extensions . An easy way to do this would be by 
> setting  a part file suffix with the required file extension. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (FLINK-9115) Support addition of part suffix in BucketingSink

2018-04-24 Thread Andrei (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-9115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16449846#comment-16449846
 ] 

Andrei commented on FLINK-9115:
---

Hi [~glaksh100]. I'm ready to work on this

> Support addition of part suffix in BucketingSink
> 
>
> Key: FLINK-9115
> URL: https://issues.apache.org/jira/browse/FLINK-9115
> Project: Flink
>  Issue Type: Improvement
>  Components: filesystem-connector
>Reporter: Lakshmi Rao
>Priority: Minor
>  Labels: usability
>
> Currently the BucketingSink allows addition of part prefix, pending 
> prefix/suffix and in-progress prefix/suffix via setter methods. Can we also 
> support setting part suffixes?
> An instance where this maybe useful: I am currently writing GZIP compressed 
> output to S3 using the BucketingSink and I would want the uploaded files to 
> have a ".gz" or ".zip" extensions . An easy way to do this would be by 
> setting  a part file suffix with the required file extension. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (FLINK-9115) Support addition of part suffix in BucketingSink

2018-04-02 Thread Lakshmi Rao (JIRA)

[ 
https://issues.apache.org/jira/browse/FLINK-9115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16423131#comment-16423131
 ] 

Lakshmi Rao commented on FLINK-9115:


I see a similar ask on this thread here earlier this year: 
https://stackoverflow.com/questions/48204520/how-to-add-suffix-to-final-completed-file-generated-by-bucketingsink-in-apache-f?rq=1

> Support addition of part suffix in BucketingSink
> 
>
> Key: FLINK-9115
> URL: https://issues.apache.org/jira/browse/FLINK-9115
> Project: Flink
>  Issue Type: Improvement
>  Components: filesystem-connector
>Reporter: Lakshmi Rao
>Priority: Minor
>  Labels: usability
>
> Currently the BucketingSink allows addition of part prefix, pending 
> prefix/suffix and in-progress prefix/suffix via setter methods. Can we also 
> support setting part suffixes?
> An instance where this maybe useful: I am currently writing GZIP compressed 
> output to S3 using the BucketingSink and I would want the uploaded files to 
> have a ".gz" or ".zip" extensions . An easy way to do this would be by 
> setting  a part file suffix with the required file extension. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)