[jira] [Commented] (FLINK-19550) StreamingFileSink can't be interrupted when writing to S3
[ https://issues.apache.org/jira/browse/FLINK-19550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17244017#comment-17244017 ] Roman Khachatryan commented on FLINK-19550: --- Thanks for sharing this! Did you update hadoop.version in flink/pom.xml? Or fs.s3.aws.version in flink/flink-filesystems/flink-s3-fs-base/pom.xml directly? > StreamingFileSink can't be interrupted when writing to S3 > - > > Key: FLINK-19550 > URL: https://issues.apache.org/jira/browse/FLINK-19550 > Project: Flink > Issue Type: Bug > Components: Connectors / FileSystem >Affects Versions: 1.12.0 >Reporter: Roman Khachatryan >Priority: Minor > > Reported in > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Network-issue-leading-to-quot-No-pooled-slot-available-quot-td38553.html > : > StreamingFileSink uses hadoop S3AFileSystem for s3a, which in turn uses > amazon aws sdk. > The version of amazon aws sdk used doesn't respect interrupts. However, a > newer Amazon 1.11.878 SDK version does. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-19550) StreamingFileSink can't be interrupted when writing to S3
[ https://issues.apache.org/jira/browse/FLINK-19550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17243998#comment-17243998 ] Steve Loughran commented on FLINK-19550: s3a in 3.2.2 and 3.3.1 will ship with 1.11.901, see HADOOP-17343. FWIW, we didn't see any regressions in test runs nor did we have any API changes to worry about. > StreamingFileSink can't be interrupted when writing to S3 > - > > Key: FLINK-19550 > URL: https://issues.apache.org/jira/browse/FLINK-19550 > Project: Flink > Issue Type: Bug > Components: Connectors / FileSystem >Affects Versions: 1.12.0 >Reporter: Roman Khachatryan >Priority: Minor > > Reported in > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Network-issue-leading-to-quot-No-pooled-slot-available-quot-td38553.html > : > StreamingFileSink uses hadoop S3AFileSystem for s3a, which in turn uses > amazon aws sdk. > The version of amazon aws sdk used doesn't respect interrupts. However, a > newer Amazon 1.11.878 SDK version does. -- This message was sent by Atlassian Jira (v8.3.4#803005)
