m/>
>
> Follow us @VervericaData
>
> --
>
> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> Conference
>
> Stream Processing | Event Driven | Real Time
>
> --
>
> Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany
>
> --
> Ververica GmbH
> Registered at Amtsgericht Charlottenburg: HRB 158244 B
> Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji
> (Toni) Cheng
>
--
Dan Diephouse
@dandiep
se this? If it something that is
> worth raising as a Flink issue and then contributing back upstream.
>
> Any others who would like to be able to set object tags for the s3
> filesystem?
>
> Cheers,
> Padarn
>
--
Dan Diephouse
@dandiep
heck if AWS SDK version can be upgraded
> in Flink distribution.
>
> Regards,
> Roman
>
>
> On Fri, Oct 9, 2020 at 12:54 AM Dan Diephouse wrote:
>
>> Well, I just dropped in the latest Amazon 1.11.878 SDK and now it
>> appears to respect interrupts in a t
Well, I just dropped in the latest Amazon 1.11.878 SDK and now it
appears to respect interrupts in a test case I created. (the test fails
with the SDK that is in use by Flink)
I will try it in a full fledged Flink environment and report back.
On Thu, Oct 8, 2020 at 3:41 PM Dan Diephouse wrote
uses NIO, but I don't think
I'm up for all the changes that would involve in the downstream components.
On Thu, Oct 8, 2020 at 8:36 AM Dan Diephouse wrote:
> Using the latest - 1.11.2.
>
> I would assume the interruption is being ignored in the Hadoop / S3 layer.
> I was looking at
<
khachatryan.ro...@gmail.com> wrote:
> Hi Dan Diephouse,
>
> From the logs you provided indeed it looks like 1 causes 2 => 3 => 4,
> where 2 is a bug.
> It's unclear though where the interruption is ignored (Flink/Hadoop FS/S3
> client).
>
> What version
1.2]
at
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.registerSlotRequest(SlotManagerImpl.java:386)
~[flink-runtime_2.11-1.11.2.jar:1.11.2]
... 27 common frames omitted
Any thoughts / suggestions are much appreciated.
--
Dan Diephouse
@dandiep
ostas Kloudas who should be able to
> clarify things.
>
> David
>
> On Wed, Oct 7, 2020 at 7:12 PM Dan Diephouse wrote:
>
>> Thanks! Completely missed that in the docs. It's now working, however
>> it's not working with compression writers. Someone el
.apache.org/projects/flink/flink-docs-release-1.11/ops/filesystems/s3.html#configure-access-credentials
>
>
> On Wed, Oct 7, 2020 at 5:53 AM Dan Diephouse wrote:
>
>> First, let me say, Flink is super cool - thanks everyone for making my
>> life easier in a lot of ways! Wish
guration);
StreamingFileSink s3 = StreamingFileSink
.forRowFormat(new Path("s3://bucket/"), new
SimpleStringEncoder())
.build();
env.fromElements("string1", "string2")
.addSink(s3);
env.execute();
System.out.println("Done");
}
}
--
Dan Diephouse
@dandiep
10 matches
Mail list logo
