Great. Thanks.
On Tue, Oct 13, 2020 at 4:29 PM Arvid Heise wrote:
> Hi Padarn,
>
> I assigned the ticket to you, so you can start working on it. Here are
> some contribution guidelines [1] in case it's your first contribution.
>
> Basically, you will need to open a PR which contains the ticket a
Hi Padarn,
I assigned the ticket to you, so you can start working on it. Here are some
contribution guidelines [1] in case it's your first contribution.
Basically, you will need to open a PR which contains the ticket and
component. So the prefix should be "[FLINK-19589][s3]" (also for your
commit
Thanks for the feedback. I've created a JIRA here
https://issues.apache.org/jira/browse/FLINK-19589.
@Dan: This indeed would make it easier to set a lifetime property on
objects created by Flink, but actually if you want to apply it to all your
objects for a given bucket you can set bucket wide po
We use the StreamingFileSink. An option to expire files after some time
period would certainly be welcome. (I could probably figure out a way to do
this from the S3 admin UI too though)
On Sat, Oct 10, 2020 at 10:45 PM Padarn Wilson wrote:
> Hi Flink Users,
>
> We need to expose some additional
Hi Padarn,
sounds like a good addition to me. We could wait for more feedback or you
could start immedately.
The next step would be to create a JIRA and get it assigned to you.
Looking forward to your contribution
Arvid
On Sun, Oct 11, 2020 at 7:45 AM Padarn Wilson wrote:
> Hi Flink Users,
>
Hi Flink Users,
We need to expose some additional options for the s3 hadoop filesystem:
Specifically, we want to set object tagging and lifecycle. This would be a
fairly easy change and we initially thought to create a new Filsystem with
very minor changes to allow this.
However then I wondered,
