Hi,
Maybe a bit crazy idea, but you could also try extending the S3
filesystem and add the metadata there. You could write a thin wrapper
for the existing filesystem. If you'd like to go that route you might
want to check this page[1]. You could use that filesystem with your
custom scheme.
Best,
Hi Dhurandar,
With my understand I think what you need is to get notified when a file is
written successfully (committed) on the S3 FileSystem. However, currently there
is no public API for the listener and there an issue tracking it [1].
With the current version, one possible method co
We are creating files in S3 and we want to update the S3 object metadata
with some security-related information for governance purposes.
Right now Apache Flink totally abstracts how and when S3 object gets
created in the system.
Is there a way that we can pass the S3 object metadata and update it
