Padarn commented on pull request #10482: URL: https://github.com/apache/flink/pull/10482#issuecomment-688358481
Got it. Thanks for detailing the thought process, I understand the intention much better now. On Mon, 7 Sep 2020, 10:06 pm Arvid Heise, <[email protected]> wrote: > There shouldn't be a reason to include our filesystem in the user jar. If > you spawn the flink cluster yourself, you should always go with plugin and > nothing else. If you don't have the Flink cluster under your control, then > the admins must add the plugins (similar to how they added it into lib). > > Now let's assume that your user code also needs direct access to s3, e.g., > to use API directly. Then instead of bundling our jars, use the AWS sdk s3 > and bundle it. The whole idea of the plugins is that you would not need to > worry about any conflicts. Each plugin / user code can use the library > version they want as all are isolated. That wasn't true for jars in lib. > > The only way you interact with the s3 plugin is to use a path starting > with s3:// (or s3a, s3p). > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > <https://github.com/apache/flink/pull/10482#issuecomment-688348362>, or > unsubscribe > <https://github.com/notifications/unsubscribe-auth/AAGRPNZP6FBWXABRFRA3UKDSETSEPANCNFSM4JXRQI2Q> > . > -- By communicating with Grab Inc and/or its subsidiaries, associate companies and jointly controlled entities (“Grab Group”), you are deemed to have consented to the processing of your personal data as set out in the Privacy Notice which can be viewed at https://grab.com/privacy/ <https://grab.com/privacy/> This email contains confidential information and is only for the intended recipient(s). If you are not the intended recipient(s), please do not disseminate, distribute or copy this email Please notify Grab Group immediately if you have received this by mistake and delete this email from your system. Email transmission cannot be guaranteed to be secure or error-free as any information therein could be intercepted, corrupted, lost, destroyed, delayed or incomplete, or contain viruses. Grab Group do not accept liability for any errors or omissions in the contents of this email arises as a result of email transmission. All intellectual property rights in this email and attachments therein shall remain vested in Grab Group, unless otherwise provided by law. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
