Re: FLINK YARN SHIP from S3 Directory

2020-09-04 Thread Vijayendra Yadav
Thank You Gordon. I am still on 1.10.0. I will try 1.11.0 When I get there. Regards, Vijay On Fri, Sep 4, 2020 at 12:52 AM Tzu-Li (Gordon) Tai wrote: > Hi, > > As far as I can tell from a recent change [1], this seems to be possible > now starting from Flink 1.11.x. Have you already tried this

Re: FLINK YARN SHIP from S3 Directory

2020-09-04 Thread Tzu-Li (Gordon) Tai
Hi, As far as I can tell from a recent change [1], this seems to be possible now starting from Flink 1.11.x. Have you already tried this with the latest Flink version? Also including Klou in this email, who might be able to confirm this. Cheers, Gordon [1]

FLINK YARN SHIP from S3 Directory

2020-09-03 Thread Vijayendra Yadav
Hi Team, Is there any feature to be able to ship directory to containers from s3 Directory instead of local. -yt,--yarnship Ship files in the specified directory (t for transfer)