Re: Using Amazon EC2 Spot instances with Flink
My company is running Flink in Kubernetes with spot instances for both JM and TM. Feel free to reach out. On Thu, Mar 24, 2022, 20:33 Ber, Jeremy wrote: > > https://aws.amazon.com/blogs/compute/optimizing-apache-flink-on-amazon-eks-using-amazon-ec2-spot-instances/ > > > > Sharing this link FWIW. > > > > Jeremy > > > > *From: *David Anderson > *Date: *Thursday, March 24, 2022 at 1:32 PM > *To: *"Vasileva, Valeriia" > *Cc: *"user@flink.apache.org" > *Subject: *RE: [EXTERNAL] Using Amazon EC2 Spot instances with Flink > > > > *CAUTION*: This email originated from outside of the organization. Do not > click links or open attachments unless you can confirm the sender and know > the content is safe. > > > > I remember a Flink Forward talk several years ago where the speaker shared > how they were running on spot instances. They were catching the > notification that the instance was being shutdown, taking a savepoint, and > relaunching. They were also proactively monitoring spot instance prices > around the world, and migrating to the least expensive region. > > > > David > > > > On Tue, Mar 22, 2022 at 11:33 PM Vasileva, Valeriia < > c-valeriia.vasil...@disneystreaming.com> wrote: > > Hello, folks! > > > > I was wondering if there are some good articles on how to use EC2 Spot > instances with Flink? > > > > I would appreciate your help! Thank you! > > > > Kind Regards, > > Valeriia > >
Re: Using Amazon EC2 Spot instances with Flink
https://aws.amazon.com/blogs/compute/optimizing-apache-flink-on-amazon-eks-using-amazon-ec2-spot-instances/ Sharing this link FWIW. Jeremy From: David Anderson Date: Thursday, March 24, 2022 at 1:32 PM To: "Vasileva, Valeriia" Cc: "user@flink.apache.org" Subject: RE: [EXTERNAL] Using Amazon EC2 Spot instances with Flink CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. I remember a Flink Forward talk several years ago where the speaker shared how they were running on spot instances. They were catching the notification that the instance was being shutdown, taking a savepoint, and relaunching. They were also proactively monitoring spot instance prices around the world, and migrating to the least expensive region. David On Tue, Mar 22, 2022 at 11:33 PM Vasileva, Valeriia mailto:c-valeriia.vasil...@disneystreaming.com>> wrote: Hello, folks! I was wondering if there are some good articles on how to use EC2 Spot instances with Flink? I would appreciate your help! Thank you! Kind Regards, Valeriia
Re: Using Amazon EC2 Spot instances with Flink
I remember a Flink Forward talk several years ago where the speaker shared how they were running on spot instances. They were catching the notification that the instance was being shutdown, taking a savepoint, and relaunching. They were also proactively monitoring spot instance prices around the world, and migrating to the least expensive region. David On Tue, Mar 22, 2022 at 11:33 PM Vasileva, Valeriia < c-valeriia.vasil...@disneystreaming.com> wrote: > Hello, folks! > > > > I was wondering if there are some good articles on how to use EC2 Spot > instances with Flink? > > > > I would appreciate your help! Thank you! > > > > Kind Regards, > > Valeriia >
Re: Using Amazon EC2 Spot instances with Flink
HI Vasileva, Do you want to run Flink programs on EC2? If yes, it can be deploy in standalone mode, reference this doc[1] [1]https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/resource-providers/standalone/overview/ > 2022年3月23日 上午6:33，Vasileva, Valeriia > 写道： > > Hello, folks! > > I was wondering if there are some good articles on how to use EC2 Spot > instances with Flink? > > I would appreciate your help! Thank you! > > Kind Regards, > Valeriia
Using Amazon EC2 Spot instances with Flink
Hello, folks! I was wondering if there are some good articles on how to use EC2 Spot instances with Flink? I would appreciate your help! Thank you! Kind Regards, Valeriia
