[
https://issues.apache.org/jira/browse/SPARK-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205367#comment-14205367
]
Dan Osipov commented on SPARK-3821:
-----------------------------------
[~nchammas] Excellent work, I look forward to testing it out this week.
{quote}
1. My preference would be to just have a single AMI across Spark versions for a
couple of reasons.
{quote}
I would actually advocate for baked AMIs. Yes, there are many of them, but IMHO
there should be a Jenkins job creating these on every release, so it would be a
fully automated task. These AMIs would be production ready release for Spark
with all dependencies built in.
> Develop an automated way of creating Spark images (AMI, Docker, and others)
> ---------------------------------------------------------------------------
>
> Key: SPARK-3821
> URL: https://issues.apache.org/jira/browse/SPARK-3821
> Project: Spark
> Issue Type: Improvement
> Components: Build, EC2
> Reporter: Nicholas Chammas
> Assignee: Nicholas Chammas
> Attachments: packer-proposal.html
>
>
> Right now the creation of Spark AMIs or Docker containers is done manually.
> With tools like [Packer|http://www.packer.io/], we should be able to automate
> this work, and do so in such a way that multiple types of machine images can
> be created from a single template.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
