[
https://issues.apache.org/jira/browse/SPARK-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183245#comment-14183245
]
Nicholas Chammas commented on SPARK-3821:
-----------------------------------------
Hey [~danospv], I'm currently in the middle of working on this. I've assigned
this JIRA issue to myself to make that clearer. Next week I plan to post a
brief design doc and perhaps also an initial alpha of this feature working so
that people can review it and give their feedback. If after reviewing it you
find that you'd still like to pursue this, feel free to do so.
{quote}
this is needed for a launch script I'm working on
{quote}
Could you elaborate on your use case? The use cases I'm currently targeting are
focused on improving {{spark-ec2}} launch times and automating updates to any
Spark machine images or containers.
{quote}
Are there manual steps that are currently done to produce
https://github.com/mesos/spark-ec2/tree/v4/ami-list ?
{quote}
Yes,
[{{create_image.sh}}|https://github.com/mesos/spark-ec2/blob/v4/create_image.sh]
is supposed to be that script, though it was created _ex post-facto_ and may
not yield a proper replica of the AMIs we currently have.
On a related note, the approach I'm pursuing will automate both the creation of
the AMIs in multiple regions and across virtualization types, as well as update
the AMI list under {{ami-list/}} automatically.
> Develop an automated way of creating Spark images (AMI, Docker, and others)
> ---------------------------------------------------------------------------
>
> Key: SPARK-3821
> URL: https://issues.apache.org/jira/browse/SPARK-3821
> Project: Spark
> Issue Type: Improvement
> Components: Build, EC2
> Reporter: Nicholas Chammas
> Assignee: Nicholas Chammas
>
> Right now the creation of Spark AMIs or Docker containers is done manually.
> With tools like [Packer|http://www.packer.io/], we should be able to automate
> this work, and do so in such a way that multiple types of machine images can
> be created from a single template.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
