Re: [Discuss] AWS cost for genomics lesson

2017-02-07 Thread Ariel Rokem 
Hi everyone,

On Fri, Jan 27, 2017 at 5:38 PM, Tracy Teal <tkt...@gmail.com> wrote:

> Hi Fotis,
>
> For the Data Carpentry Genomics workshops, we have an Education grant from
> Amazon. So, we use the Data Carpentry account and spin up instances for you
> for the workshop. Then the workshop participants just ssh in to the
> instances.
>
> We specifically don't have people spin up their own instances in the
> workshop because of the time it would take to go through that process and
> some of the issues that Titus mentions.
>
> We do provide documentation on how to spin up the instances
> <https://jasonjwilliamsny.github.io/cloud-genomics/logging-onto-cloud.html>
> though, so that after the workshop, people can work through that on their
> own for their own work, and when they have more time.
>
> Some places also teach the Genomics workshop on their local HPC resources
> and we're also looking into using Jetstream <http://jetstream-cloud.org>.
> We want to teach something that people will have access to after the
> workshop, and Amazon is something that is generally available, but the
> point is to introduce people to the idea of remote computing, so it's just
> one of many options.
>
>
We recently used Jetstream to teach a workshop in neuroscience/image
processing at UCSF (http://grinberglab.ucsf.edu/python). The experience was
made very pleasant thanks to the UC Berkeley XSEDE champion, Aaron Culich,
who helped us set this up.

A few more details in this blog-post: https://bids.
berkeley.edu/news/berkeley-and-uw-data-scientists-team-
ucsf-researchers-deliver-data-driven-analysis-and-machine, and we're also
planning to write a technical report about all the moving pieces.

Cheers,



> Best,
> -Tracy
>
>
>
>
> On Fri, Jan 27, 2017 at 12:47 PM, Fotis E. Psomopoulos <
> fp...@issel.ee.auth.gr> wrote:
>
>> That's actually really useful Titus - thanks a lot for sharing this!
>>
>> Last time I had the process with AWS done was last May, so that's why I
>> had
>> the wrong impression. This also means that we probably need to find a
>> working solution for preparing participants for the DC genomics lesson.
>>
>> Regards,
>>
>> Fotis
>>
>> -Original Message-
>> From: C. Titus Brown [mailto:ctbr...@ucdavis.edu]
>> Sent: Friday, January 27, 2017 10:11 PM
>> To: Jaime Ashander <ashan...@ucla.edu>
>> Cc: Fotis E. Psomopoulos <fp...@issel.ee.auth.gr>; Software Carpentry
>> Discussion <discuss@lists.software-carpentry.org>
>> Subject: Re: [Discuss] AWS cost for genomics lesson
>>
>> Apologies if this is a bit off-topic, but:
>>
>> Note that in recent months (at least the last 4 months or so) you will be
>> blocked from starting up a new AWS instance for at least the first few
>> hours
>> after you first try, until they verify your account.  Presumably this is
>> to
>> stop people from creating fake accounts and running up compute before
>> being
>> caught.
>>
>> This puts a serious monkey wrench in any workshop that doesn't have people
>> sign up *and try to start a new instance at least the night before the
>> workshop*.
>>
>> (This change in AWS practice happened sometime around our workshop at
>> Scripps Institute of Oceanograph,
>> https://2016-metagenomics-sio.readthedocs.io/en/latest/, so before
>> October
>> 12, 2016.  We had 17 people unable to start their instances.  Fun fun
>> fun!)
>>
>> I've talked to some AWS folk about it and so far there has been nothing
>> they
>> could do other than take a list of accounts to prevalidate (which didn't
>> work the one time we tried to do it).
>>
>> Largely for this reason, I'm going to seriously try out JetStream as an
>> alternative to AWS in the next few months.
>>
>> best,
>> --titus
>>
>> On Fri, Jan 27, 2017 at 12:00:23PM -0800, Jaime Ashander wrote:
>> > For the recommended instance type, t2.medium, (per
>> > http://www.datacarpentry.org/genomics-workshop/ ) the current costs in
>> > N VA (per https://aws.amazon.com/ec2/pricing/on-demand/ ):
>> >
>> > t2.medium 2 Variable 4 EBS Only $0.047 per Hour
>> > - Jaime
>> >
>> > On Fri, Jan 27, 2017 at 11:44 AM, Fotis E. Psomopoulos <
>> > fp...@issel.ee.auth.gr> wrote:
>> >
>> > > If none (or at least the majority) of the participants have a
>> > > previous AWS account, they will be eligible for the free tier ???
>> > > essentially they will have to create an amazon account (and probably
>> > > give their credit ca

Re: [Discuss] AWS cost for genomics lesson

2017-01-27 Thread Fotis E. Psomopoulos 
That's actually really useful Titus - thanks a lot for sharing this!

Last time I had the process with AWS done was last May, so that's why I had
the wrong impression. This also means that we probably need to find a
working solution for preparing participants for the DC genomics lesson.

Regards,

Fotis

-Original Message-
From: C. Titus Brown [mailto:ctbr...@ucdavis.edu] 
Sent: Friday, January 27, 2017 10:11 PM
To: Jaime Ashander <ashan...@ucla.edu>
Cc: Fotis E. Psomopoulos <fp...@issel.ee.auth.gr>; Software Carpentry
Discussion <discuss@lists.software-carpentry.org>
Subject: Re: [Discuss] AWS cost for genomics lesson

Apologies if this is a bit off-topic, but:

Note that in recent months (at least the last 4 months or so) you will be
blocked from starting up a new AWS instance for at least the first few hours
after you first try, until they verify your account.  Presumably this is to
stop people from creating fake accounts and running up compute before being
caught.

This puts a serious monkey wrench in any workshop that doesn't have people
sign up *and try to start a new instance at least the night before the
workshop*.

(This change in AWS practice happened sometime around our workshop at
Scripps Institute of Oceanograph,
https://2016-metagenomics-sio.readthedocs.io/en/latest/, so before October
12, 2016.  We had 17 people unable to start their instances.  Fun fun fun!)

I've talked to some AWS folk about it and so far there has been nothing they
could do other than take a list of accounts to prevalidate (which didn't
work the one time we tried to do it).

Largely for this reason, I'm going to seriously try out JetStream as an
alternative to AWS in the next few months.

best,
--titus

On Fri, Jan 27, 2017 at 12:00:23PM -0800, Jaime Ashander wrote:
> For the recommended instance type, t2.medium, (per 
> http://www.datacarpentry.org/genomics-workshop/ ) the current costs in 
> N VA (per https://aws.amazon.com/ec2/pricing/on-demand/ ):
> 
> t2.medium 2 Variable 4 EBS Only $0.047 per Hour
> - Jaime
> 
> On Fri, Jan 27, 2017 at 11:44 AM, Fotis E. Psomopoulos < 
> fp...@issel.ee.auth.gr> wrote:
> 
> > If none (or at least the majority) of the participants have a 
> > previous AWS account, they will be eligible for the free tier ??? 
> > essentially they will have to create an amazon account (and probably 
> > give their credit card
> > details) but there will be no cost for using the cloud resources.
> >
> >
> >
> > That was the case on both times I participated to the DC genomics 
> > lesson, so it might as well be true in other instances as well.
> >
> >
> >
> > Just my two cents???
> >
> >
> >
> > Regards,
> >
> >
> >
> > Fotis
> >
> >
> >
> > *From:* Discuss 
> > [mailto:discuss-boun...@lists.software-carpentry.org] *On Behalf Of 
> > *Strong, Dena L
> > *Sent:* Friday, January 27, 2017 9:12 PM
> > *To:* Christopher Hamm <topher.h...@gmail.com>; 
> > discuss@lists.software- carpentry.org
> > *Subject:* Re: [Discuss] AWS cost for genomics lesson
> >
> >
> >
> > I can???t speak specifically to the Data Carpentry experience, but 
> > when we???ve done full day AWS training for groups of 20-30 IT Pros 
> > at our university, the whole cost for everyone for the day was 
> > approximately $3. A few cents per person per hour, because nothing 
> > external was driving much traffic to the test sites.
> >
> >
> >
> > *From:* Discuss [mailto:discuss-boun...@lists.software-carpentry.org
> > <discuss-boun...@lists.software-carpentry.org>] *On Behalf Of 
> > *Christopher Hamm
> > *Sent:* Thursday, January 26, 2017 12:50 PM
> > *To:* discuss@lists.software-carpentry.org
> > *Subject:* [Discuss] AWS cost for genomics lesson
> >
> >
> >
> > Do we know what the approximate cost of using AWS is per student for 
> > the Data Carpentry genomics lessons?
> >
> >
> >
> > Chris
> >
> >
> >
> > ---
> >
> > Christopher A. Hamm
> >
> > Postdoctoral Researcher
> >
> > School of Veterinary Medicine
> >
> > University of California, Davis
> >
> > @butterflyology
> > <https://urldefense.proofpoint.com/v2/url?u=https-3A__twitter.com_bu
> > tterflyology=DwMFaQ=8hUWFZcy2Z-Za5rBPlktOQ=rD4OA1kkL0S4v1qYK9k
> > -ja5g5j8GrEgKciJJhx3Vkj8=3RijHwz9Hr6_CU6kiKiIjmtHHYOEMybNGTMurBm64
> > VM=K_G_gYdsgtxrfI7oim1jrDLmySh5Ip2gyLWiTiPQt78=>
> >
> > butterflyology.github.io
> > <https://urldefense.proofpoint.com/v2/url?u=http-3A__butterflyology.
> > github.io=DwMFaQ=8hUW

Re: [Discuss] AWS cost for genomics lesson

2017-01-27 Thread C. Titus Brown 
Apologies if this is a bit off-topic, but:

Note that in recent months (at least the last 4 months or so) you will
be blocked from starting up a new AWS instance for at least the first few
hours after you first try, until they verify your account.  Presumably this is
to stop people from creating fake accounts and running up compute before being
caught.

This puts a serious monkey wrench in any workshop that doesn't have people
sign up *and try to start a new instance at least the night before the
workshop*.

(This change in AWS practice happened sometime around our workshop at Scripps
Institute of Oceanograph,
https://2016-metagenomics-sio.readthedocs.io/en/latest/, so before October 12,
2016.  We had 17 people unable to start their instances.  Fun fun fun!)

I've talked to some AWS folk about it and so far there has been nothing they
could do other than take a list of accounts to prevalidate (which didn't work
the one time we tried to do it).

Largely for this reason, I'm going to seriously try out JetStream as an
alternative to AWS in the next few months.

best,
--titus

On Fri, Jan 27, 2017 at 12:00:23PM -0800, Jaime Ashander wrote:
> For the recommended instance type, t2.medium, (per
> http://www.datacarpentry.org/genomics-workshop/ ) the current costs in N VA
> (per https://aws.amazon.com/ec2/pricing/on-demand/ ):
> 
> t2.medium 2 Variable 4 EBS Only $0.047 per Hour
> - Jaime
> 
> On Fri, Jan 27, 2017 at 11:44 AM, Fotis E. Psomopoulos <
> fp...@issel.ee.auth.gr> wrote:
> 
> > If none (or at least the majority) of the participants have a previous AWS
> > account, they will be eligible for the free tier ??? essentially they will
> > have to create an amazon account (and probably give their credit card
> > details) but there will be no cost for using the cloud resources.
> >
> >
> >
> > That was the case on both times I participated to the DC genomics lesson,
> > so it might as well be true in other instances as well.
> >
> >
> >
> > Just my two cents???
> >
> >
> >
> > Regards,
> >
> >
> >
> > Fotis
> >
> >
> >
> > *From:* Discuss [mailto:discuss-boun...@lists.software-carpentry.org] *On
> > Behalf Of *Strong, Dena L
> > *Sent:* Friday, January 27, 2017 9:12 PM
> > *To:* Christopher Hamm <topher.h...@gmail.com>; discuss@lists.software-
> > carpentry.org
> > *Subject:* Re: [Discuss] AWS cost for genomics lesson
> >
> >
> >
> > I can???t speak specifically to the Data Carpentry experience, but when
> > we???ve done full day AWS training for groups of 20-30 IT Pros at our
> > university, the whole cost for everyone for the day was approximately $3. A
> > few cents per person per hour, because nothing external was driving much
> > traffic to the test sites.
> >
> >
> >
> > *From:* Discuss [mailto:discuss-boun...@lists.software-carpentry.org
> > <discuss-boun...@lists.software-carpentry.org>] *On Behalf Of *Christopher
> > Hamm
> > *Sent:* Thursday, January 26, 2017 12:50 PM
> > *To:* discuss@lists.software-carpentry.org
> > *Subject:* [Discuss] AWS cost for genomics lesson
> >
> >
> >
> > Do we know what the approximate cost of using AWS is per student for the
> > Data Carpentry genomics lessons?
> >
> >
> >
> > Chris
> >
> >
> >
> > ---
> >
> > Christopher A. Hamm
> >
> > Postdoctoral Researcher
> >
> > School of Veterinary Medicine
> >
> > University of California, Davis
> >
> > @butterflyology
> > <https://urldefense.proofpoint.com/v2/url?u=https-3A__twitter.com_butterflyology=DwMFaQ=8hUWFZcy2Z-Za5rBPlktOQ=rD4OA1kkL0S4v1qYK9k-ja5g5j8GrEgKciJJhx3Vkj8=3RijHwz9Hr6_CU6kiKiIjmtHHYOEMybNGTMurBm64VM=K_G_gYdsgtxrfI7oim1jrDLmySh5Ip2gyLWiTiPQt78=>
> >
> > butterflyology.github.io
> > <https://urldefense.proofpoint.com/v2/url?u=http-3A__butterflyology.github.io=DwMFaQ=8hUWFZcy2Z-Za5rBPlktOQ=rD4OA1kkL0S4v1qYK9k-ja5g5j8GrEgKciJJhx3Vkj8=3RijHwz9Hr6_CU6kiKiIjmtHHYOEMybNGTMurBm64VM=yZyMcIKZiQ8ZpfdxjTfmbKf3x9S9hpcnGzVXtNV2xO8=>
> >
> > ___
> > Discuss mailing list
> > Discuss@lists.software-carpentry.org
> > http://lists.software-carpentry.org/listinfo/discuss
> >

> ___
> Discuss mailing list
> Discuss@lists.software-carpentry.org
> http://lists.software-carpentry.org/listinfo/discuss

-- 
C. Titus Brown, ctbr...@ucdavis.edu
___
Discuss mailing list
Discuss@lists.software-carpentry.org
http://lists.software-carpentry.org/listinfo/discuss

Re: [Discuss] AWS cost for genomics lesson

2017-01-27 Thread Jaime Ashander 
For the recommended instance type, t2.medium, (per
http://www.datacarpentry.org/genomics-workshop/ ) the current costs in N VA
(per https://aws.amazon.com/ec2/pricing/on-demand/ ):

t2.medium 2 Variable 4 EBS Only $0.047 per Hour
- Jaime

On Fri, Jan 27, 2017 at 11:44 AM, Fotis E. Psomopoulos <
fp...@issel.ee.auth.gr> wrote:

> If none (or at least the majority) of the participants have a previous AWS
> account, they will be eligible for the free tier – essentially they will
> have to create an amazon account (and probably give their credit card
> details) but there will be no cost for using the cloud resources.
>
>
>
> That was the case on both times I participated to the DC genomics lesson,
> so it might as well be true in other instances as well.
>
>
>
> Just my two cents…
>
>
>
> Regards,
>
>
>
> Fotis
>
>
>
> *From:* Discuss [mailto:discuss-boun...@lists.software-carpentry.org] *On
> Behalf Of *Strong, Dena L
> *Sent:* Friday, January 27, 2017 9:12 PM
> *To:* Christopher Hamm <topher.h...@gmail.com>; discuss@lists.software-
> carpentry.org
> *Subject:* Re: [Discuss] AWS cost for genomics lesson
>
>
>
> I can’t speak specifically to the Data Carpentry experience, but when
> we’ve done full day AWS training for groups of 20-30 IT Pros at our
> university, the whole cost for everyone for the day was approximately $3. A
> few cents per person per hour, because nothing external was driving much
> traffic to the test sites.
>
>
>
> *From:* Discuss [mailto:discuss-boun...@lists.software-carpentry.org
> <discuss-boun...@lists.software-carpentry.org>] *On Behalf Of *Christopher
> Hamm
> *Sent:* Thursday, January 26, 2017 12:50 PM
> *To:* discuss@lists.software-carpentry.org
> *Subject:* [Discuss] AWS cost for genomics lesson
>
>
>
> Do we know what the approximate cost of using AWS is per student for the
> Data Carpentry genomics lessons?
>
>
>
> Chris
>
>
>
> ---
>
> Christopher A. Hamm
>
> Postdoctoral Researcher
>
> School of Veterinary Medicine
>
> University of California, Davis
>
> @butterflyology
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__twitter.com_butterflyology=DwMFaQ=8hUWFZcy2Z-Za5rBPlktOQ=rD4OA1kkL0S4v1qYK9k-ja5g5j8GrEgKciJJhx3Vkj8=3RijHwz9Hr6_CU6kiKiIjmtHHYOEMybNGTMurBm64VM=K_G_gYdsgtxrfI7oim1jrDLmySh5Ip2gyLWiTiPQt78=>
>
> butterflyology.github.io
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__butterflyology.github.io=DwMFaQ=8hUWFZcy2Z-Za5rBPlktOQ=rD4OA1kkL0S4v1qYK9k-ja5g5j8GrEgKciJJhx3Vkj8=3RijHwz9Hr6_CU6kiKiIjmtHHYOEMybNGTMurBm64VM=yZyMcIKZiQ8ZpfdxjTfmbKf3x9S9hpcnGzVXtNV2xO8=>
>
> ___
> Discuss mailing list
> Discuss@lists.software-carpentry.org
> http://lists.software-carpentry.org/listinfo/discuss
>
___
Discuss mailing list
Discuss@lists.software-carpentry.org
http://lists.software-carpentry.org/listinfo/discuss

Re: [Discuss] AWS cost for genomics lesson

2017-01-27 Thread Strong, Dena L 
I can’t speak specifically to the Data Carpentry experience, but when we’ve 
done full day AWS training for groups of 20-30 IT Pros at our university, the 
whole cost for everyone for the day was approximately $3. A few cents per 
person per hour, because nothing external was driving much traffic to the test 
sites.

From: Discuss [mailto:discuss-boun...@lists.software-carpentry.org] On Behalf 
Of Christopher Hamm
Sent: Thursday, January 26, 2017 12:50 PM
To: discuss@lists.software-carpentry.org
Subject: [Discuss] AWS cost for genomics lesson

Do we know what the approximate cost of using AWS is per student for the Data 
Carpentry genomics lessons?

Chris

---
Christopher A. Hamm
Postdoctoral Researcher
School of Veterinary Medicine
University of California, Davis
@butterflyology
butterflyology.github.io
___
Discuss mailing list
Discuss@lists.software-carpentry.org
http://lists.software-carpentry.org/listinfo/discuss