Dear both,
as a side note (and my apologies for digressing), I was wondering how
popular cloud computing for data processing at scale in an academic
context is in the US or elsewhere?
Here in Europe, many universities run their own HPC centers where people
can sign up to process larger amounts of data or do larger simulations
or whatnot ... mostly people here are concerned about efficiency (data
connnections into the cloud are typically poor, VM overhead is
considerable) and security/confidentiality when putting scientific
workflows into the cloud.
What is your take on this?
Best,
Peter
PS. I love the "serverless" metaphor. Get's rid of all the problems of
computers. ;)
On 06/12/2017 06:02 PM, Marianne Corvellec wrote:
Hi Justin,
Thank you so much for the quick reply!
I'm going to give this new package a try.
Best,
Marianne
On Fri, Jun 9, 2017 at 11:20 AM, Justin Kitzes <[email protected]> wrote:
Hi Marianne,
PyWren by Eric Jonas sounds like it's pretty similar to what you're looking for
-
http://pywren.io/
It's a relatively new package that's still in active development, but Eric is
very interested in expanding it (and has some support from the riselab at UC
Berkeley to do so). I know that he's also actively looking for use cases, so
I'd definitely suggest getting in touch with him if you're interested.
Best,
Justin
--
Justin Kitzes
Energy and Resources Group
Berkeley Institute for Data Science
University of California, Berkeley
On Jun 9, 2017, at 6:51 AM, Marianne Corvellec <[email protected]>
wrote:
Dear community,
I'm curious as to whether some of you might have worked on or used
solutions such as AWS Lambda in the context of your scientific
research.
If so, have you documented it in a blog post that you could share?
Thanks in advance!
Without even considering workflows or full-fledged projects, wouldn't
we want to be able to make a standard API call to, say, fit a
polynomial to some data? Is anyone aware of any effort in this
direction?
A friend of mine just drew my attention to this general issue, which
touches on open science and reproducible research... In the meantime,
I'll encourage him to join this mailing list!
Thank you,
Marianne
_______________________________________________
Discuss mailing list
[email protected]
http://lists.software-carpentry.org/listinfo/discuss
_______________________________________________
Discuss mailing list
[email protected]
http://lists.software-carpentry.org/listinfo/discuss
_______________________________________________
Discuss mailing list
[email protected]
http://lists.software-carpentry.org/listinfo/discuss
