All,
Before we dive off into the finer points of MPI, HPC, and which is the best job
scheduler in the universe, lets stay on topic about running workshop(s) at SC
this year.
Developing new lessons is probably not going to happen in time for the deadline
in 11 days, so I suggest we go with something that does already exist and see
if it will meet the topics put forth by the organizing committee.
There is obviously some interest in this topic of HPCCarpentry so let me know
if I can be of use to help bring together the interested parties for a meeting
on what will and won't work globally for such a lesson. Feel free to email me
directly if you would like to be on such a team and I will try to set a time
and virtual place for it to happen.
Regards,
---
Jonah Duckles
Software Carpentry, Executive Director
http://software-carpentry.org
From: Brendan Smithyman <[email protected]>
Reply: Brendan Smithyman <[email protected]>
Date: April 7, 2016 at 7:42:05 PM
To: Alex Razoumov <[email protected]>
CC: Bob Freeman <[email protected]>, Software Carpentry Discussion
<[email protected]>, Aleksandra Pawlik
<[email protected]>
Subject: Re: [Discuss] Tutorials at SC'16
MPI yes, absolutely. Within the timeline of a workshop, and given the Python
curriculum already there, I wonder if mpi4py could be taught purely as a
common, easy-to-understand way of getting the MPI fundamentals. Of course, if
you’re doing the computation in Python directly then it’s not going to be
competitive as a numerical code, but for toy examples it would work fine. It’s
also not a bad glue for compiled modules, etc. It’s a fairly thin wrapper
around the C API. Adds transparent cPickle, which is cool, if not particularly
fast because of serialization and memory copying.
This would also allow using Python multiprocessing to teach shared memory
parallelism, which is not a terrible implementation. The code would be fairly
easy to adapt between mpi4py and multiprocessing, and I can see someone with a
basic Python knowledge being able to onboard both in the same two-day stretch.
I suspect that getting people to bootstrap the MPI C API and OpenMP in their
brains is not going to go well in a workshop timeframe.
Eventually, most people are going to need to know a “nice” language and a
“fast" language; however, getting people to agree on which fast language to
teach could be tough. If you’re just calling C code, SuperLU, etc. and using
mpi4py to pass around arrays it’s not too bad. I suppose I’m suggesting
focussing on teaching the different ways of approaching problems, rather than
teaching people to use MPI with a specific compiled language.
—
Brendan Smithyman
Postdoctoral Fellow
Western University, Earth Sciences
Biological & Geological Sciences, Rm. 1045
London, ON, Canada N6A 5B7
c. 778.990.5957
On Apr 7, 2016, at 6:46 PM, Alex Razoumov <[email protected]> wrote:
On the topic of HPC Carpentry (which is somewhat different from the original
topic in this list), I suspect dozens (if not in the low hundreds) of people on
this mailing list have taught HPC to novices. I have done this for many years
at various summer schools and in semester-long courses. Consequently, people
will have dozens of opinions on what to include into an HPC-novice course. For
example, I think it would be sheer madness not to teach MPI inside a compiled
language, but that's my opinion.
--
Alex Razoumov
WestGrid Visualization Coordinator, Compute Canada
On Thursday, April 7, 2016 at 3:21 PM, Aron Ahmadia wrote:
I've taught these in the past. Reach out directly to me if I can provide
guidance.
A
On Thu, Apr 7, 2016 at 6:05 PM Kate Hertweck <[email protected]
(mailto:[email protected])> wrote:
It sounds like we have critical mass for developing the hpc-novice lesson more
thoroughly! I've been working on tutorials for using Texas Advanced Computing
Center (TACC).
It sounds like we might not be able to make the deadline for SC'16, but I would
love to help facilitate lesson development sometime this summer (maybe schedule
a hackathon?). If anyone else is interested, please contact me directly and
I'll initiate separate correspondence for lesson development.
On Thu, Apr 7, 2016 at 3:04 PM, Brunson, Dana <[email protected]
(mailto:[email protected])> wrote:
I’m interested in HPC Carpentry but urgent fires keep preventing me from
getting too far. I’m leaning toward the idea of developing some good conceptual
lessons that avoid most of the technical difference between HPC sites. Here’s
the site I started back when I imagined I’d have more time to think about it,
and that’s when I learned how hard a easily adaptable HPC carpentry lesson
would be: https://github.com/dbrunson/hpc-novice
There was also a discussion under the data carpentry github org late last year.
Dana
Dana Brunson ([email protected] (mailto:[email protected]),
405-744-4455 (tel:405-744-4455))
Assistant Vice President for Research Cyberinfrastructure;
Director, OSU High Performance Computing Center;
Adjunct Associate Professor, Mathematics Department;
Adjunct Associate Professor, Computer Science Department;
Oklahoma State University, http://hpcc.okstate.edu (http://hpcc.okstate.edu/)
From: Discuss [mailto:[email protected]] On Behalf
Of Ashwin Trikuta Srinath
Sent: Thursday, April 7, 2016 2:39 PM
To: Katy Huff <[email protected] (mailto:[email protected])>
Cc: Bob Freeman <[email protected]
(mailto:[email protected])>; Software Carpentry Discussion
<[email protected]
(mailto:[email protected])>; Aleksandra Pawlik
<[email protected] (mailto:[email protected])>
Subject: Re: [Discuss] Tutorials at SC'16
I've long been interested in developing this, and there's some material I've
already written (forked off the now empty hpc-novice) for our own HPC workshop:
http://clemsoncoe.github.io/hpc-workshop/
If there's interest in developing HPCCarpentry, maybe we can form a committee
to discuss what the curriculum should look like.
Thanks,
Ashwin
On Thu, Apr 7, 2016 at 3:27 PM, Katy Huff <[email protected]
(mailto:[email protected])> wrote:
Maybe this is the ideal opportunity to create an HPCCarpentry curriculum!
(just throwing that out there.. not volunteering to invent it from scratch...)
On Wed, Apr 6, 2016 at 7:59 PM, Paul Wilson <[email protected]
(mailto:[email protected])> wrote:
Hello all,
I seem to recall that there have been workshops offered by this community at
previous SuperComputing meetings, and also know that some may not feel that it
is the best audience, but... as I'm on the tutorials committee for SC16, it is
my duty to advertise this opportunity to offer tutorials.
The details are attached, but there are only 11 days left (plus a 1 week
extension) so if you are interested please consider proposing a tutorial.
Paul
--
-- ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ --
Paul Wilson ~ UW-Madison ~ 608-263-0807 (tel:608-263-0807) ~ cal:
http://go.wisc.edu/pphw-cal
Professor, Engineering Physics. ~ http://cnerg.engr.wisc.edu
Faculty Director, Advanced Computing Infrastructure ~ http://aci.wisc.edu
_______________________________________________
Discuss mailing list
[email protected]
(mailto:[email protected])
http://lists.software-carpentry.org/mailman/listinfo/discuss_lists.software-carpentry.org
--
http://katyhuff.github.com
_______________________________________________
Discuss mailing list
[email protected]
(mailto:[email protected])
http://lists.software-carpentry.org/mailman/listinfo/discuss_lists.software-carpentry.org
_______________________________________________
Discuss mailing list
[email protected]
(mailto:[email protected])
http://lists.software-carpentry.org/mailman/listinfo/discuss_lists.software-carpentry.org
--
Kate L. Hertweck, Ph.D.
Assistant Professor, Department of Biology
The University of Texas at Tyler
3900 University Blvd., Tyler, TX 75799
Email: [email protected] (mailto:[email protected])
Office: HPR 109, 903.565.5882
https://www.uttyler.edu/biology/
_______________________________________________
Discuss mailing list
[email protected]
(mailto:[email protected])
http://lists.software-carpentry.org/mailman/listinfo/discuss_lists.software-carpentry.org
_______________________________________________
Discuss mailing list
[email protected]
(mailto:[email protected])
http://lists.software-carpentry.org/mailman/listinfo/discuss_lists.software-carpentry.org
_______________________________________________
Discuss mailing list
[email protected]
http://lists.software-carpentry.org/mailman/listinfo/discuss_lists.software-carpentry.org
_______________________________________________
Discuss mailing list
[email protected]
http://lists.software-carpentry.org/mailman/listinfo/discuss_lists.software-carpentry.org
_______________________________________________
Discuss mailing list
[email protected]
http://lists.software-carpentry.org/mailman/listinfo/discuss_lists.software-carpentry.org
