Personally, I think including the hpl benchmark is important.  Whether or
not it is strictly a useful measure of actual cluster performance on any
real problem, it is the de facto standard for top500.org, so people have a
very well established ruler to measure their cluster against.

The other benchmark package which was mentioned during prior discussions, I
believe by Oak Ridge, was "the DARPA benchmarks".  I have not looked into
this option yet myself, but it is worth some consideration as well.

ATLAS and gotoBLAS are not benchmarks themselves but optimize the underlying
math libraries that the benchmarks use.  I am slightly concerned about some
text on the gotoBLAS site saying they use a strict accademic license.  OSCAR
is used by many non-edu folks, so I am not sure how we can deal with that.
You should at least contact the author and ask about this.

My vision was to make a single package, with some selection of components to
be installed in the configurator, which installs a separate program which
"automatically" configures and gives the option to run various benchmarks,
maybe with a convenient summary grepped out of the output files (which can
be very confusing).  At least initially, doing this in pure text mode may be
the way to go,  though a gui would of course be snazzy.

As far as what information is available, it boils down to more or less the
current state of hardware and packages installed on the cluster.  This
includes number of CPUs and the amount of memory on each node, which is
likely the most important in your case.  I think there is some ODA
documentation floating around somewhere, probably in laTex files :)

On 4/12/07, James <[EMAIL PROTECTED]> wrote:

Hello everyone!

I am an undergrad at Louisiana Tech University, my degree focus is on
Computer Science and I plan to graduate in November of this year. My SoC
project is the OSCAR Bench project that will incorporate benchmarks into
OSCAR. I would love to hear any suggestions, or vision you have for the
project. I expect my proposal will change a good bit between now and
August.

Some pressing thoughts I have had are:

Where in OSCAR does OSCAR Bench belong? Should it be run as part of the
'test cluster' if the users downloads it? Would an additional GUI button
be added if the user downloads my package? My thoughts are that the
benchmark should be able to run independently of the Wizard, but with
the requirement that the cluster be an OSCAR cluster, e.g., it has an
OSCAR database. That could be removed as well, but I would like to build
off OSCAR as much as possible, so I don't have to recreate any wheels.
This is future thinking on my part, because I am not sure what data I
may want that OSCAR has to offer (if any).

Also what benchmarks are most relevant? If I work with the HPCC
benchmark package, do I need to include HPL? From experience I have used
the HPCC benchmark for about 4 months now, I have also built/used ATLAS
to go with it. I noticed a post here regarding IO benchmarking, so I
really want to narrow my focus down to a few specific benchmarks/packages.

And the final thought was: Should all the benchmarks be clumped into 1
package, or should each be its own package. For instance: an Atlas
package, a HPL package, a HPCC packages, etc...,

Thanks again for the chance to work with you,
James Elliott

-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share
your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Oscar-devel mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/oscar-devel

-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Oscar-devel mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/oscar-devel

Reply via email to