Dear all,
Following recommendations of Chuck Ritter, the openmpi build specific to oscar
is built into /opt/openmpi-oscar and it should allow the installation of distro
openmpi without conflict hopefully.
The opkg-openmpi is able to handle both /usr and /opt installations if my
memory is correct (I done such a thing lately).
For the src.rpm, it's the default openmpi spec file that is used , but the
openmpi.cfg in oscar specifies specific compilation parameters.
Currently, in unstable, the build options are the following:
rpmbuild --define "configure_options FC=gfortran --with-tm=/opt/pbs
--with-blcr=yes --with-ft=cr --with-openib"
--define "install_in_opt 1"
--define "ofed 1"
--define "_name openmpi-oscar"
--define "install_shell_scripts 1"
--define "install_modulefile 1"
--define "modulefile_path /opt/modules/oscar-modulefiles"
--define "modulefile_subdir openmpi"
--define "modulefile_name %{name}-%{version}"
--define "use_mpi_selector 1"
--define "allow_fortify_source 0"
--define "modules_rpm_name modules-oscar"
--define "build_all_in_one_rpm 0"
openmpi.spec
The good point is that the spec file is maintained upstream, thus at each new
upstream version, the spec file is updated (new build requires and such)
The cons is that rpmbuild --rebuild openmpi.spec will not produce an oscar
openmpi. To rebuild the correct package, all the above options must be used.
(even the rpm name is defined here. This is the price to pay if we don't want
to maintain a spec file specific to oscar.)
Aside that, the src.rpm are incompatible with the oscar phylosophy (oscar is
not dependant of a specific packaging system). But in some cases, it is a
problem. Indeed, oscar can't be included in a distro (no way to add th src.rpm
in the build process of a distro) Thus Oscar is forced to stay on oit's own
(thus less popularity).
Generating all the src.rpm is very easy and can be added to oscar-packager, but
as said above, the src.rpm alone are not sufficient to build the oscar
rpms...We must keep in mind that we need to keep compatibility with the debin
side as well.
Maybe a solution would be to modify oscar-packager with an option to generate a
quick build tree: generate all the src.rpm and generate a script with the
appropriate rpmbuild commands. (though, I'm not sure that this is easy as we
also need to install generated packages on the fly because of build
dependancies).
IMHO, a 1st step could be to generate the src.rpm "for educational purpose"
with a notice explaining that some src.rpm needs parameter to build in a way
they are compatible with OSCAR.
Sorry for the long mail and poor english, I hope you understand my thinkings.
Have a nice WE.
Best regards,
Olivier.
--
Olivier LAHAYE
CEA DRT/LIST/DCSI/DIR
________________________________
De : DongInn Kim [di...@cs.indiana.edu]
Date d'envoi : vendredi 15 février 2013 18:01
À : Users OSCAR
Objet : Re: [Oscar-users] Feedback required about openmpi with oscar.
I would like to second the openmpi-oscar name and I like Sten's idea of having
src rpm or spec file link of openmpi-oscar too.
Just in case a user is not happy with the bundled openmpi, they can simply
rebuild openmpi with the openmpi-oscar compatible srpm or spec file on their
own way.
I bet that this would make more works on the development side, though.
Regards,
--
- DongInn
On Dec 17, 2012, at 12:47 PM, Sten Wolf
<s...@checkpalm.com<mailto:s...@checkpalm.com>> wrote:
I've been using the OFED version as openmpi by itself, without IB support, is
somewhat useless on most of my installs.
The easiest approach is to simply drop the latest src.rpm into the SRPMS
subdir, then build ofed normally. ofed will pick the latest src rpm and build
it with IB primitives.
This does break epel and distro openmpi, but as I said - these are usually
useless to me without inherent IB support. For the same reason I don't use the
distro's IB tools ( which conflict with ofed's ).
The major downside to this approach - yum update breaks. ofed rpms conflict
with distro's rpms w/o any resolution, but it's easy enough to work around.
Also, I have given up on pbs and am now installing slurm exclusively. But this
is just my experience - slurm for me is easier to use and maintain, easier to
customize and configure for different requirements etc. There is no need to
configure an interface for slurm, the default configuration is supported for
openmpi.
Just my two cents.
On 14/12//2012 15:17, Ibad Kureshi U0850037 wrote:
Hello.
what are you using at the moment?
- custom openmpi build (rpm or nfs share)?
YES, we have /apps/mpi/* over gluster
- epel rpm?
NO
- oscar rpm?
YES, our teaching examples were all created using the oscar rpm version of
openmpi so we have kept it on.
What would help you?
- openmpi-oscar located in /opt
- openmpi located in /opt
- openmpi located in /usr
Any is fine .
Many thanks for your feedback about this point.
Glad to help
Regards
Ibad Kureshi
Lecturer: Department of Engineering and Technology
Administrator: High Performance Computing - Resource Centre
Canal Side East 2/13
University of Huddersfield
Queensgate
Huddersfield HD13DH
t: +44 (0) 1484 471855
---
This transmission is confidential and may be legally privileged. If you receive
it in error, please notify us immediately by e-mail and remove it from your
system. If the content of this e-mail does not relate to the business of the
University of Huddersfield, then we do not endorse it and will accept no
liability.
------------------------------------------------------------------------------
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d
_______________________________________________
Oscar-users mailing list
Oscar-users@lists.sourceforge.net<mailto:Oscar-users@lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/oscar-users
------------------------------------------------------------------------------
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d_______________________________________________
Oscar-users mailing list
Oscar-users@lists.sourceforge.net<mailto:Oscar-users@lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/oscar-users
------------------------------------------------------------------------------
Free Next-Gen Firewall Hardware Offer
Buy your Sophos next-gen firewall before the end March 2013
and get the hardware for free! Learn more.
http://p.sf.net/sfu/sophos-d2d-feb
_______________________________________________
Oscar-users mailing list
Oscar-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/oscar-users