Dear all,

Following recommendations of Chuck Ritter, the openmpi build specific to oscar 
is built into /opt/openmpi-oscar and it should allow the installation of distro 
openmpi without conflict hopefully.

The opkg-openmpi is able to handle both /usr and /opt installations if my 
memory is correct (I done such a thing lately).

For the src.rpm, it's the default openmpi spec file that is used , but the 
openmpi.cfg in oscar specifies specific compilation parameters.
Currently, in unstable, the build options are the following:
rpmbuild  --define "configure_options FC=gfortran --with-tm=/opt/pbs 
--with-blcr=yes --with-ft=cr --with-openib"
                --define "install_in_opt 1"
                --define "ofed 1"
                --define "_name openmpi-oscar"
                --define "install_shell_scripts 1"
                --define "install_modulefile 1"
                --define "modulefile_path /opt/modules/oscar-modulefiles"
                --define "modulefile_subdir openmpi"
                --define "modulefile_name %{name}-%{version}"
                --define "use_mpi_selector 1"
                --define "allow_fortify_source 0"
                --define "modules_rpm_name modules-oscar"
                --define "build_all_in_one_rpm 0"
                openmpi.spec

The good point is that the spec file is maintained upstream, thus at each new 
upstream version, the spec file is updated (new build requires and such)
The cons is that rpmbuild --rebuild openmpi.spec will not produce an oscar 
openmpi. To rebuild the correct package, all the above options must be used. 
(even the rpm name is defined here. This is the price to pay if we don't want 
to maintain a spec file specific to oscar.)

Aside that, the src.rpm are incompatible with the oscar phylosophy (oscar is 
not dependant of a specific packaging system). But in some cases, it is  a 
problem. Indeed, oscar can't be included in a distro (no way to add th src.rpm 
in the build process of a distro) Thus Oscar is forced to stay on oit's own 
(thus less popularity).
Generating all the src.rpm is very easy and can be added to oscar-packager, but 
as said above, the src.rpm alone are not sufficient to build the oscar 
rpms...We must keep in mind that we need to keep compatibility with the debin 
side as well.

Maybe a solution would be to modify oscar-packager with an option to generate a 
quick build tree: generate all the src.rpm and generate a script with the 
appropriate rpmbuild commands. (though, I'm not sure that this is easy as we 
also need to install generated packages on the fly because of build 
dependancies).

IMHO, a 1st step could be to generate the src.rpm "for educational purpose" 
with a notice explaining that some src.rpm needs parameter to build in a way 
they are compatible with OSCAR.

Sorry for the long mail and poor english, I hope you understand my thinkings.

Have a nice WE.

Best regards,

Olivier.
--
   Olivier LAHAYE
   CEA DRT/LIST/DCSI/DIR
________________________________
De : DongInn Kim [di...@cs.indiana.edu]
Date d'envoi : vendredi 15 février 2013 18:01
À : Users OSCAR
Objet : Re: [Oscar-users] Feedback required about openmpi with oscar.

I would like to second the openmpi-oscar name and I like Sten's idea of having 
src rpm or spec file link of openmpi-oscar too.

Just in case a user is not happy with the bundled openmpi, they can simply 
rebuild openmpi with the openmpi-oscar compatible srpm or spec file on their 
own way.
I bet that this would make more works on the development side, though.

Regards,

--
- DongInn

On Dec 17, 2012, at 12:47 PM, Sten Wolf 
<s...@checkpalm.com<mailto:s...@checkpalm.com>> wrote:

I've been using the OFED version as openmpi by itself, without IB support, is 
somewhat useless on most of my installs.
The easiest approach is to simply drop the latest src.rpm into the SRPMS 
subdir, then build ofed normally. ofed will pick the latest src rpm and build 
it with IB primitives.
This does break epel and distro openmpi, but as I said - these are usually 
useless to me without inherent IB support. For the same reason I don't use the 
distro's IB tools ( which conflict with ofed's ).
The major downside to this approach - yum update breaks. ofed rpms conflict 
with distro's rpms w/o any resolution, but it's easy enough to work around.

Also, I have given up on pbs and am now installing slurm exclusively. But this 
is just my experience - slurm for me is easier to use and maintain, easier to 
customize and configure for different requirements etc. There is no need to 
configure an interface for slurm, the default configuration is supported for 
openmpi.

Just my two cents.

On 14/12//2012 15:17, Ibad Kureshi U0850037 wrote:

Hello.



what are you using at the moment?
- custom openmpi build (rpm or nfs share)?


YES, we have /apps/mpi/* over gluster


- epel rpm?


NO


- oscar rpm?


YES, our teaching examples were all created using the oscar rpm version of 
openmpi so we have kept it on.



What would help you?
- openmpi-oscar located in /opt
- openmpi located in /opt
- openmpi located in /usr


Any is fine .



Many thanks for your feedback about this point.


Glad to help


Regards


Ibad Kureshi
Lecturer: Department of Engineering and Technology
Administrator: High Performance Computing - Resource Centre

Canal Side East 2/13
University of Huddersfield
Queensgate
Huddersfield HD13DH
t: +44 (0) 1484 471855


---
This transmission is confidential and may be legally privileged. If you receive 
it in error, please notify us immediately by e-mail and remove it from your 
system. If the content of this e-mail does not relate to the business of the 
University of Huddersfield, then we do not endorse it and will accept no 
liability.

------------------------------------------------------------------------------
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d
_______________________________________________
Oscar-users mailing list
Oscar-users@lists.sourceforge.net<mailto:Oscar-users@lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/oscar-users


------------------------------------------------------------------------------
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d_______________________________________________
Oscar-users mailing list
Oscar-users@lists.sourceforge.net<mailto:Oscar-users@lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/oscar-users

------------------------------------------------------------------------------
Free Next-Gen Firewall Hardware Offer
Buy your Sophos next-gen firewall before the end March 2013 
and get the hardware for free! Learn more.
http://p.sf.net/sfu/sophos-d2d-feb
_______________________________________________
Oscar-users mailing list
Oscar-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/oscar-users

Reply via email to