Re: [OMPI users] OrangeFS ROMIO support

[Ralph Castain]

Did you see the note I forwarded to you about SLES issues? Not sure if that is 
on your side or ours

On Feb 28, 2014, at 12:05 PM, Latham, Robert J.  wrote:

> On Wed, 2014-02-26 at 17:14 -0600, Edgar Gabriel wrote:
>> that was my fault, I did not follow up the time, got probably side
>> tracked by something. Anyway, I suspect that you actually have the
>> patch, otherwise the current Open MPI trunk and the 1.7 release series
>> would not have the patch after the last ROMIO update  - at least I did
>> not reapply it, not sure whether Nathan did.
> 
> Well, thanks for apologizing for not following up.  I was about to get
> good and angry, but you've taken away my righteous fury! :>
> 
> I've gone through six years worth of OpenMPI romio changes: everything
> since 
> r16693 | adi | 2007-11-08 06:54:48 -0600 (Thu, 08 Nov 2007) | 2 lines
> 
> and picked up a few changes.  I'm sure everyone will be happy that I
> found the "fix a catamount build warning" change, that was never sent
> upstream to us :>  .   Do you know of any other old patches I should
> look at?
> 
> I've also done a diff of the two source trees.   OpenMPI ROMIO is
> missing 
> - some Blue Gene fixes (probably not relevant?) 
> - some large-datatype processing fixes (probably more interesting).
> - better (any) handling of retrying write(2) and read(2) system calls
> when they return less than requested
> - better memory cleanup in error cases
> - a configure-time check for the need for constification of bindings.
> (not relevant: openmpi is constified)
> - external32 support routines (but external32 is only "mostly there".
> Dave knows the details)
> - 
> 
> I saw mentions in the SVN logs of a pending "updated PanFS driver" but
> that was several years ago, and the two drivers are the same right now.
> Is there a secret PanFS repository I should raid?
> 
> There are still a good deal of Ompi-specific changes that I don't want
> to pull into ROMIO, especially anything dealing with the build system. 
> 
> I should bring this up on openmpi-devel, but I pushed these changes to a
> review branch:
> http://git.mpich.org/mpich-dev.git/shortlog/refs/heads/romio_sync_from_ompi
> 
> ==rob
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users

Re: [OMPI users] OrangeFS ROMIO support

[Latham, Robert J.]

On Wed, 2014-02-26 at 17:14 -0600, Edgar Gabriel wrote:
> that was my fault, I did not follow up the time, got probably side
> tracked by something. Anyway, I suspect that you actually have the
> patch, otherwise the current Open MPI trunk and the 1.7 release series
> would not have the patch after the last ROMIO update  - at least I did
> not reapply it, not sure whether Nathan did.

Well, thanks for apologizing for not following up.  I was about to get
good and angry, but you've taken away my righteous fury! :>

I've gone through six years worth of OpenMPI romio changes: everything
since 
r16693 | adi | 2007-11-08 06:54:48 -0600 (Thu, 08 Nov 2007) | 2 lines

and picked up a few changes.  I'm sure everyone will be happy that I
found the "fix a catamount build warning" change, that was never sent
upstream to us :>  .   Do you know of any other old patches I should
look at?

I've also done a diff of the two source trees.   OpenMPI ROMIO is
missing 
- some Blue Gene fixes (probably not relevant?) 
- some large-datatype processing fixes (probably more interesting).
- better (any) handling of retrying write(2) and read(2) system calls
when they return less than requested
- better memory cleanup in error cases
- a configure-time check for the need for constification of bindings.
(not relevant: openmpi is constified)
- external32 support routines (but external32 is only "mostly there".
Dave knows the details)
- 

I saw mentions in the SVN logs of a pending "updated PanFS driver" but
that was several years ago, and the two drivers are the same right now.
Is there a secret PanFS repository I should raid?

There are still a good deal of Ompi-specific changes that I don't want
to pull into ROMIO, especially anything dealing with the build system. 

I should bring this up on openmpi-devel, but I pushed these changes to a
review branch:
http://git.mpich.org/mpich-dev.git/shortlog/refs/heads/romio_sync_from_ompi

==rob

Re: [OMPI users] OrangeFS ROMIO support

[Edgar Gabriel]

that was my fault, I did not follow up the time, got probably side
tracked by something. Anyway, I suspect that you actually have the
patch, otherwise the current Open MPI trunk and the 1.7 release series
would not have the patch after the last ROMIO update  - at least I did
not reapply it, not sure whether Nathan did.

Thanks
Edgar

On 2/26/2014 4:52 PM, Latham, Robert J. wrote:
> On Tue, 2014-02-25 at 07:26 -0600, Edgar Gabriel wrote:
>> this was/is a bug in ROMIO, in which they assume a datatype is an int. I
>> fixed it originally in a previous version of Open MPI on the trunk, but
>> it did not get ported upstream, so we might have to do the same fix again.
>>
> 
> Sorry about that.  I'm going through OpenMPI SVN now to see what other
> gems I may have dropped.
> 
> ==rob
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
> 

-- 
Edgar Gabriel
Associate Professor
Parallel Software Technologies Lab  http://pstl.cs.uh.edu
Department of Computer Science  University of Houston
Philip G. Hoffman Hall, Room 524Houston, TX-77204, USA
Tel: +1 (713) 743-3857  Fax: +1 (713) 743-3335



signature.asc
Description: OpenPGP digital signature

Re: [OMPI users] OrangeFS ROMIO support

[Latham, Robert J.]

On Tue, 2014-02-25 at 07:26 -0600, Edgar Gabriel wrote:
> this was/is a bug in ROMIO, in which they assume a datatype is an int. I
> fixed it originally in a previous version of Open MPI on the trunk, but
> it did not get ported upstream, so we might have to do the same fix again.
> 

Sorry about that.  I'm going through OpenMPI SVN now to see what other
gems I may have dropped.

==rob

Re: [OMPI users] OrangeFS ROMIO support

[Jeff Squyres (jsquyres)]

Thanks!

On Feb 25, 2014, at 8:45 AM, Edgar Gabriel  wrote:

> give me day ( I am currently out of town) to dig up the patch again, and
> reapply it again to the trunk, we can CMR it to 1.6 and 1.7. I did not
> follow up at that time, since nobody else seemed to care. I guess the
> number of users using the combination of OPen MPI + ROMIO + PVFS2 is
> pretty low.
> 
> Thanks
> Edgar
> 
> On 2/25/2014 7:34 AM, Jeff Squyres (jsquyres) wrote:
>> Edgar --
>> 
>> Is there a fix that we should CMR to the v1.6 branch?
>> 
>> 
>> On Feb 25, 2014, at 8:26 AM, Edgar Gabriel  wrote:
>> 
>>> this was/is a bug in ROMIO, in which they assume a datatype is an int. I
>>> fixed it originally in a previous version of Open MPI on the trunk, but
>>> it did not get ported upstream, so we might have to do the same fix again.
>>> 
>>> Thanks
>>> Edgar
>>> 
>>> On 2/25/2014 7:15 AM, vithanousek wrote:
 Hello,
 
 At fisrt, please, excuse my poor level of english.
 
 I'm little bit confused by versions of OpenMPI and ROMIO, because i met
 siliar bugs reported in multiple versions. Im buliding version 1.6.5
 (current stable).
 
 I compiled OpenMPI 1.6.5 with included ROMIO by doing this:
 
 ./configure --prefix=/usr/local/openmpi_1.6.5_romio \
 --with-io-romio-flags='--with-pvfs2=/usr/local/orangefs'
 make -j 32
 
 and I got error message:
 (...)
 ad_pvfs2_io_dtype.c: In function 'convert_named':
 ad_pvfs2_io_dtype.c:581: error: switch quantity not an integer
 ad_pvfs2_io_dtype.c:583: error: pointers are not permitted as case values
 (...)
 
 I rewrited "switch" construction to multiple "if" constructions. This
 solve compiling problem.
 But I cant use myself edited source code of OpenMPI on our cluster.
 Is this bug of sourcecode and will be fixed, or am I doing something wrong?
 
 Thanks for reply
 Hanousek Vít
 
 
 ___
 users mailing list
 us...@open-mpi.org
 http://www.open-mpi.org/mailman/listinfo.cgi/users
 
>>> 
>>> -- 
>>> Edgar Gabriel
>>> Associate Professor
>>> Parallel Software Technologies Lab  http://pstl.cs.uh.edu
>>> Department of Computer Science  University of Houston
>>> Philip G. Hoffman Hall, Room 524Houston, TX-77204, USA
>>> Tel: +1 (713) 743-3857  Fax: +1 (713) 743-3335
>>> 
>>> ___
>>> users mailing list
>>> us...@open-mpi.org
>>> http://www.open-mpi.org/mailman/listinfo.cgi/users
>> 
>> 
> 
> -- 
> Edgar Gabriel
> Associate Professor
> Parallel Software Technologies Lab  http://pstl.cs.uh.edu
> Department of Computer Science  University of Houston
> Philip G. Hoffman Hall, Room 524Houston, TX-77204, USA
> Tel: +1 (713) 743-3857  Fax: +1 (713) 743-3335
> 
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users


-- 
Jeff Squyres
jsquy...@cisco.com
For corporate legal information go to: 
http://www.cisco.com/web/about/doing_business/legal/cri/

Re: [OMPI users] OrangeFS ROMIO support

[Edgar Gabriel]

give me day ( I am currently out of town) to dig up the patch again, and
reapply it again to the trunk, we can CMR it to 1.6 and 1.7. I did not
follow up at that time, since nobody else seemed to care. I guess the
number of users using the combination of OPen MPI + ROMIO + PVFS2 is
pretty low.

Thanks
Edgar

On 2/25/2014 7:34 AM, Jeff Squyres (jsquyres) wrote:
> Edgar --
> 
> Is there a fix that we should CMR to the v1.6 branch?
> 
> 
> On Feb 25, 2014, at 8:26 AM, Edgar Gabriel  wrote:
> 
>> this was/is a bug in ROMIO, in which they assume a datatype is an int. I
>> fixed it originally in a previous version of Open MPI on the trunk, but
>> it did not get ported upstream, so we might have to do the same fix again.
>>
>> Thanks
>> Edgar
>>
>> On 2/25/2014 7:15 AM, vithanousek wrote:
>>> Hello,
>>>
>>> At fisrt, please, excuse my poor level of english.
>>>
>>> I'm little bit confused by versions of OpenMPI and ROMIO, because i met
>>> siliar bugs reported in multiple versions. Im buliding version 1.6.5
>>> (current stable).
>>>
>>> I compiled OpenMPI 1.6.5 with included ROMIO by doing this:
>>>
>>> ./configure --prefix=/usr/local/openmpi_1.6.5_romio \
>>> --with-io-romio-flags='--with-pvfs2=/usr/local/orangefs'
>>> make -j 32
>>>
>>> and I got error message:
>>> (...)
>>> ad_pvfs2_io_dtype.c: In function 'convert_named':
>>> ad_pvfs2_io_dtype.c:581: error: switch quantity not an integer
>>> ad_pvfs2_io_dtype.c:583: error: pointers are not permitted as case values
>>> (...)
>>>
>>> I rewrited "switch" construction to multiple "if" constructions. This
>>> solve compiling problem.
>>> But I cant use myself edited source code of OpenMPI on our cluster.
>>> Is this bug of sourcecode and will be fixed, or am I doing something wrong?
>>>
>>> Thanks for reply
>>> Hanousek Vít
>>>
>>>
>>> ___
>>> users mailing list
>>> us...@open-mpi.org
>>> http://www.open-mpi.org/mailman/listinfo.cgi/users
>>>
>>
>> -- 
>> Edgar Gabriel
>> Associate Professor
>> Parallel Software Technologies Lab  http://pstl.cs.uh.edu
>> Department of Computer Science  University of Houston
>> Philip G. Hoffman Hall, Room 524Houston, TX-77204, USA
>> Tel: +1 (713) 743-3857  Fax: +1 (713) 743-3335
>>
>> ___
>> users mailing list
>> us...@open-mpi.org
>> http://www.open-mpi.org/mailman/listinfo.cgi/users
> 
> 

-- 
Edgar Gabriel
Associate Professor
Parallel Software Technologies Lab  http://pstl.cs.uh.edu
Department of Computer Science  University of Houston
Philip G. Hoffman Hall, Room 524Houston, TX-77204, USA
Tel: +1 (713) 743-3857  Fax: +1 (713) 743-3335



signature.asc
Description: OpenPGP digital signature

Re: [OMPI users] OrangeFS ROMIO support

[Jeff Squyres (jsquyres)]

Edgar --

Is there a fix that we should CMR to the v1.6 branch?


On Feb 25, 2014, at 8:26 AM, Edgar Gabriel  wrote:

> this was/is a bug in ROMIO, in which they assume a datatype is an int. I
> fixed it originally in a previous version of Open MPI on the trunk, but
> it did not get ported upstream, so we might have to do the same fix again.
> 
> Thanks
> Edgar
> 
> On 2/25/2014 7:15 AM, vithanousek wrote:
>> Hello,
>> 
>> At fisrt, please, excuse my poor level of english.
>> 
>> I'm little bit confused by versions of OpenMPI and ROMIO, because i met
>> siliar bugs reported in multiple versions. Im buliding version 1.6.5
>> (current stable).
>> 
>> I compiled OpenMPI 1.6.5 with included ROMIO by doing this:
>> 
>> ./configure --prefix=/usr/local/openmpi_1.6.5_romio \
>> --with-io-romio-flags='--with-pvfs2=/usr/local/orangefs'
>> make -j 32
>> 
>> and I got error message:
>> (...)
>> ad_pvfs2_io_dtype.c: In function 'convert_named':
>> ad_pvfs2_io_dtype.c:581: error: switch quantity not an integer
>> ad_pvfs2_io_dtype.c:583: error: pointers are not permitted as case values
>> (...)
>> 
>> I rewrited "switch" construction to multiple "if" constructions. This
>> solve compiling problem.
>> But I cant use myself edited source code of OpenMPI on our cluster.
>> Is this bug of sourcecode and will be fixed, or am I doing something wrong?
>> 
>> Thanks for reply
>> Hanousek Vít
>> 
>> 
>> ___
>> users mailing list
>> us...@open-mpi.org
>> http://www.open-mpi.org/mailman/listinfo.cgi/users
>> 
> 
> -- 
> Edgar Gabriel
> Associate Professor
> Parallel Software Technologies Lab  http://pstl.cs.uh.edu
> Department of Computer Science  University of Houston
> Philip G. Hoffman Hall, Room 524Houston, TX-77204, USA
> Tel: +1 (713) 743-3857  Fax: +1 (713) 743-3335
> 
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users


-- 
Jeff Squyres
jsquy...@cisco.com
For corporate legal information go to: 
http://www.cisco.com/web/about/doing_business/legal/cri/

Re: [OMPI users] OrangeFS ROMIO support

[vithanousek]

Okey.
Thanks You for you reply.

Hanousek Vít




-- Původní zpráva --
Od: Edgar Gabriel <gabr...@cs.uh.edu>
Komu: Open MPI Users <us...@open-mpi.org>
Datum: 25. 2. 2014 14:26:43
Předmět: Re: [OMPI users] OrangeFS ROMIO support

"this was/is a bug in ROMIO, in which they assume a datatype is an int. I
fixed it originally in a previous version of Open MPI on the trunk, but
it did not get ported upstream, so we might have to do the same fix again.

Thanks
Edgar

On 2/25/2014 7:15 AM, vithanousek wrote:
> Hello,
> 
> At fisrt, please, excuse my poor level of english.
> 
> I'm little bit confused by versions of OpenMPI and ROMIO, because i met
> siliar bugs reported in multiple versions. Im buliding version 1.6.5
> (current stable).
> 
> I compiled OpenMPI 1.6.5 with included ROMIO by doing this:
> 
> ./configure --prefix=/usr/local/openmpi_1.6.5_romio \
> --with-io-romio-flags='--with-pvfs2=/usr/local/orangefs'
> make -j 32
> 
> and I got error message:
> (...)
> ad_pvfs2_io_dtype.c: In function 'convert_named':
> ad_pvfs2_io_dtype.c:581: error: switch quantity not an integer
> ad_pvfs2_io_dtype.c:583: error: pointers are not permitted as case values
> (...)
> 
> I rewrited "switch" construction to multiple "if" constructions. This
> solve compiling problem.
> But I cant use myself edited source code of OpenMPI on our cluster.
> Is this bug of sourcecode and will be fixed, or am I doing something 
wrong?
> 
> Thanks for reply
> Hanousek Vít
> 
> 
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
> 

-- 
Edgar Gabriel
Associate Professor
Parallel Software Technologies Lab http://pstl.cs.uh.edu
Department of Computer Science University of Houston
Philip G. Hoffman Hall, Room 524 Houston, TX-77204, USA
Tel: +1 (713) 743-3857 Fax: +1 (713) 743-3335___

users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users;

Re: [OMPI users] OrangeFS ROMIO support

[Edgar Gabriel]

this was/is a bug in ROMIO, in which they assume a datatype is an int. I
fixed it originally in a previous version of Open MPI on the trunk, but
it did not get ported upstream, so we might have to do the same fix again.

Thanks
Edgar

On 2/25/2014 7:15 AM, vithanousek wrote:
> Hello,
> 
> At fisrt, please, excuse my poor level of english.
> 
> I'm little bit confused by versions of OpenMPI and ROMIO, because i met
> siliar bugs reported in multiple versions. Im buliding version 1.6.5
> (current stable).
> 
> I compiled OpenMPI 1.6.5 with included ROMIO by doing this:
> 
> ./configure --prefix=/usr/local/openmpi_1.6.5_romio \
> --with-io-romio-flags='--with-pvfs2=/usr/local/orangefs'
> make -j 32
> 
> and I got error message:
> (...)
> ad_pvfs2_io_dtype.c: In function 'convert_named':
> ad_pvfs2_io_dtype.c:581: error: switch quantity not an integer
> ad_pvfs2_io_dtype.c:583: error: pointers are not permitted as case values
> (...)
> 
> I rewrited "switch" construction to multiple "if" constructions. This
> solve compiling problem.
> But I cant use myself edited source code of OpenMPI on our cluster.
> Is this bug of sourcecode and will be fixed, or am I doing something wrong?
> 
> Thanks for reply
> Hanousek Vít
> 
> 
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
> 

-- 
Edgar Gabriel
Associate Professor
Parallel Software Technologies Lab  http://pstl.cs.uh.edu
Department of Computer Science  University of Houston
Philip G. Hoffman Hall, Room 524Houston, TX-77204, USA
Tel: +1 (713) 743-3857  Fax: +1 (713) 743-3335



signature.asc
Description: OpenPGP digital signature

[OMPI users] OrangeFS ROMIO support

[vithanousek]

Hello,

At fisrt, please, excuse my poor level of english.

I'm little bit confused by versions of OpenMPI and ROMIO, because i met 
siliar bugs reported in multiple versions. Im buliding version 1.6.5 
(current stable).

I compiled OpenMPI 1.6.5 with included ROMIO by doing this:

./configure --prefix=/usr/local/openmpi_1.6.5_romio \ --with-io-romio-flags=
'--with-pvfs2=/usr/local/orangefs'
make -j 32

and I got error message:
(...)
ad_pvfs2_io_dtype.c: In function 'convert_named': 
ad_pvfs2_io_dtype.c:581: error: switch quantity not an integer 
ad_pvfs2_io_dtype.c:583: error: pointers are not permitted as case values 
(...)

I rewrited "switch" construction to multiple "if" constructions. This solve 
compiling problem. 
But I cant use myself edited source code of OpenMPI on our cluster. 
Is this bug of sourcecode and will be fixed, or am I doing something wrong?

Thanks for reply
Hanousek Vít