Re: [OMPI users] MPIIO max record size

2013-07-19 Thread Rob Latham
On Wed, May 22, 2013 at 12:23:36PM -0400, Eric Chamberland wrote: > On 05/22/2013 11:33 AM, Tom Rosmond wrote: > >Thanks for the confirmation of the MPIIO problem. Interestingly, we > >have the same problem when using MPIIO in INTEL MPI. So something > >fundamental seems to be wrong. > > > > I t

Re: [OMPI users] MPIIO max record size

2013-05-22 Thread Eric Chamberland
On 05/22/2013 12:37 PM, Ralph Castain wrote: Well, ROMIO was written by Argonne/MPICH (unfair to point the finger solely at Rob) and picked up by pretty much everyone. The issue isn't a bug in MPIIO, but rather Ok, sorry about that! thanks for the historical and technical informations! Eric

Re: [OMPI users] MPIIO max record size

2013-05-22 Thread Tom Rosmond
I was afraid that was the case. Too bad, because applications (and the files they use), are getting much too big for the 32 bit limit. T. Rosmond On Wed, 2013-05-22 at 09:37 -0700, Ralph Castain wrote: > On May 22, 2013, at 9:23 AM, Eric Chamberland > wrote: > > > On 05/22/2013 11:33 AM, Tom

Re: [OMPI users] MPIIO max record size

2013-05-22 Thread Ralph Castain
On May 22, 2013, at 9:23 AM, Eric Chamberland wrote: > On 05/22/2013 11:33 AM, Tom Rosmond wrote: >> Thanks for the confirmation of the MPIIO problem. Interestingly, we >> have the same problem when using MPIIO in INTEL MPI. So something >> fundamental seems to be wrong. >> > > I think but

Re: [OMPI users] MPIIO max record size

2013-05-22 Thread Eric Chamberland
On 05/22/2013 11:33 AM, Tom Rosmond wrote: Thanks for the confirmation of the MPIIO problem. Interestingly, we have the same problem when using MPIIO in INTEL MPI. So something fundamental seems to be wrong. I think but I am not sure that it is because the MPI I/O (ROMIO) code is the same f

Re: [OMPI users] MPIIO max record size

2013-05-22 Thread Eric Chamberland
I have experienced the same problem.. and worst, I have discovered a bug in MPI I/O... look here: http://trac.mpich.org/projects/mpich/ticket/1742 and here: http://www.open-mpi.org/community/lists/users/2012/10/20511.php Eric On 05/21/2013 03:18 PM, Tom Rosmond wrote: Hello: A colleague an

[OMPI users] MPIIO max record size

2013-05-21 Thread Tom Rosmond
Hello: A colleague and I are running an atmospheric ensemble data assimilation system using MPIIO. We find that if for an individual MPI_FILE_READ_AT_ALL the block of data read exceeds 2**31 elements, the program fails. Our application is 32 bit fortran (Intel), so we certainly can see why this