I just checked the code for testing 2GB limitation in OMPIO. The code works with OMPIO's " fcoll dynamic" module. Although it does have the same 2GB limitation with the two_phase module which is based on ROMIO's implementation and the static module. I have a fix for both these modules I will commit them to trunk shortly.
Thanks Vish Vishwanath Venkatesan Graduate Research Assistant Parallel Software Technologies Lab Department of Computer Science University of Houston TX, USA www.cs.uh.edu/~venkates On Nov 7, 2012, at 3:47 AM, Ralph Castain wrote: > Hi Rayson > > We take snapshots from time to time. We debated whether or not to update > again for the 1.7 release, but ultimately decided not to do so - IIRC, none > of our developers had the time. > > If you are interested and willing to do the update, and perhaps look at > removing the limit, that is fine with me! You might check to see if the > latest ROMIO can go past 2GB - could be that an update is all that is > required. > > Alternatively, you might check with Edgar Gabriel about the ompio component > and see if it either supports > 2GB sizes or can also be extended to do so. > Might be that a simple change to select that module instead of ROMIO would > meet the need. > > Appreciate your interest in contributing! > Ralph > > > On Tue, Nov 6, 2012 at 11:55 AM, Rayson Ho <raysonlo...@gmail.com> wrote: > How is the ROMIO code in Open MPI developed & maintained? Do Open MPI > releases take snapshots of the ROMIO code from time to time from the > ROMIO project, or was the ROMIO code forked a while ago and maintained > separately in Open MPI?? > > I would like to fix the 2GB limit in the ROMIO code... and that's why > I am asking! :-D > > Rayson > > ================================================== > Open Grid Scheduler - The Official Open Source Grid Engine > http://gridscheduler.sourceforge.net/ > > > On Thu, Nov 1, 2012 at 6:21 PM, Richard Shaw <jr...@cita.utoronto.ca> wrote: > > Hi Rayson, > > > > Just seen this. > > > > In the end we've worked around it, by creating successive views of the file > > that are all else than 2GB and then offsetting them to eventually read in > > everything. It's a bit of a pain to keep track of, but it works at the > > moment. > > > > I was intending on following your hints and trying to fix the bug myself, > > but I've been short on time so haven't gotten around to it yet. > > > > Richard > > > > On Saturday, 20 October, 2012 at 10:12 AM, Rayson Ho wrote: > > > > Hi Eric, > > > > Sounds like it's also related to this problem reported by Scinet back in > > July: > > > > http://www.open-mpi.org/community/lists/users/2012/07/19762.php > > > > And I think I found the issue, but I still have not followed up with > > the ROMIO guys yet. And I was not sure if Scinet was waiting for the > > fix or not - next time I visit U of Toronto, I will see if I can visit > > the Scinet office and meet with the Scinet guys! > > > > > > > > > > _______________________________________________ > > users mailing list > > us...@open-mpi.org > > http://www.open-mpi.org/mailman/listinfo.cgi/users > _______________________________________________ > devel mailing list > de...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/devel > > _______________________________________________ > devel mailing list > de...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/devel
