Hello, I'm working on a pet research project in which I'm (somewhat abashedly) actually _removing_ functionality from PVFS2. What I'm trying to do is create a new trove interface in which requests to disk are no longer logically striped across multiple PVFS2 servers each with its own physical storage but are rather passed transparently from client through PVFS2 onto a second and underlying shared file system on which each PVFS2 server is mounted.
In order to do this, I have extended IO requests to pass the logical filenames along with the handles and I have further modified PINT_distribute(footnote 1) to use the file distribution info to translate its physical offset into the actual logical file offset and then pass this logical offset to the PINT_ADD_SEGMENT macro. This works in that files written to pvfs2 servers are transparently created in the pvfs2 storage space. These files can then be correctly read directly from the other underlying shared file system. However, they can no longer be read correctly through the PVFS2 servers. Perhaps when I write to the actual logical offsets instead of to the striped offsets, I am fooling the pvfs2 servers into thinking those logical offsets are actually the striped ones? When I try to read the file back, I get a file that is N times the correct size where N is the number of data servers. What happens is that each server gives me each segment of the file thinking that segment is unique to it. (at least this is what I think is happening) Does anyone have any suggestions where else I should look in the code to modify this? Thanks, John footnote 1: This is not very clean to do this in the PINT_distribute function. I did try to keep my changes isolated with the new trove layer by passing the distribution info to the trove_bstream_[read|write]_list functions but this had the same problem when I did the readback through the PVFS2 servers as well as having the additional problem that the readback directly through the other shared file system was _almost_ correct but somehow off by a little bit (seemingly at the end of the file). _______________________________________________ Pvfs2-developers mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
