Cédric Lambert wrote: > Hi WangDi, > > 12521 is a private bugzilla. Could it be possible to access it ? > Oh, this adio driver is developed by Oak Ridge National lib and SUN together. > Generally speaking, do you know performance problem with ufs adio driver with > small I/Os from multiple clients and if it is the case should it be enhanced > with lustre adio driver ? > Yes, most of the filesystem does not like this kind of small I/Os from mulitple clients. UFS driver will not reorganize these data from multiple clients, if it is not interleave. Lustre ADIO driver will reorganize these small piece of data no matter whether it is interleaved. And also it will reorganize the data according where the data is located,(which ost) instead of split the data evenly when redistributing the data to each clients.
Thanks WangDi > Do some bugzilla exist about this problem ? > Hmm, It seems other bug could not resolve this effectively if the small I/O from multi-clients, except ADIO driver. Because only adio driver could regroup these data from different client currently, and also might write it by data-sieving to avoid small I/O. Thanks WangDi > Regards > Cédric Lambert > > Tom.Wang a écrit : > >> Jim Williams wrote: >> >> >>> When running an earlier version of lustre (1.4.6) we had partial mpi-io >>> support. >>> Since upgrading to 1.4.11, that seems to have disappeared. The version >>> that >>> we're running is a local compile & 1.4.6 was provided by Sun when we >>> deployed >>> the machine. After searching the list archives I see references to the >>> adio >>> driver in the contrib tree & I suspect that the person who built the >>> version >>> that we're running didn't include it. Is that the only missing component >>> or do >>> I need to do anything else to get mpi-io to work? Thanks in advance. >>> >>> >>> >> I am not sure what kind of mpi-io support you want. Actualy, without >> lustre adio driver you can still built and install mpi-io, ufs adio driver >> will be used in this case. We are working on lustre adio driver, you can >> track >> this on bug 12521. The new version lustre adio driver should be available >> in 1 or 2 month. If you want try original lustre adio driver, it should >> be in >> lustre/lustre/contrib on 1.4.11 and 1.6.3. >> >> Thanks >> WangDi >> >> >> >> _______________________________________________ >> Lustre-discuss mailing list >> [email protected] >> https://mail.clusterfs.com/mailman/listinfo/lustre-discuss >> >> >> > > _______________________________________________ > Lustre-discuss mailing list > [email protected] > https://mail.clusterfs.com/mailman/listinfo/lustre-discuss > _______________________________________________ Lustre-discuss mailing list [email protected] https://mail.clusterfs.com/mailman/listinfo/lustre-discuss
