Re: [OMPI users] CephFS and striping_factor
[AMD Official Use Only - General] I can also offer to help if there are any question regarding the ompio code, but I do not have the bandwidth/resources to do that myself, and more importantly, I do not have a platform to test the new component. Edgar From: users On Behalf Of Jeff Squyres (jsquyres) via users Sent: Tuesday, November 29, 2022 9:16 AM To: users@lists.open-mpi.org Cc: Jeff Squyres (jsquyres) Subject: Re: [OMPI users] CephFS and striping_factor More specifically, Gilles created a skeleton "ceph" component in this draft pull request: https://github.com/open-mpi/ompi/pull/11122 If anyone has any cycles to work on it and develop it beyond the skeleton that is currently there, that would be great! -- Jeff Squyres jsquy...@cisco.com<mailto:jsquy...@cisco.com> From: users mailto:users-boun...@lists.open-mpi.org>> on behalf of Gilles Gouaillardet via users mailto:users@lists.open-mpi.org>> Sent: Monday, November 28, 2022 9:48 PM To: users@lists.open-mpi.org<mailto:users@lists.open-mpi.org> mailto:users@lists.open-mpi.org>> Cc: Gilles Gouaillardet mailto:gil...@rist.or.jp>> Subject: Re: [OMPI users] CephFS and striping_factor Hi Eric, Currently, Open MPI does not provide specific support for CephFS. MPI-IO is either implemented by ROMIO (imported from MPICH, it does not support CephFS today) or the "native" ompio component (that also does not support CephFS today). A proof of concept for CephFS in ompio might not be a huge work for someone motivated: That could be as simple as (so to speak, since things are generally not easy) creating a new fs/ceph component (e.g. in ompi/mca/fs/ceph) and implement the "file_open" callback that uses the ceph API. I think the fs/lustre component can be used as an inspiration. I cannot commit to do this, but if you are willing to take a crack at it, I can create such a component so you can go directly to implementing the callback without spending too much time on some Open MPI internals (e.g. component creation). Cheers, Gilles On 11/29/2022 6:55 AM, Eric Chamberland via users wrote: > Hi, > > I would like to know if OpenMPI is supporting file creation with > "striping_factor" for CephFS? > > According to CephFS library, I *think* it would be possible to do it > at file creation with "ceph_open_layout". > > https://github.com/ceph/ceph/blob/main/src/include/cephfs/libcephfs.h > > Is it a possible futur enhancement? > > Thanks, > > Eric >
Re: [OMPI users] CephFS and striping_factor
More specifically, Gilles created a skeleton "ceph" component in this draft pull request: https://github.com/open-mpi/ompi/pull/11122 If anyone has any cycles to work on it and develop it beyond the skeleton that is currently there, that would be great! -- Jeff Squyres jsquy...@cisco.com From: users on behalf of Gilles Gouaillardet via users Sent: Monday, November 28, 2022 9:48 PM To: users@lists.open-mpi.org Cc: Gilles Gouaillardet Subject: Re: [OMPI users] CephFS and striping_factor Hi Eric, Currently, Open MPI does not provide specific support for CephFS. MPI-IO is either implemented by ROMIO (imported from MPICH, it does not support CephFS today) or the "native" ompio component (that also does not support CephFS today). A proof of concept for CephFS in ompio might not be a huge work for someone motivated: That could be as simple as (so to speak, since things are generally not easy) creating a new fs/ceph component (e.g. in ompi/mca/fs/ceph) and implement the "file_open" callback that uses the ceph API. I think the fs/lustre component can be used as an inspiration. I cannot commit to do this, but if you are willing to take a crack at it, I can create such a component so you can go directly to implementing the callback without spending too much time on some Open MPI internals (e.g. component creation). Cheers, Gilles On 11/29/2022 6:55 AM, Eric Chamberland via users wrote: > Hi, > > I would like to know if OpenMPI is supporting file creation with > "striping_factor" for CephFS? > > According to CephFS library, I *think* it would be possible to do it > at file creation with "ceph_open_layout". > > https://github.com/ceph/ceph/blob/main/src/include/cephfs/libcephfs.h > > Is it a possible futur enhancement? > > Thanks, > > Eric >
Re: [OMPI users] CephFS and striping_factor
Hi Eric, Currently, Open MPI does not provide specific support for CephFS. MPI-IO is either implemented by ROMIO (imported from MPICH, it does not support CephFS today) or the "native" ompio component (that also does not support CephFS today). A proof of concept for CephFS in ompio might not be a huge work for someone motivated: That could be as simple as (so to speak, since things are generally not easy) creating a new fs/ceph component (e.g. in ompi/mca/fs/ceph) and implement the "file_open" callback that uses the ceph API. I think the fs/lustre component can be used as an inspiration. I cannot commit to do this, but if you are willing to take a crack at it, I can create such a component so you can go directly to implementing the callback without spending too much time on some Open MPI internals (e.g. component creation). Cheers, Gilles On 11/29/2022 6:55 AM, Eric Chamberland via users wrote: Hi, I would like to know if OpenMPI is supporting file creation with "striping_factor" for CephFS? According to CephFS library, I *think* it would be possible to do it at file creation with "ceph_open_layout". https://github.com/ceph/ceph/blob/main/src/include/cephfs/libcephfs.h Is it a possible futur enhancement? Thanks, Eric
[OMPI users] CephFS and striping_factor
Hi, I would like to know if OpenMPI is supporting file creation with "striping_factor" for CephFS? According to CephFS library, I *think* it would be possible to do it at file creation with "ceph_open_layout". https://github.com/ceph/ceph/blob/main/src/include/cephfs/libcephfs.h Is it a possible futur enhancement? Thanks, Eric -- Eric Chamberland, ing., M. Ing Professionnel de recherche GIREF/Université Laval (418) 656-2131 poste 41 22 42
