[CentOS] Overlay Filesystem Mounts?
Greetings- Is it possible to mount multiple block devices (or network devices over NFS/CIFS) such that the contents of the mounts appear in one location? For example, lets say I have these shares available: \\server1\volume1\ \\server1\volume2\ \\server1\volume3\ All three contain a directory called data, with different subdirectories. Typically, these would be mounted like so: mount \\server1\volume1\ /mnt/s1v1 mount \\server1\volume2\ /mnt/s1v2 mount \\server1\volume3\ /mnt/s1v3 And, each would have a corresponding 'data' dir at those mounts: /mnt/s1v1/data /mnt/s1v2/data /mnt/s1v3/data However, it is possible to mount all of the shares to one location, such that there is one 'data' dir, with the combined contents of each of the three shares? So, all shares are mounted at /mnt/s1, and the contents of the multiple data dirs appears in one single data dir? The only time I've seen such functionality is within the XBMC media center application. It allows you to mount multiple network shares, but shows them all in one location as a sort of 'overlay' view. Duplicate directories are shown have their contents merged, but remain intact on the actual shares/filesystem. Does any of this make sense? Is it possible with CentOS (pref. 6) ? --Tim ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Overlay Filesystem Mounts?
Vreme: 11/15/2011 05:44 PM, Tim Nelson piše: However, it is possible to mount all of the shares to one location, such that there is one 'data' dir, with the combined contents of each of the three shares? So, all shares are mounted at /mnt/s1, and the contents of the multiple data dirs appears in one single data dir? The only time I've seen such functionality is within the XBMC media center application. It allows you to mount multiple network shares, but shows them all in one location as a sort of 'overlay' view. Duplicate directories are shown have their contents merged, but remain intact on the actual shares/filesystem. Does any of this make sense? Is it possible with CentOS (pref. 6) ? If nothing else, you could create ans script that would create symlinks from all files in those directories into single one. I use that technique to create combined repository directory for mrepo. -- Ljubomir Ljubojevic (Love is in the Air) PL Computers Serbia, Europe Google is the Mother, Google is the Father, and traceroute is your trusty Spiderman... StarOS, Mikrotik and CentOS/RHEL/Linux consultant ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Overlay Filesystem Mounts?
- Original Message - Vreme: 11/15/2011 05:44 PM, Tim Nelson piše: However, it is possible to mount all of the shares to one location, such that there is one 'data' dir, with the combined contents of each of the three shares? So, all shares are mounted at /mnt/s1, and the contents of the multiple data dirs appears in one single data dir? The only time I've seen such functionality is within the XBMC media center application. It allows you to mount multiple network shares, but shows them all in one location as a sort of 'overlay' view. Duplicate directories are shown have their contents merged, but remain intact on the actual shares/filesystem. Does any of this make sense? Is it possible with CentOS (pref. 6) ? If nothing else, you could create ans script that would create symlinks from all files in those directories into single one. I use that technique to create combined repository directory for mrepo. I'm already doing this. It works, but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically. --Tim ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Overlay Filesystem Mounts?
On Tue, 15 Nov 2011, Tim Nelson wrote: I'm already doing this. It works, but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically. Presumably it's be easy enough to knock up with fuse, but there'd be a small performance hit compared to the symlink approach. Why are you wanting to do this out of interest? Are you merging filesystems from multiple servers? jh ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Overlay Filesystem Mounts?
- Original Message - On Tue, 15 Nov 2011, Tim Nelson wrote: I'm already doing this. It works, but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically. Presumably it's be easy enough to knock up with fuse, but there'd be a small performance hit compared to the symlink approach. A small loss of performance would be acceptable. Why are you wanting to do this out of interest? Are you merging filesystems from multiple servers? Yes, multiple exports on multiple servers. The data is read by a legacy application that does not have a concept of 'multiple data locations' in which to read data from. :-/ --Tim ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Overlay Filesystem Mounts?
On Tue, 15 Nov 2011, Tim Nelson wrote: - Original Message - On Tue, 15 Nov 2011, Tim Nelson wrote: I'm already doing this. It works, but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically. Presumably it's be easy enough to knock up with fuse, but there'd be a small performance hit compared to the symlink approach. A small loss of performance would be acceptable. Why are you wanting to do this out of interest? Are you merging filesystems from multiple servers? Yes, multiple exports on multiple servers. The data is read by a legacy application that does not have a concept of 'multiple data locations' in which to read data from. :-/ Anything of interest here? http://en.wikipedia.org/wiki/UnionFS jh ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Overlay Filesystem Mounts?
- Original Message - Anything of interest here? http://en.wikipedia.org/wiki/UnionFS YES, very interesting. This looks on paper at least to be what I'm looking for. Thanks for the pointer! --Tim ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Overlay Filesystem Mounts?
Vreme: 11/15/2011 06:39 PM, John Hodrien piše: On Tue, 15 Nov 2011, Tim Nelson wrote: - Original Message - On Tue, 15 Nov 2011, Tim Nelson wrote: I'm already doing this. It works, but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically. Presumably it's be easy enough to knock up with fuse, but there'd be a small performance hit compared to the symlink approach. A small loss of performance would be acceptable. Why are you wanting to do this out of interest? Are you merging filesystems from multiple servers? Yes, multiple exports on multiple servers. The data is read by a legacy application that does not have a concept of 'multiple data locations' in which to read data from. :-/ Anything of interest here? http://en.wikipedia.org/wiki/UnionFS jh ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos Yup, that should be it. Available Packages funionfs.x86_64 0.4.3-6.el6epel fuse-unionfs.x86_64 0.23-1.el6.rf repoforge Repoforge built variant seams better, but do not hold me for it. -- Ljubomir Ljubojevic (Love is in the Air) PL Computers Serbia, Europe Google is the Mother, Google is the Father, and traceroute is your trusty Spiderman... StarOS, Mikrotik and CentOS/RHEL/Linux consultant ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Overlay Filesystem Mounts?
on 11/15/2011 9:22 AM Tim Nelson spake the following: - Original Message - Vreme: 11/15/2011 05:44 PM, Tim Nelson piše: However, it is possible to mount all of the shares to one location, such that there is one 'data' dir, with the combined contents of each of the three shares? So, all shares are mounted at /mnt/s1, and the contents of the multiple data dirs appears in one single data dir? The only time I've seen such functionality is within the XBMC media center application. It allows you to mount multiple network shares, but shows them all in one location as a sort of 'overlay' view. Duplicate directories are shown have their contents merged, but remain intact on the actual shares/filesystem. Does any of this make sense? Is it possible with CentOS (pref. 6) ? If nothing else, you could create ans script that would create symlinks from all files in those directories into single one. I use that technique to create combined repository directory for mrepo. I'm already doing this. It works, but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically. In Microsoft terms that sounds like Distributed file system. I think you can do that under samba... ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Overlay Filesystem Mounts?
On 11/15/2011 01:05 PM, Ljubomir Ljubojevic wrote: Vreme: 11/15/2011 06:39 PM, John Hodrien piše: On Tue, 15 Nov 2011, Tim Nelson wrote: - Original Message - On Tue, 15 Nov 2011, Tim Nelson wrote: I'm already doing this. It works, but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically. Presumably it's be easy enough to knock up with fuse, but there'd be a small performance hit compared to the symlink approach. A small loss of performance would be acceptable. Why are you wanting to do this out of interest? Are you merging filesystems from multiple servers? Yes, multiple exports on multiple servers. The data is read by a legacy application that does not have a concept of 'multiple data locations' in which to read data from. :-/ Anything of interest here? http://en.wikipedia.org/wiki/UnionFS jh ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos Yup, that should be it. Available Packages funionfs.x86_64 0.4.3-6.el6epel fuse-unionfs.x86_64 0.23-1.el6.rf repoforge Repoforge built variant seams better, but do not hold me for it. how about mhddfs? $ yum search unionFS funionfs-debuginfo.x86_64 : Debug information for package funionfs funionfs.x86_64 : Union filesystem in userspace mhddfs.x86_64 : Fuse-based file system for unifying several mount points into : one -- Roger Wells, P.E. SAIC 221 Third St Newport, RI 02840 401-847-4210 (voice) 401-849-1585 (fax) roger.k.we...@saic.com ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Overlay Filesystem Mounts?
On Tue, 15 Nov 2011, Scott Silva wrote: In Microsoft terms that sounds like Distributed file system. I think you can do that under samba... Is that the same? I thought DFS was just about effectively having cross server symlinks so that one folder could be on one server and another on another transparently, but I didn't know it could effectively merge multiple folders into one. jh ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Overlay Filesystem Mounts?
on 11/15/2011 10:48 AM John Hodrien spake the following: On Tue, 15 Nov 2011, Scott Silva wrote: In Microsoft terms that sounds like Distributed file system. I think you can do that under samba... Is that the same? I thought DFS was just about effectively having cross server symlinks so that one folder could be on one server and another on another transparently, but I didn't know it could effectively merge multiple folders into one. jh I suppose it would have to be more like disparate subfolders shared under one root... ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Overlay Filesystem Mounts?
On Tue, 15 Nov 2011, Scott Silva wrote: I suppose it would have to be more like disparate subfolders shared under one root... In which case it might as well just be a bunch of symlinks, and that's fairly easy to automatically maintain. jh ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Overlay Filesystem Mounts?
Scott Silva wrote: on 11/15/2011 9:22 AM Tim Nelson spake the following: - Original Message - Vreme: 11/15/2011 05:44 PM, Tim Nelson piše: However, it is possible to mount all of the shares to one location, such that there is one 'data' dir, with the combined contents of each of the three shares? So, all shares are mounted at /mnt/s1, and the contents of the multiple data dirs appears in one single data dir? The only time I've seen such functionality is within the XBMC media center application. It allows you to mount multiple network shares, but shows them all in one location as a sort of 'overlay' view. Duplicate directories are shown have their contents merged, but remain intact on the actual shares/filesystem. Does any of this make sense? Is it possible with CentOS (pref. 6) ? If nothing else, you could create ans script that would create symlinks from all files in those directories into single one. I use that technique to create combined repository directory for mrepo. I'm already doing this. It works, but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically. In Microsoft terms that sounds like Distributed file system. I think you can do that under samba... I hadn't been following this thread - been busy - but have you looked into glusterfs? mark ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] Overlay Filesystem Mounts?
Vreme: 11/15/2011 11:04 PM, m.r...@5-cent.us piše: I hadn't been following this thread - been busy - but have you looked into glusterfs? Fedora 16 uses HekaFS, a cloud-ready version of GlusterFS. -- Ljubomir Ljubojevic (Love is in the Air) PL Computers Serbia, Europe Google is the Mother, Google is the Father, and traceroute is your trusty Spiderman... StarOS, Mikrotik and CentOS/RHEL/Linux consultant ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
