Re: [Samba] compressed file VFS
A similar question has been posted here (with an answer): http://askubuntu.com/questions/5212/can-i-transparently-compress-some-files-on-a-samba-share HTH Hello, AFAIK the FUSE filesystems have in common the problem that they are read only. I have to write to this share too. My idea was a samba VFS that, when it finds a compressed file with a certain extension ( say .gzvfs ) allows a normal read access to this file but allows to read and write to other files Bye Andreas -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Re: [Samba] compressed file VFS
Il 31/03/2011 09:36, Andreas Moroder ha scritto: A similar question has been posted here (with an answer): http://askubuntu.com/questions/5212/can-i-transparently-compress-some-files-on-a-samba-share HTH Hello, AFAIK the FUSE filesystems have in common the problem that they are read only. I have to write to this share too. My idea was a samba VFS that, when it finds a compressed file with a certain extension ( say .gzvfs ) allows a normal read access to this file but allows to read and write to other files Bye Andreas The article I linked above has a link to this page: http://sourceforge.net/apps/mediawiki/fuse/index.php?title=CompressedFileSystems where 4 fuse-based compressed filesystems with R/W support are mentioned. HTH -- Marcello Romani -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Re: [Samba] compressed file VFS
Andreas Moroder wrote: A similar question has been posted here (with an answer): http://askubuntu.com/questions/5212/can-i-transparently-compress-some-files-on-a-samba-share HTH Hello, AFAIK the FUSE filesystems have in common the problem that they are read only. I have to write to this share too. Except at least ntfs-3g which is read + write (see the link posted yesterday). It is fully compatible with Windows, which may be useful in a Samba environment. My idea was a samba VFS that, when it finds a compressed file with a certain extension ( say .gzvfs ) allows a normal read access to this file but allows to read and write to other files For ntfs the compression is transparent. No specific extension or change needed in applications or scripts. Regards Jean-Pierre -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Re: [Samba] compressed file VFS
Il 31/03/2011 11:48, Jean-Pierre ha scritto: Andreas Moroder wrote: A similar question has been posted here (with an answer): http://askubuntu.com/questions/5212/can-i-transparently-compress-some-files-on-a-samba-share HTH Hello, AFAIK the FUSE filesystems have in common the problem that they are read only. I have to write to this share too. Except at least ntfs-3g which is read + write (see the link posted yesterday). It is fully compatible with Windows, which may be useful in a Samba environment. My idea was a samba VFS that, when it finds a compressed file with a certain extension ( say .gzvfs ) allows a normal read access to this file but allows to read and write to other files Windows XP (and later) and almost all Linux file managers support viewing a compressed file (e.g. zip archive) as a normal folder. This feature lives inside the file manager application and doesn't require any server-side support. For ntfs the compression is transparent. No specific extension or change needed in applications or scripts. Regards Jean-Pierre I recently read somewhere about a user that was exporting via samba an ntfs volume created under windows that had the compress option activated. When writing to the share via samba he could create files but not overwrite them. Reason is ntfs-3g driver doesn't support overwriting transparently compressed files. He solved the issue by mounting the volume under Windows and deselecting the compress option. I'm sorry but I don't remember if that post was recent, and can't find it againt right now. HTH -- Marcello Romani -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Re: [Samba] compressed file VFS
On Wed, Mar 30, 2011 at 8:41 AM, Andreas Moroder andreas.moro...@sb-brixen.it wrote: Hallo, we have a clinical system that generate lot of files that once written are never changed. This file consume lot of disk and tape space*, so my idea was to compress this files. The problem is that it can happen, that the users have to open this files later. Is there a VFS module for samba that show gzipped** read only files as if they were standard files ? Bye Andreas * Disks are cheap, but the are no more disk-slots in the server and the server has to be up 24*7 so we can not simply change the disks ** bzip2 would be preferable because of the better compression, but the orginal size is not stored in the header so I assume it can not be used for this purpose -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba I've had some good compression from lessfs ( http://www.lessfs.com/ ), not samba specific but is quite transparent, and POSIX compliant. -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Re: [Samba] compressed file VFS
I've had some good compression from lessfs ( http://www.lessfs.com/ ), not samba specific but is quite transparent, and POSIX compliant. I thought that lessfs was about datadeduplication. Is there compression as well? John -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Re: [Samba] compressed file VFS
Marcello Romani wrote: Windows XP (and later) and almost all Linux file managers support viewing a compressed file (e.g. zip archive) as a normal folder. This feature lives inside the file manager application and doesn't require any server-side support. For ntfs the compression is transparent. No specific extension or change needed in applications or scripts. Regards Jean-Pierre I recently read somewhere about a user that was exporting via samba an ntfs volume created under windows that had the compress option activated. When writing to the share via samba he could create files but not overwrite them. Reason is ntfs-3g driver doesn't support overwriting transparently compressed files. He solved the issue by mounting the volume under Windows and deselecting the compress option. I'm sorry but I don't remember if that post was recent, and can't find it againt right now. Well, it was not supported until support was provided, this is a very common situation. Here is the link again : http://www.tuxera.com/community/ntfs-3g-advanced/data-compression/ Regards Jean-Pierre -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Re: [Samba] compressed file VFS
Am 31.03.2011 15:44, schrieb John Drescher: I've had some good compression from lessfs ( http://www.lessfs.com/ ), not samba specific but is quite transparent, and POSIX compliant. I thought that lessfs was about datadeduplication. Is there compression as well? John http://www.sfr-fresh.com/linux/misc/lessfs-1.3.3.8.tar.gz:a/lessfs-1.3.3.8/lessfs.1#toc3 -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Re: [Samba] compressed file VFS
Am 31.03.2011 16:15, schrieb J. Echter: Am 31.03.2011 15:44, schrieb John Drescher: I've had some good compression from lessfs ( http://www.lessfs.com/ ), not samba specific but is quite transparent, and POSIX compliant. I thought that lessfs was about datadeduplication. Is there compression as well? John http://www.sfr-fresh.com/linux/misc/lessfs-1.3.3.8.tar.gz:a/lessfs-1.3.3.8/lessfs.1#toc3 sorry this link doesnt point to where i wanted to here's a snippet: *lessfs*is a filesystem that performs inline data deduplication. lessfs uses the 192-bit (24-byte) tiger hash algorithm by default to compare the data. The filesystem compresses the unique data blocks before writing them to disk. -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Re: [Samba] compressed file VFS
On Thu, Mar 31, 2011 at 8:44 AM, John Drescher dresche...@gmail.com wrote: I've had some good compression from lessfs ( http://www.lessfs.com/ ), not samba specific but is quite transparent, and POSIX compliant. I thought that lessfs was about datadeduplication. Is there compression as well? it does both, though I'm really only seeing compression on my email archive storage, maybe my block size is too high, or maybe i don't have as many mass emails as I thought I had. for compression, it supports qlz, lzo, bzip and deflate -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
[Samba] compressed file VFS
Hallo, we have a clinical system that generate lot of files that once written are never changed. This file consume lot of disk and tape space*, so my idea was to compress this files. The problem is that it can happen, that the users have to open this files later. Is there a VFS module for samba that show gzipped** read only files as if they were standard files ? Bye Andreas * Disks are cheap, but the are no more disk-slots in the server and the server has to be up 24*7 so we can not simply change the disks ** bzip2 would be preferable because of the better compression, but the orginal size is not stored in the header so I assume it can not be used for this purpose -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Re: [Samba] compressed file VFS
Il 30/03/2011 15:41, Andreas Moroder ha scritto: Hallo, we have a clinical system that generate lot of files that once written are never changed. This file consume lot of disk and tape space*, so my idea was to compress this files. The problem is that it can happen, that the users have to open this files later. Is there a VFS module for samba that show gzipped** read only files as if they were standard files ? Bye Andreas * Disks are cheap, but the are no more disk-slots in the server and the server has to be up 24*7 so we can not simply change the disks ** bzip2 would be preferable because of the better compression, but the orginal size is not stored in the header so I assume it can not be used for this purpose A similar question has been posted here (with an answer): http://askubuntu.com/questions/5212/can-i-transparently-compress-some-files-on-a-samba-share HTH -- Marcello Romani -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Re: [Samba] compressed file VFS
Il 30/03/2011 15:41, Andreas Moroder ha scritto: Hallo, we have a clinical system that generate lot of files that once written are never changed. This file consume lot of disk and tape space*, so my idea was to compress this files. The problem is that it can happen, that the users have to open this files later. Is there a VFS module for samba that show gzipped** read only files as if they were standard files ? Bye Andreas * Disks are cheap, but the are no more disk-slots in the server and the server has to be up 24*7 so we can not simply change the disks ** bzip2 would be preferable because of the better compression, but the orginal size is not stored in the header so I assume it can not be used for this purpose See also this interesting thread http://www.mail-archive.com/rsync@lists.samba.org/msg23263.html where fusecompress is mentioned. -- Marcello Romani -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Re: [Samba] compressed file VFS
On Wed, Mar 30, 2011 at 9:41 AM, Andreas Moroder andreas.moro...@sb-brixen.it wrote: Hallo, we have a clinical system that generate lot of files that once written are never changed. This file consume lot of disk and tape space*, so my idea was to compress this files. The problem is that it can happen, that the users have to open this files later. Is there a VFS module for samba that show gzipped** read only files as if they were standard files ? On top of the fuse modules mentioned a previous link, there are also 3 filesystems under linux that support compression. btrfs, reiser4 and zfs. All like the fuse modules are considered experimental and I would avoid reiser4 since the main developer Hans Reiser is in jail. John -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Re: [Samba] compressed file VFS
John Drescher wrote: On Wed, Mar 30, 2011 at 9:41 AM, Andreas Moroder andreas.moro...@sb-brixen.it wrote: Hallo, we have a clinical system that generate lot of files that once written are never changed. This file consume lot of disk and tape space*, so my idea was to compress this files. The problem is that it can happen, that the users have to open this files later. Is there a VFS module for samba that show gzipped** read only files as if they were standard files ? On top of the fuse modules mentioned a previous link, there are also 3 filesystems under linux that support compression. btrfs, reiser4 and zfs. All like the fuse modules are considered experimental and I would avoid reiser4 since the main developer Hans Reiser is in jail. And ntfs (ntfs-3g) Regards -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Re: [Samba] compressed file VFS
On Wed, Mar 30, 2011 at 11:08 AM, Jean-Pierre jean-pierre.an...@wanadoo.fr wrote: John Drescher wrote: On Wed, Mar 30, 2011 at 9:41 AM, Andreas Moroder andreas.moro...@sb-brixen.it wrote: Hallo, we have a clinical system that generate lot of files that once written are never changed. This file consume lot of disk and tape space*, so my idea was to compress this files. The problem is that it can happen, that the users have to open this files later. Is there a VFS module for samba that show gzipped** read only files as if they were standard files ? On top of the fuse modules mentioned a previous link, there are also 3 filesystems under linux that support compression. btrfs, reiser4 and zfs. All like the fuse modules are considered experimental and I would avoid reiser4 since the main developer Hans Reiser is in jail. And ntfs (ntfs-3g) Compression now works with that? For a long time it was not supported. John -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Re: [Samba] compressed file VFS
On Wed, Mar 30, 2011 at 11:11 AM, John Drescher dresche...@gmail.com wrote: On Wed, Mar 30, 2011 at 11:08 AM, Jean-Pierre jean-pierre.an...@wanadoo.fr wrote: John Drescher wrote: On Wed, Mar 30, 2011 at 9:41 AM, Andreas Moroder andreas.moro...@sb-brixen.it wrote: Hallo, we have a clinical system that generate lot of files that once written are never changed. This file consume lot of disk and tape space*, so my idea was to compress this files. The problem is that it can happen, that the users have to open this files later. Is there a VFS module for samba that show gzipped** read only files as if they were standard files ? On top of the fuse modules mentioned a previous link, there are also 3 filesystems under linux that support compression. btrfs, reiser4 and zfs. All like the fuse modules are considered experimental and I would avoid reiser4 since the main developer Hans Reiser is in jail. And ntfs (ntfs-3g) Compression now works with that? For a long time it was not supported. http://www.tuxera.com/community/ntfs-3g-advanced/data-compression/ -- John M. Drescher -- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
