Hallo, we have a clinical system that generate lot of files that once written are never changed. This file consume lot of disk and tape space*, so my idea was to compress this files. The problem is that it can happen, that the users have to open this files later. Is there a VFS module for samba that show gzipped** read only files as if they were standard files ? Bye Andreas * Disks are cheap, but the are no more disk-slots in the server and the server has to be up 24*7 so we can not simply change the disks ** bzip2 would be preferable because of the better compression, but the orginal size is not stored in the header so I assume it can not be used for this purpose
Il 30/03/2011 15:41, Andreas Moroder ha scritto:> Hallo, > > we have a clinical system that generate lot of files that once written > are never changed. This file consume lot of disk and tape space*, so my > idea was to compress this files. The problem is that it can happen, that > the users have to open this files later. > > Is there a VFS module for samba that show gzipped** read only files as > if they were standard files ? > > > Bye > Andreas > > * Disks are cheap, but the are no more disk-slots in the server and the > server has to be up 24*7 so we can not simply change the disks > > ** bzip2 would be preferable because of the better compression, but the > orginal size is not stored in the header so I assume it can not be used > for this purpose >A similar question has been posted here (with an answer): http://askubuntu.com/questions/5212/can-i-transparently-compress-some-files-on-a-samba-share HTH -- Marcello Romani
Il 30/03/2011 15:41, Andreas Moroder ha scritto:> Hallo, > > we have a clinical system that generate lot of files that once written > are never changed. This file consume lot of disk and tape space*, so my > idea was to compress this files. The problem is that it can happen, that > the users have to open this files later. > > Is there a VFS module for samba that show gzipped** read only files as > if they were standard files ? > > > Bye > Andreas > > * Disks are cheap, but the are no more disk-slots in the server and the > server has to be up 24*7 so we can not simply change the disks > > ** bzip2 would be preferable because of the better compression, but the > orginal size is not stored in the header so I assume it can not be used > for this purpose >See also this interesting thread http://www.mail-archive.com/rsync at lists.samba.org/msg23263.html where fusecompress is mentioned. -- Marcello Romani
On Wed, Mar 30, 2011 at 9:41 AM, Andreas Moroder <andreas.moroder at sb-brixen.it> wrote:> Hallo, > > we have a clinical system that generate lot of files that once written are > never changed. This file consume lot of disk and tape space*, so my idea was > to compress this files. The problem is that it can happen, that the users > have to open this files later. > > Is there a VFS module for samba that show gzipped** read only files as if > they were standard files ? > >On top of the fuse modules mentioned a previous link, there are also 3 filesystems under linux that support compression. btrfs, reiser4 and zfs. All like the fuse modules are considered experimental and I would avoid reiser4 since the main developer Hans Reiser is in jail. John
John Drescher wrote:> On Wed, Mar 30, 2011 at 9:41 AM, Andreas Moroder > <andreas.moroder at sb-brixen.it> wrote: >> Hallo, >> >> we have a clinical system that generate lot of files that once written are >> never changed. This file consume lot of disk and tape space*, so my idea was >> to compress this files. The problem is that it can happen, that the users >> have to open this files later. >> >> Is there a VFS module for samba that show gzipped** read only files as if >> they were standard files ? >> >> > On top of the fuse modules mentioned a previous link, there are also 3 > filesystems under linux that support compression. btrfs, reiser4 and > zfs. All like the fuse modules are considered experimental and I would > avoid reiser4 since the main developer Hans Reiser is in jail.And ntfs (ntfs-3g).... Regards
On Wed, Mar 30, 2011 at 11:08 AM, Jean-Pierre <jean-pierre.andre at wanadoo.fr> wrote:> John Drescher wrote: >> >> On Wed, Mar 30, 2011 at 9:41 AM, Andreas Moroder >> <andreas.moroder at sb-brixen.it> ?wrote: >>> >>> Hallo, >>> >>> we have a clinical system that generate lot of files that once written >>> are >>> never changed. This file consume lot of disk and tape space*, so my idea >>> was >>> to compress this files. The problem is that it can happen, that the users >>> have to open this files later. >>> >>> Is there a VFS module for samba that show gzipped** read only files as if >>> they were standard files ? >>> >>> >> On top of the fuse modules mentioned a previous link, there are also 3 >> filesystems under linux that support compression. btrfs, reiser4 and >> zfs. All like the fuse modules are considered experimental and I would >> avoid reiser4 since the main developer Hans Reiser is in jail. > > And ntfs (ntfs-3g).... >Compression now works with that? For a long time it was not supported. John
On Wed, Mar 30, 2011 at 11:11 AM, John Drescher <drescherjm at gmail.com> wrote:> On Wed, Mar 30, 2011 at 11:08 AM, Jean-Pierre > <jean-pierre.andre at wanadoo.fr> wrote: >> John Drescher wrote: >>> >>> On Wed, Mar 30, 2011 at 9:41 AM, Andreas Moroder >>> <andreas.moroder at sb-brixen.it> ?wrote: >>>> >>>> Hallo, >>>> >>>> we have a clinical system that generate lot of files that once written >>>> are >>>> never changed. This file consume lot of disk and tape space*, so my idea >>>> was >>>> to compress this files. The problem is that it can happen, that the users >>>> have to open this files later. >>>> >>>> Is there a VFS module for samba that show gzipped** read only files as if >>>> they were standard files ? >>>> >>>> >>> On top of the fuse modules mentioned a previous link, there are also 3 >>> filesystems under linux that support compression. btrfs, reiser4 and >>> zfs. All like the fuse modules are considered experimental and I would >>> avoid reiser4 since the main developer Hans Reiser is in jail. >> >> And ntfs (ntfs-3g).... >> > > Compression now works with that? For a long time it was not supported. >http://www.tuxera.com/community/ntfs-3g-advanced/data-compression/ -- John M. Drescher
> A similar question has been posted here (with an answer): > > http://askubuntu.com/questions/5212/can-i-transparently-compress-some-files-on-a-samba-share > > > HTH >Hello, AFAIK the FUSE filesystems have in common the problem that they are read only. I have to write to this share too. My idea was a samba VFS that, when it finds a compressed file with a certain extension ( say .gzvfs ) allows a normal read access to this file but allows to read and write to other files Bye Andreas
Il 31/03/2011 09:36, Andreas Moroder ha scritto:>> A similar question has been posted here (with an answer): >> >> http://askubuntu.com/questions/5212/can-i-transparently-compress-some-files-on-a-samba-share >> >> >> >> HTH >> > Hello, > > AFAIK the FUSE filesystems have in common the problem that they are read > only. I have to write to this share too. > > My idea was a samba VFS that, when it finds a compressed file with a > certain extension ( say .gzvfs ) allows a normal read access to this > file but allows to read and write to other files > > Bye > Andreas >The article I linked above has a link to this page: http://sourceforge.net/apps/mediawiki/fuse/index.php?title=CompressedFileSystems where 4 fuse-based compressed filesystems with R/W support are mentioned. HTH -- Marcello Romani
Andreas Moroder wrote:>> A similar question has been posted here (with an answer): >> >> http://askubuntu.com/questions/5212/can-i-transparently-compress-some-files-on-a-samba-share >> >> >> >> HTH >> > Hello, > > AFAIK the FUSE filesystems have in common the problem that they are read > only. I have to write to this share too.Except at least ntfs-3g which is read + write (see the link posted yesterday). It is fully compatible with Windows, which may be useful in a Samba environment.> My idea was a samba VFS that, when it finds a compressed file with a > certain extension ( say .gzvfs ) allows a normal read access to this > file but allows to read and write to other filesFor ntfs the compression is transparent. No specific extension or change needed in applications or scripts. Regards Jean-Pierre
On Wed, Mar 30, 2011 at 8:41 AM, Andreas Moroder <andreas.moroder at sb-brixen.it> wrote:> Hallo, > > we have a clinical system that generate lot of files that once written are > never changed. This file consume lot of disk and tape space*, so my idea was > to compress this files. The problem is that it can happen, that the users > have to open this files later. > > Is there a VFS module for samba that show gzipped** read only files as if > they were standard files ? > > > Bye > Andreas > > * Disks are cheap, but the are no more disk-slots in the server and the > server has to be up 24*7 so we can not simply change the disks > > ** bzip2 would be preferable because of the better compression, but the > orginal size is not stored in the header so I assume it can not be used for > this purpose > > -- > To unsubscribe from this list go to the following URL and read the > instructions: ?https://lists.samba.org/mailman/options/samba >I've had some good compression from lessfs ( http://www.lessfs.com/ ), not samba specific but is quite transparent, and POSIX compliant.