similar to: ZFS on Linux testing effort

We are a CentOS shop, and have the lucky, fortunate problem of having ever-increasing amounts of data to manage. EXT3/4 becomes tough to manage when you start climbing, especially when you have to upgrade, so we're contemplating switching to ZFS. As of last spring, it appears that ZFS On Linux http://zfsonlinux.org/ calls itself production ready despite a version number of 0.6.2, and

On Fri, 27 Apr 2018 22:40:41 +0100 Jonathan Hunter via samba <samba at lists.samba.org> wrote: > OK - some more detail I have found in the meantime. > > I have compiled & ran listxattr, and I can now see a difference > between a working and a broken file: > > me at dc2:~/download $ > sudo ./listxattr /usr/local/samba/var/locks/sysvol/ >

On Thu, 9 Feb 2017 10:55:51 +0100 Axel Kittenberger <axkibe at gmail.com> wrote: > > Has someone experience with collecting the changed files > > with a third party tool which detects which files were changed? > > I don't know of sysdig but am the developer of Lsyncd which does > exactly that, collect file changes via inotify event mechanism and > then calls

Benjamin Smith wrote: > On Wednesday, April 24, 2019 11:25:00 AM PDT Andrew Holway wrote: > >>> Btw, right now, we've just built a new server as Ubuntu, because my >>> manager wants to use it to test zfs, including its ability to a) act >>> as a RAID, directly, without an underlying RAID, and b) encrypt the >>> whole thing natively. >> >>

Hmm, don't you just love changing terminology! I've been using HSM systems at work since '99. BTW, DMAPI is the Data Management API which was a common(ish) extension used by amongst others SGI and IBM. Back to lvmcache. It looks interesting. I'd earlier dismissed LVM since it is block orientated, not file orientated. Probably because my mental image is of files migrating to

On 12/14/2013, 04:00 , lists at benjamindsmith.com wrote: > We checked lsyncd out and it's most certainly an very interesting tool. > I*will* be using it in the future! > > However, we found that it has some issues scaling up to really big file > stores that we haven't seen (yet) with ZFS. > > For example, the first thing it has to do when it comes online is a >

Hi, we have a huge directory tree. * 17M files (number of files) * 2.2TBytes of data. * Only 0.1% changes per day Current pain: rsyncs directory tree traversal needs to long to discover the changed files. Only few files change. I discovered the tool sysdig which could be used to monitor the files which were changed. Then we could feed the list of changed files to rsync and avoid the

Or ZFS.. http://zfsonlinux.org/ On 29 March 2015 at 03:37, Chris Murphy <lists at colorremedies.com> wrote: > It's a matter of user space tools preference. Both mdadm, and lvm > tools use the Linux md driver code to implement RAID on the backend; > but have completely different user facing tools and on-disk metadata. > So it's best to be familiar with the

Dear list, I'd like to have your expertise opinion on following issue. Out of a concrete need we developed an application that will rsync any changes on a local directory structure to a remove system the moment they happen using the linux kernel watch feature. This is in our opinion much more elegant compared to invoking rsync every x seconds/minutes from cron, or having to use a special

Hello, I'm author of Lsyncd - the live syncing deamon - http://code.google.com/p/lsyncd/ - a daemon that uses Linux` inotify to watch for filesystem changes - aggregates them for a few seconds and then periodically calls rsync to transfer the changes to target(s). Version 1 was simply aware of directories only, and it called rsync once with --delete -d for every directory in which anything

Hi Everyone, I need to keep 2 systems identical. Mostly e-mail directories, web directories, mysql, etc. The goal here is to have a 2nd system ready to go it the first one starts to exhibit hardware issues. What are options to have this happen? I'm going out on a limb and thinking rsync but I haven't used it past just simple use cases. Can anyone provide some insight for me? CentOS

We are implementing a ZFS storage server (NAS) to replace a NetApp box. I have a Sun server with two dual Ultra320 PCIX cards connected to 4 shelves of 12 500GB disks each, yielding a total of 24TB of raw storage. I''m kicking around the different ways to carve this space up, balancing storage space with data integrity. The layout that I have come to think is the best for me is to

Hi, folks, testing zfs. I'd created a zpoolz2, ran a large backup onto it. Then I pulled one drive (11-drive, one hot spare pool), and it resilvered with the hot spare. zpool status -x shows me state: DEGRADED status: One or more devices could not be used because the label is missing or invalid. Sufficient replicas exist for the pool to continue functioning in a degraded state.

https://bugzilla.samba.org/show_bug.cgi?id=14262 Bug ID: 14262 Summary: add continuous sync mode using inotify/fanotify/etc Product: rsync Version: 3.1.3 Hardware: All OS: All Status: NEW Severity: enhancement Priority: P5 Component: core Assignee: wayne at opencoder.net

Speaking of ZFS, got a weird one: we were testing ZFS (ok, it was on Ubuntu, but that shouldn't make a difference, I would think). and I've got a zpool z2. I pulled one drive, to simulate a drive failure, and it rebuilt with the hot spare. Then I pushed the drive I'd pulled back in... and it does not look like I've got a hot spare. zpool status shows config: NAME STATE

Hello all, It was often asked and discussed on the list about "how to change rpool HDDs from AHCI to IDE mode" and back, with the modern routine involving reconfiguration of the BIOS, bootup from separate live media, simple import and export of the rpool, and bootup from the rpool. The documented way is to reinstall the OS upon HW changes. Both are inconvenient to say the least.

Hi Friends, I am using rsync to copy data from Production File Server to Disaster Recovery file server. I have 100Mbps link setup between these two servers. Folder structure is very deep. It is having path like /reports/folder1/date/folder2/file.tx, where we have 1600 directories like 'folder1', daily folders since last year in date folder and 2 folders for each date folder like folder2

On Thu, 9 Feb 2017 14:43:57 +0100 Axel Kittenberger <axkibe at gmail.com> wrote: > > > > Not only that, but inotify is not guaranteed. (At least not on > > 3.16.0. Can't say regards later versions.) So you might miss some > > changes. > > > > Got any info on that? > > I noted that MOVE_FROM and MOVE_TO events are not guaranted to arrive

https://bugzilla.samba.org/show_bug.cgi?id=12569 Bug ID: 12569 Summary: Missing directory errors not ignored Product: rsync Version: 3.1.2 Hardware: All OS: Linux Status: NEW Severity: normal Priority: P5 Component: core Assignee: wayned at samba.org Reporter: axkibe

HI, We have done something similar using inotify. On the DC1. we watch the "/usr/local/samba/var/locks/sysvol" folder and if there is any change, (add, modify or delete), we run "samba-tool ntacl sysvolreset" and we push those changes to other DCs using rsync. We have created a shell script that is put in rc.local so that this starts even if the server reboots. We chose