Alan McKay
2012-Jan-11 19:30 UTC
[CentOS] Is Amanda "vaulting" what I need for archiving data?
Hi folks,
I've got a bit of a different scenario than I imagine most, and have spent
the last 60 or 90 minutes searching Amanda list archives and googling, but
did not come up with anything much. Then I went browsing around the
Amanda website and found "vaulting" and was wondering whether this
would
suit my needs.
I'm basically searching around for a backup solution and trying to decide
whether to use something off the shelf or just roll my own with gtar. It
is important to me that my solution use standard tools like dump/restore /
gtar on the back end, which is how I ended up at Amanda. In looking
through some of the initial configuration how-tos it seemed as though this
was massively over-complex for my application. But then I hit upon
"vaulting"
http://wiki.zmanda.com/index.php/How_To:Copy_Data_from_Volume_to_Volume
This is not exactly my scenario, but maybe there is another way to roll a
"vaulting" solution to suit me.
Basically I work in a scientific research lab (stem cell research) where
the scientists produce a fair bit of raw data. We want to periodically
take the data and archive it to tape and then remove it from disk and store
the tape in our archival facility. We'd need a record of what is on each
tape of course. But this would not be the same scenario as in the link
above because it would not be taking data from 2ndary to tertiary storage.
It would essentially be taken from primary to tertiary directly. i.e.
directly from disk to tape. But not in an automated fashion like typical
nightly dumps. On request, we'd take the scientist's data and copy it
over
to our server that has the tape unit, then dump it out to tape, and remove
it from the disk there. Once verified, we could tell the scientist it is
OK to remove their primary data now, and then we'd store the tape.
Is Amanda suited to this? Or is there another application I should be
looking at?
thanks,
-Alan
--
?Don't eat anything you've ever seen advertised on TV?
- Michael Pollan, author of "In Defense of Food"
m.roth at 5-cent.us
2012-Jan-11 20:07 UTC
[CentOS] Is Amanda "vaulting" what I need for archiving data?
Hey, Alan, Alan McKay wrote: <snip>> gtar on the back end, which is how I ended up at Amanda. In looking > through some of the initial configuration how-tos it seemed as though this > was massively over-complex for my application. But then I hit upon > "vaulting" > > http://wiki.zmanda.com/index.php/How_To:Copy_Data_from_Volume_to_Volume<snip>> Basically I work in a scientific research lab (stem cell research) where > the scientists produce a fair bit of raw data. We want to periodically > take the data and archive it to tape and then remove it from disk and > store the tape in our archival facility. We'd need a record of what is<snip> For one thing, I think you seriously need to look at backup up to offline hard drives, instead of tapes. Unless you really want/need to archive the tapes for seven years, or whatever, legally, tapes are not the preferred solution these days: they're very slow to use for recovery, and h/d's are large and fast, and still cheap. We back up to backup servers, then, every couple of weeks, I run rsync backups (well, we have a locally-rolled system to run the rsync) onto offline drives - in our case, I swap large drives into an eSATA drive bay. When I'm done, they go in the fire safe. I will note that I work for a US federal agency who I shouldn't mention (I do not speak for the agency or my employer), and our division generates a lot of data, also: easily half a terabyte for one user, and a number for the group that does protein folding.... mark