similar to: data deduplication

I am planning to use ZFS on my Centos 5.2 systems. The data I am storing is very large text files where each file can range from 10M to 20G. I am very interested on the compression feature of ZFS, and it seems no other native Linux FS supports it. My question are: Is ZFS stable? How does it scale for very large filesytems, ie, 2TB to 9TB? How is the performance of fuse? I plan to use it on my

Hello, I know centos does not use syslog-ng, but I have installed it at my university. My intention is if a particular string appears in my /var/log/messages I would like to get an email alert. For example, if i see a message "foo" in /var/log/kern I would like to email myself. Any idea how to do this? Has anyone done this before? TIA

WE have a centos 5.3 install, and our server is keep getting hacked. We see load averages of 500+ and see people from all over the world logging into our server (used last). Is there a good place to start to avoid these kinds of things? For example, here is what I already did. Open up sshd port only setup iptables to only accept port 80 and 22 No FTP No other ports are allowed according to IP

We use Microsoft Outlook heavy at school but our backed is CentOS. I use echo "Foo" | mail -s "subject" addr at unc.edu a lot. Is it possible to change the priority to High so Outlook will understand it? The priority meaning the email will be sent to the normal email queue but on Outlook it would have the exclamation point. TIA

Hello All: Running 5.2 at our university. We have several student's processes that take up too much memory. Our system have 64G of RAM and some processes take close to 32-48G of RAM. This is causing many problems for others. I was wondering if there is a way to restrict memory usage per process? If the process goes over 32G simply kill it. Any thoughts or ideas? TIA

We have about 800 CentOS 5.2 servers and our university. We use NFS being served from over 10 NetApp frames. We use autofs for to mount up our partitions. There have been times where we can't cd into the directory. It says the directory does not exist. On some servers it works but on others it does not. Typically we restart amd and autofs to resolve this issue. But sometimes it does not even

Hi All, I am trying to understand the purpose of rsyncd. Why does it exist? Why not just use rsync ad-hoc or via script? Also, to a more serious note. I need to keep a filesystem on 1 server and another server synced by. What is the best way to do this? I want to have /source and /target to be exactly the same. I don't want any extra files in /target. I want the timestamps to be the exact

I am planning to sign up for a VoIP service in the U.S. Can anyone recommend anything cheap, reliable and good quality? I want to use it for my primary house phone (I also own a cell phone). I also want the service to be asterisk friendly so I can play with it :-) Thanks in advance. -------------- next part -------------- An HTML attachment was scrubbed... URL:

At our Physics research labs we do a lot with low latency networks. We have been using Centos for over 3 years now and its been great! We would like to tune and optimize our setup by removing unneeded packages -- kernel modules to be specific. I was wondering, how does one measure the speed of the kernel. Is that even possible?

<p> </p>

I have 12 750GB drive appliance from HP. I was wondering what is the best disk configuration? I suppose a large RAID5 would be bad since rebuilding would take too long. What do you recommend? TIA -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.centos.org/pipermail/centos/attachments/20080526/faf0ff6f/attachment-0005.html>

Hello: I am very new to "R", and I am trying to plot a large data set. I would like to get a line graph. My data looks like this in a csv file (no header): 07/03/23,05:00,23 07/03/23,06:00,32 07/03/23,07:00,33 07/03/23,08:00,25 07/03/23,09:00,26 07/03/23,10:00,21 07/03/23,11:00,23 07/03/23,12:00,24 07/03/23,13:00,25 07/03/23,14:00,29 07/03/23,15:00,23 07/03/23,16:00,23 TIA

Hello All, I have been using rsync to backup several filesystems by using Mike Rubel's hard link method (http://www.mikerubel.org/computers/rsync_snapshots/). The problem is, I am backing up a lot of ASCII .log, csv, and .txt files. These files are large and can range anywhere from 1GB to 30GB. I was wondering if on the target side (the backup side), if I can use some sort of compression. I

Would it be more efficient to use rsync to get filestats instead of using the 'find' command? I would like to know how big a directory is on a filesystem, but this directory has millions of small files. I was wondering if rsync would be more efficient than find when using "-n" options. TIA

I have deduplication active in my first mdbox: type mailbox, but how do I find out how well the deduplication works? Is there a way of finding out how much disk space I saved (if I saved some :) )? -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax:

Hi Guys, I am wondering about mail deduplication. I am looking into the possibility of seperating out all of the message bodies with multiple parts inside mail that is recived from `dovecot` and hashing them all. The idea is that by hashing all of the parts inside the email, I will be able to ensure that each part of the email will only be saved once. This means that attachments & common

Hi: I am very interested in the ZFS deduplication, where can I get the the source code? Or would anybody send me an actual source code achive which contains the ZFS deduplication? I am looking forward your kind help. Thanks very much. Best Rgards -- Yujuan Tan, PhD Candidate Wuhan National Laboratory for Optoelectronics, Wuhan, China Key Lab of Information Storage, Ministry of Education,

Hello, some questions regarding btrfs deduplication. - What is the state of it? Is it "safe" to use? https://btrfs.wiki.kernel.org/index.php/Deduplication does not yield much information. - https://pypi.python.org/pypi/bedup says: "bedup looks for new and changed files, making sure that multiple copies of identical files share space on disk. It integrates deeply with btrfs so

On 3/9/2016 9:02 PM, Timo Sirainen <tss at iki.fi> wrote: > On 08 Mar 2016, at 01:50, Pavel Stano <stanojr at websupport.sk> wrote: >> >> sis attachment deduplication is broken in 2.2.16 upwards. >> It is caused by this commit. >> https://github.com/dovecot/core/commit/664bf3e236c214aee86294483c379e4fa66c2e63 >> >> in src/lib-fs/fs-sis.c function

At my physics lab we have 30 servers with 1TB disk packs. I am in need of monitoring for disk failures. I have been reading about SMART and it seems it can help. However, I am not sure what to look for if a drive is about to fail. Any thoughts about this? Is anyone using this method to predetermine disk failures? TIA