search for: petabyt

...m my Verizon, Samsung Galaxy smartphone -------- Original message --------From: Serkan ?oban <cobanserkan at gmail.com> Date: 6/29/17 4:39 AM (GMT-05:00) To: Jason Kiebzak <jkiebzak at gmail.com> Cc: Gluster Users <gluster-users at gluster.org> Subject: Re: [Gluster-users] Multi petabyte gluster I am currently using 10PB single volume without problems. 40PB is on the way. EC is working fine. You need to plan ahead with large installations like this. Do complete workload tests and make sure your use case is suitable for EC. On Wed, Jun 28, 2017 at 11:18 PM, Jason Kiebzak <jki...

...phone > > -------- Original message -------- > From: Serkan ?oban <cobanserkan at gmail.com> > Date: 6/29/17 4:39 AM (GMT-05:00) > To: Jason Kiebzak <jkiebzak at gmail.com> > Cc: Gluster Users <gluster-users at gluster.org> > Subject: Re: [Gluster-users] Multi petabyte gluster > > I am currently using 10PB single volume without problems. 40PB is on > the way. EC is working fine. > You need to plan ahead with large installations like this. Do complete > workload tests and make sure your use case is suitable for EC. > > > On Wed, Jun 28, 20...

Has anyone scaled to a multi petabyte gluster setup? How well does erasure code do with such a large setup? Thanks -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20170628/b030376d/attachment.html>

...Original message -------- > > From: Serkan ?oban <cobanserkan at gmail.com> > > Date: 6/29/17 4:39 AM (GMT-05:00) > > To: Jason Kiebzak <jkiebzak at gmail.com> > > Cc: Gluster Users <gluster-users at gluster.org> > > Subject: Re: [Gluster-users] Multi petabyte gluster > > > > I am currently using 10PB single volume without problems. 40PB is on > > the way. EC is working fine. > > You need to plan ahead with large installations like this. Do complete > > workload tests and make sure your use case is suitable for EC. > &gt...

...----- >> > From: Serkan ?oban <cobanserkan at gmail.com> >> > Date: 6/29/17 4:39 AM (GMT-05:00) >> > To: Jason Kiebzak <jkiebzak at gmail.com> >> > Cc: Gluster Users <gluster-users at gluster.org> >> > Subject: Re: [Gluster-users] Multi petabyte gluster >> > >> > I am currently using 10PB single volume without problems. 40PB is on >> > the way. EC is working fine. >> > You need to plan ahead with large installations like this. Do complete >> > workload tests and make sure your use case is suita...

...;t started testing the metal had only arrived the day before and they where waiting for the drives to arrive. They had also changed the design to give it more network. I will try to find out more as the customer progresses..... &gt;Interesting blog: &gt;http://blog.backblaze.com/2009/09/01/petabytes-on-a-budget-how-to-build-cheap-cloud-storage/ &gt; -- Trevor Pretty | Technical Account Manager | T: +64 9 639 0652 | M: +64 21 666 161 Eagle Technology Group Ltd. Gate D, Alexandra Park, Greenlane West, Epsom Private Bag 93211, Parnell, Auckland www.eagle.co.nz  This email is confi...

When I run backup and send the output to a file on the server, I get a file limitation of 2g. When I do the same backup to a snap server, there is no problem. Is there a size limitation for a single file? Thanks, Steven C. Henry stevench@xnet.com

Does Samba have any max filesytem limitations. In particular can both 2.2.8 and 3.0 support 2TB+ filesystems. For now, I am thinking of 6TB max, so I don't need to know about Petabytes or Exabytes. The other side of the question, is can Win9x, Win2K, etc. work with filesystems over 2 TB. If the above is in a FAQ somewhere, a url would be great. Greg -- Greg Freemyer

...'' to zfs-discuss-request@opensolaris.org You can reach the person managing the list at zfs-discuss-owner@opensolaris.org When replying, please edit your Subject line so it is more specific than "Re: Contents of zfs-discuss digest..." Today''s Topics: 1. Re: [zfs] Re: Petabyte pool? (Richard Yao) 2. Re: [zfs] Re: Petabyte pool? (Trey Palmer) ---------------------------------------------------------------------- Message: 1 Date: Sat, 16 Mar 2013 08:23:07 -0400 From: Richard Yao <ryao@gentoo.org> To: zfs@lists.illumos.org Cc: zfs-discuss@opensolaris.org Subject:...

...: All Status: NEW Severity: enhancement Priority: P5 Component: core Assignee: wayned at samba.org Reporter: chip at innovates.com QA Contact: rsync-qa at samba.org As file systems are getting bigger and bigger, into the multiple petabyte scale rsync is not scaling well, but is still the tool of choice when migrating filesystems from one storage vender to another. Adding --min-depth and --max-depth options to control what directory depth rsync will operate on would allow better targeted rsync processes. -- You are receiving this...

Hello, we are currently managing access permissions through classical user-group-others permissions on a multi-petabyte directory tree with partially very deep and broad directories. Projects are represented by directory trees and mapped through GIDs. Lately we had lots of "singular" permission request (one single user needs access to a single dataset but should not be able to see all other datasets...

...as released... Sigh. > > Software seems to grow to the maximum space it can occupy. I think in 1989 we were complaining about BSD not being able to fit on our VAX 750's boot drive anymore and we needed to put in a 40MB drive system instead. I expect by the 2040's we will be looking at petabyte drives and wondering how we can fit anything on it. > Valeri > > > > > > >> mark > >> > >> _______________________________________________ > >> CentOS mailing list > >> CentOS at centos.org > >> https://lists.cento...

...to checkpoint, it fills the partition and ends up corrupted and unrecoverable. >Neither Gluster nor Ceph are "backup solutions", so if the data is not easily replaceable it's better to have it elsewhere. Better if offline. > It's a nice idea but when you're dealing in petabytes of data, streaming in as fast as your storage will allow, it's just not physically possible.

...t; problem, it works as designed, also with maildir rsync did a good job, >> what never worked as it should was dsync ,cause of bugs ,that may >> changed now >> > > I would like to very much hear about the problems you had with dsync as we have successfully migrated tens of petabytes of mails with it successfully while preserving the UID numbers. > Imapsync would have been totally out of question as it is absolutely crucial in those migrations to keep the UID -> MAIL pairs matching legacy server. And usually also POP3 UIDLs. If not keeping the data the servers would hav...

...t; problem, it works as designed, also with maildir rsync did a good job, >> what never worked as it should was dsync ,cause of bugs ,that may >> changed now >> > > I would like to very much hear about the problems you had with dsync as we have successfully migrated tens of petabytes of mails with it successfully while preserving the UID numbers. > Imapsync would have been totally out of question as it is absolutely crucial in those migrations to keep the UID -> MAIL pairs matching legacy server. And usually also POP3 UIDLs. If not keeping the data the servers would hav...

.../media/disk/Films] $ ls -l total 692996 -rw-r----- 1 678756852 34537972 148381783526817280 avr 28 01:01 Cinema drwxr-xr-x 3 kikinovak kikinovak 4096 mai 9 10:07 Anime drwxrwxrwx 4 kikinovak kikinovak 4096 mai 10 12:25 Series Notice that the file size is something like petabytes :oD Is there any way to repair this obviously corrupt data? Cheers, Niki Kovacs

...ncluded the above, because I note the 32bit mmio, but the 64bit flag; also the clock speed for the controller. Now, I've been working on one with Penguin. I noticed one thing, that it was set to native IDE. After googling, I saw that the most recent spec, which included EIDE, should be good to petabytes... but I tried resetting it to AHCI anyway. The user ran one job, ok... then another last night, and it's spitting the same errors. In /var/log/messages, I see JBD: detected IO errors while flushing file data: Mar 7 00:53:28 <server> kernel: ata2.00: exception Emask 0x0 SAct 0x3 SErr...

...e at the bricks and don't start with a dot, but aren't visible in "ls". Clients still can interact with them by using the explicit path. More information: https://bugzilla.redhat.com/show_bug.cgi?id=1564071 And since this update gluster reported for the rebalance of >16900 PB (Petabyte!) of data for one of our 2 server, when using ?gluster volume rebalance $myvolume status?. The time looks right, but the size of transfered files is absurd. The rebalance was with 3.12.6 in March 2018. The last rebalance log file listed no errors and a realistic size at the end. We started a new...

...ementations >> to decide for themselves). > > Yes, painfully aware. Not sure what to do about it however, since the > alternative (ie. switching back to yajl) as libvirt did is not going > to be pleasant. > > Currently we're OK as long as disk sizes don't exceed 8 petabytes, if > my quick calculation is correct. The problem comes anywhere that qemu outputs an unsigned 64-bit number as unsigned AND where that value is larger than INT64_MAX (jansson uses strtoll, rather than strtoull). But since disk sizes cannot exceed off_t, which is a signed 64-bit number,...

...with maildir rsync did a good job, >>>> what never worked as it should was dsync ,cause of bugs ,that may >>>> changed now >>>> >>> >>> I would like to very much hear about the problems you had with dsync as we have successfully migrated tens of petabytes of mails with it successfully while preserving the UID numbers. >>> Imapsync would have been totally out of question as it is absolutely crucial in those migrations to keep the UID -> MAIL pairs matching legacy server. And usually also POP3 UIDLs. If not keeping the data the servers w...