Displaying 20 results from an estimated 83 matches for "petabyte".
Did you mean:
petabytes
2017 Jun 29
2
Multi petabyte gluster
...m my Verizon, Samsung Galaxy smartphone
-------- Original message --------From: Serkan ?oban <cobanserkan at gmail.com> Date: 6/29/17 4:39 AM (GMT-05:00) To: Jason Kiebzak <jkiebzak at gmail.com> Cc: Gluster Users <gluster-users at gluster.org> Subject: Re: [Gluster-users] Multi petabyte gluster
I am currently using 10PB single volume without problems. 40PB is on
the way. EC is working fine.
You need to plan ahead with large installations like this. Do complete
workload tests and make sure your use case is suitable for EC.
On Wed, Jun 28, 2017 at 11:18 PM, Jason Kiebzak <jkie...
2017 Jun 30
0
Multi petabyte gluster
...phone
>
> -------- Original message --------
> From: Serkan ?oban <cobanserkan at gmail.com>
> Date: 6/29/17 4:39 AM (GMT-05:00)
> To: Jason Kiebzak <jkiebzak at gmail.com>
> Cc: Gluster Users <gluster-users at gluster.org>
> Subject: Re: [Gluster-users] Multi petabyte gluster
>
> I am currently using 10PB single volume without problems. 40PB is on
> the way. EC is working fine.
> You need to plan ahead with large installations like this. Do complete
> workload tests and make sure your use case is suitable for EC.
>
>
> On Wed, Jun 28, 201...
2017 Jun 28
1
Multi petabyte gluster
Has anyone scaled to a multi petabyte gluster setup? How well does erasure
code do with such a large setup?
Thanks
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20170628/b030376d/attachment.html>
2017 Jun 30
2
Multi petabyte gluster
...Original message --------
> > From: Serkan ?oban <cobanserkan at gmail.com>
> > Date: 6/29/17 4:39 AM (GMT-05:00)
> > To: Jason Kiebzak <jkiebzak at gmail.com>
> > Cc: Gluster Users <gluster-users at gluster.org>
> > Subject: Re: [Gluster-users] Multi petabyte gluster
> >
> > I am currently using 10PB single volume without problems. 40PB is on
> > the way. EC is working fine.
> > You need to plan ahead with large installations like this. Do complete
> > workload tests and make sure your use case is suitable for EC.
> >...
2017 Jun 30
0
Multi petabyte gluster
...-----
>> > From: Serkan ?oban <cobanserkan at gmail.com>
>> > Date: 6/29/17 4:39 AM (GMT-05:00)
>> > To: Jason Kiebzak <jkiebzak at gmail.com>
>> > Cc: Gluster Users <gluster-users at gluster.org>
>> > Subject: Re: [Gluster-users] Multi petabyte gluster
>> >
>> > I am currently using 10PB single volume without problems. 40PB is on
>> > the way. EC is working fine.
>> > You need to plan ahead with large installations like this. Do complete
>> > workload tests and make sure your use case is suitab...
2009 Dec 03
0
Re: Petabytes on a budget - blog
...;t started testing the metal had only arrived the
day before and they where waiting for the drives to arrive. They had
also changed the design to give it more network. I will try to find out
more as the customer progresses.....
>Interesting blog:
>http://blog.backblaze.com/2009/09/01/petabytes-on-a-budget-how-to-build-cheap-cloud-storage/
>
--
Trevor Pretty
| Technical Account Manager
|
T: +64 9 639 0652 |
M: +64 21 666 161
Eagle Technology Group Ltd.
Gate D, Alexandra Park, Greenlane West, Epsom
Private Bag 93211, Parnell, Auckland
www.eagle.co.nzÂ
This email is confid...
2001 Dec 24
1
File size limitation?
When I run backup and send the output to a file on the server,
I get a file limitation of 2g. When I do the same backup to
a snap server, there is no problem.
Is there a size limitation for a single file?
Thanks,
Steven C. Henry
stevench@xnet.com
2003 Oct 27
2
Can Samba export 2TB+ filesystems?
Does Samba have any max filesytem limitations.
In particular can both 2.2.8 and 3.0 support 2TB+ filesystems.
For now, I am thinking of 6TB max, so I don't need to know about
Petabytes or Exabytes.
The other side of the question, is can Win9x, Win2K, etc. work with
filesystems over 2 TB.
If the above is in a FAQ somewhere, a url would be great.
Greg
--
Greg Freemyer
2013 Mar 18
0
Re: zfs-discuss Digest, Vol 89, Issue 12
...'' to
zfs-discuss-request@opensolaris.org
You can reach the person managing the list at
zfs-discuss-owner@opensolaris.org
When replying, please edit your Subject line so it is more specific
than "Re: Contents of zfs-discuss digest..."
Today''s Topics:
1. Re: [zfs] Re: Petabyte pool? (Richard Yao)
2. Re: [zfs] Re: Petabyte pool? (Trey Palmer)
----------------------------------------------------------------------
Message: 1
Date: Sat, 16 Mar 2013 08:23:07 -0400
From: Richard Yao <ryao@gentoo.org>
To: zfs@lists.illumos.org
Cc: zfs-discuss@opensolaris.org
Subject: R...
2015 Jan 22
2
[Bug 11067] New: add --min-depth and --max-depth options
...: All
Status: NEW
Severity: enhancement
Priority: P5
Component: core
Assignee: wayned at samba.org
Reporter: chip at innovates.com
QA Contact: rsync-qa at samba.org
As file systems are getting bigger and bigger, into the multiple petabyte scale
rsync is not scaling well, but is still the tool of choice when migrating
filesystems from one storage vender to another.
Adding --min-depth and --max-depth options to control what directory depth
rsync will operate on would allow better targeted rsync processes.
--
You are receiving this...
2018 Nov 27
2
Tools/mechanisms for the management of access permissions in big filebased datasets
Hello,
we are currently managing access permissions through classical
user-group-others permissions on a multi-petabyte directory tree with
partially very deep and broad directories. Projects are represented by
directory trees and mapped through GIDs. Lately we had lots of
"singular" permission request (one single user needs access to a single
dataset but should not be able to see all other datasets...
2019 May 08
3
kickstart compat C7 -> C8
...as released... Sigh.
>
>
Software seems to grow to the maximum space it can occupy. I think in 1989
we were complaining about BSD not being able to fit on our VAX 750's boot
drive anymore and we needed to put in a 40MB drive system instead. I expect
by the 2040's we will be looking at petabyte drives and wondering how we
can fit anything on it.
> Valeri
>
> >
> >
> >> mark
> >>
> >> _______________________________________________
> >> CentOS mailing list
> >> CentOS at centos.org
> >> https://lists.centos...
2023 Dec 17
1
Gluster -> Ceph
...to checkpoint, it fills the partition and ends up corrupted and unrecoverable.
>Neither Gluster nor Ceph are "backup solutions", so if the data is not easily replaceable it's better to have it elsewhere. Better if offline.
>
It's a nice idea but when you're dealing in petabytes of data, streaming in as fast as your storage will allow, it's just not physically possible.
2018 Sep 04
2
Best way to move mail from one server to another
...t; problem, it works as designed, also with maildir rsync did a good job,
>> what never worked as it should was dsync ,cause of bugs ,that may
>> changed now
>>
>
> I would like to very much hear about the problems you had with dsync as we have successfully migrated tens of petabytes of mails with it successfully while preserving the UID numbers.
> Imapsync would have been totally out of question as it is absolutely crucial in those migrations to keep the UID -> MAIL pairs matching legacy server. And usually also POP3 UIDLs. If not keeping the data the servers would have...
2018 Sep 04
1
Best way to move mail from one server to another
...t; problem, it works as designed, also with maildir rsync did a good job,
>> what never worked as it should was dsync ,cause of bugs ,that may
>> changed now
>>
>
> I would like to very much hear about the problems you had with dsync as we have successfully migrated tens of petabytes of mails with it successfully while preserving the UID numbers.
> Imapsync would have been totally out of question as it is absolutely crucial in those migrations to keep the UID -> MAIL pairs matching legacy server. And usually also POP3 UIDLs. If not keeping the data the servers would have...
2007 Aug 04
2
Data corruption on external hard disk
.../media/disk/Films] $ ls -l
total 692996
-rw-r----- 1 678756852 34537972 148381783526817280 avr 28 01:01 Cinema
drwxr-xr-x 3 kikinovak kikinovak 4096 mai 9 10:07 Anime
drwxrwxrwx 4 kikinovak kikinovak 4096 mai 10 12:25 Series
Notice that the file size is something like petabytes :oD
Is there any way to repair this obviously corrupt data?
Cheers,
Niki Kovacs
2012 Mar 07
2
hardware issues? driver issues?
...ncluded the above, because I note the 32bit mmio, but the 64bit
flag; also the clock speed for the controller.
Now, I've been working on one with Penguin. I noticed one thing, that it
was set to native IDE. After googling, I saw that the most recent spec,
which included EIDE, should be good to petabytes... but I tried resetting
it to AHCI anyway.
The user ran one job, ok... then another last night, and it's spitting the
same errors.
In /var/log/messages, I see JBD: detected IO errors while flushing file data:
Mar 7 00:53:28 <server> kernel: ata2.00: exception Emask 0x0 SAct 0x3
SErr...
2018 Apr 23
4
Problems since 3.12.7: invisible files, strange rebalance size, setxattr failed during rebalance and broken unix rights
...e at the bricks and
don't start with a dot, but aren't visible in "ls". Clients still can
interact with them by using the explicit path.
More information: https://bugzilla.redhat.com/show_bug.cgi?id=1564071
And since this update gluster reported for the rebalance of >16900 PB
(Petabyte!) of data for one of our 2 server, when using ?gluster volume
rebalance $myvolume status?. The time looks right, but the size of
transfered files is absurd. The rebalance was with 3.12.6 in March 2018.
The last rebalance log file listed no errors and a realistic size at the
end.
We started a new r...
2018 Aug 17
1
Re: [PATCH v3 1/4] mltools: Rename Yajl module as JSON_parser and move to common/mltools.
...ementations
>> to decide for themselves).
>
> Yes, painfully aware. Not sure what to do about it however, since the
> alternative (ie. switching back to yajl) as libvirt did is not going
> to be pleasant.
>
> Currently we're OK as long as disk sizes don't exceed 8 petabytes, if
> my quick calculation is correct.
The problem comes anywhere that qemu outputs an unsigned 64-bit number
as unsigned AND where that value is larger than INT64_MAX (jansson uses
strtoll, rather than strtoull). But since disk sizes cannot exceed
off_t, which is a signed 64-bit number, i...
2018 Sep 06
1
Best way to move mail from one server to another
...with maildir rsync did a good job,
>>>> what never worked as it should was dsync ,cause of bugs ,that may
>>>> changed now
>>>>
>>>
>>> I would like to very much hear about the problems you had with dsync as we have successfully migrated tens of petabytes of mails with it successfully while preserving the UID numbers.
>>> Imapsync would have been totally out of question as it is absolutely crucial in those migrations to keep the UID -> MAIL pairs matching legacy server. And usually also POP3 UIDLs. If not keeping the data the servers wo...