similar to: Multi petabyte gluster

Displaying 20 results from an estimated 1600 matches similar to: "Multi petabyte gluster"

2017 Jun 29
2
Multi petabyte gluster
Thanks for the reply. We will mainly use this for archival - near-cold storage. Anything, from your experience, to keep in mind while planning large installations? Sent from my Verizon, Samsung Galaxy smartphone -------- Original message --------From: Serkan ?oban <cobanserkan at gmail.com> Date: 6/29/17 4:39 AM (GMT-05:00) To: Jason Kiebzak <jkiebzak at gmail.com> Cc: Gluster
2017 Jun 30
2
Multi petabyte gluster
We are using 3.10 and have a 7 PB cluster. We decided against 16+3 as the rebuild time are bottlenecked by matrix operations which scale as the square of the number of data stripes. There are some savings because of larger data chunks but we ended up using 8+3 and heal times are about half compared to 16+3. -Alastair On 30 June 2017 at 02:22, Serkan ?oban <cobanserkan at gmail.com>
2017 Jun 30
0
Multi petabyte gluster
>Thanks for the reply. We will mainly use this for archival - near-cold storage. Archival usage is good for EC >Anything, from your experience, to keep in mind while planning large installations? I am using 3.7.11 and only problem is slow rebuild time when a disk fails. It takes 8 days to heal a 8TB disk.(This might be related with my EC configuration 16+4) 3.9+ versions has some
2017 Jun 30
0
Multi petabyte gluster
Did you test healing by increasing disperse.shd-max-threads? What is your heal times per brick now? On Fri, Jun 30, 2017 at 8:01 PM, Alastair Neil <ajneil.tech at gmail.com> wrote: > We are using 3.10 and have a 7 PB cluster. We decided against 16+3 as the > rebuild time are bottlenecked by matrix operations which scale as the square > of the number of data stripes. There are
2012 Feb 14
4
Exorbitant cost to achieve redundancy??
I'm trying to justify a GlusterFS storage system for my technology development group and I want to get some clarification on something that I can't seem to figure out architecture wise... My storage system will be rather large. Significant fraction of a petabyte and will require scaling in size for at least one decade. from what I understand GlusterFS achieves redundancy through
2009 Feb 18
2
[LLVMdev] Parametric polymorphism
> Why do you say that people who compile, e.g., functional languages > would benefit from type variables in LLVM? > I like the level the LLVM is at, and would prefer to deal with > instantiating parametric polymorphism at a higher level. I'm surprised you're happy with a non-polymorphic llvm. Does Cayenne target llvm? Dependent types take polymorphism to new heights -- but
2017 Oct 31
3
BoF - Gluster for VM store use case
During Gluster Summit, we discussed gluster volumes as storage for VM images - feedback on the usecase and upcoming features that may benefit this usecase. Some of the points discussed * Need to ensure there are no issues when expanding a gluster volume when sharding is turned on. * Throttling feature for self-heal, rebalance process could be useful for this usecase * Erasure coded volumes with
2017 Nov 01
0
BoF - Gluster for VM store use case
----- Original Message ----- > From: "Sahina Bose" <sabose at redhat.com> > To: gluster-users at gluster.org > Cc: "Gluster Devel" <gluster-devel at gluster.org> > Sent: Tuesday, October 31, 2017 11:46:57 AM > Subject: [Gluster-users] BoF - Gluster for VM store use case > > During Gluster Summit, we discussed gluster volumes as storage for VM
2025 Apr 17
1
Gluster with ZFS
Gagan: Throwing my $0.02 in -- It depends on the system environment of how you are planning on deploying Gluster (and/or Ceph). I have Ceph running on my three node HA Proxmox cluster using three OASLOA Mini PCs that only has the Intel N95 Processor (4-core/4-thread) with 16 GB of RAM and a cheap Microcenter store brand 512 GB NVMe M.2 2230 SSD and my Ceph cluster has been running without any
2017 Nov 01
1
[Gluster-devel] BoF - Gluster for VM store use case
On 10/31/2017 08:36 PM, Ben Turner wrote: >> * Erasure coded volumes with sharding - seen as a good fit for VM disk >> storage > I am working on this with a customer, we have been able to do 400-500 MB / sec writes! Normally things max out at ~150-250. The trick is to use multiple files, create the lvm stack and use native LVM striping. We have found that 4-6 files seems to give
2014 Sep 17
2
[LLVMdev] Any support for zeroing buffers?
Hi, Is there any existing support/on going work for zeroing buffers in llvm infrastructure? (either in the form of intrinsics or IR code buffer erasure?) My basic "grep" did not show up any. Please let me know any info on this. I will be glad to hear out! -- Anitha
2015 Jan 22
2
[Bug 11067] New: add --min-depth and --max-depth options
https://bugzilla.samba.org/show_bug.cgi?id=11067 Bug ID: 11067 Summary: add --min-depth and --max-depth options Product: rsync Version: 3.1.1 Hardware: All OS: All Status: NEW Severity: enhancement Priority: P5 Component: core Assignee: wayned at samba.org Reporter:
2011 Sep 14
0
[LLVMdev] Generics
> Hi, > > I'm about designing the compiler backend of my script language and I > have generic types in the language. An example is the array. An > array#int means array of integers. You can compare it to Java's > generics. Whenever i have a variable of the type "generic", the type > should be replaced by the really used type. > Now the question is: how do
2025 Apr 17
1
Gluster with ZFS
On Thu, Apr 17, 2025 at 02:44:28PM +0530, gagan tiwari wrote: > HI Alexander, > Thanks for the update. Initially, I also > thought of deploying Ceph but ceph is quite difficult to set-up and manage. > Moreover, it's also hardware demanding. I think it's most suitable for a > very large set-up with hundreds of clients. I strongly disagree. I
2022 Sep 30
2
Project based in US for a Data Scientist
Yes. This position requires Python and SQL. Sorry for the confusion. On Fri, 30 Sep 2022 at 12:50, Ilya Kipnis <ilya.kipnis at gmail.com> wrote: > The position explicitly asks for Python, not R. > > On Fri, Sep 30, 2022, 6:47 AM Eusebi Llensa <ellensa at outvise.com> wrote: > >> Dear community, >> >> We are searching for a freelance data scientist to
2018 Nov 27
2
Tools/mechanisms for the management of access permissions in big filebased datasets
Hello, we are currently managing access permissions through classical user-group-others permissions on a multi-petabyte directory tree with partially very deep and broad directories. Projects are represented by directory trees and mapped through GIDs. Lately we had lots of "singular" permission request (one single user needs access to a single dataset but should not be able to
2019 May 08
3
kickstart compat C7 -> C8
On Wed, 8 May 2019 at 13:48, Valeri Galtsev <galtsev at kicp.uchicago.edu> wrote: > > > On 2019-05-08 12:28, Stephen John Smoogen wrote: > > On Wed, 8 May 2019 at 13:24, mark <m.roth at 5-cent.us> wrote: > > >> > > Yep. Minimum for that is going to be about the same as your RESCUE. The > > other would just be to confirm that the sda has space and
2017 Sep 23
0
EC 1+2
Hi Take a look at this link (under ?Optimal volumes?), for Erasure Coded volume optimal configuration http://docs.gluster.org/Administrator%20Guide/Setting%20Up%20Volumes/ On Sat, Sep 23, 2017 at 10:01 Gandalf Corvotempesta < gandalf.corvotempesta at gmail.com> wrote: > Is possible to create a dispersed volume 1+2 ? (Almost the same as replica > 3, the same as RAID-6) > > If
2017 Sep 23
1
EC 1+2
Already read that. Seems that I have to use a multiple of 512, so 512*(3-2) is 512. Seems fine Il 23 set 2017 5:00 PM, "Dmitri Chebotarov" <4dimach at gmail.com> ha scritto: > Hi > > Take a look at this link (under ?Optimal volumes?), for Erasure Coded > volume optimal configuration > > http://docs.gluster.org/Administrator%20Guide/Setting%20Up%20Volumes/ >
2009 Sep 16
3
[LLVMdev] Type strengthening and type weakening
Has anyone done any experiments with regards to type strengthening or weakening in the context of LLVM? For example, the GWT compiler does type strengthening - that is, if you are calling a method on an interface or abstract type, and the compiler determines through live variable analysis what the concrete type is, then it goes ahead and re-writes the type information to be the stronger