search for: ingestion

Displaying 20 results from an estimated 88 matches for "ingestion".

Did you mean: congestion
2017 Sep 06
2
3.10.5 vs 3.12.0 huge performance loss
Hi, Just do some ingestion tests to 40 node 16+4EC 19PB single volume. 100 clients are writing each has 5 threads total 500 threads. With 3.10.5 each server has 800MB/s network traffic, cluster total is 32GB/s With 3.12.0 each server has 200MB/s network traffic, cluster total is 8GB/s I did not change any volume options in b...
2016 Apr 26
0
vectors of equations in ode / desolve
...# Example1: Predator-Prey Lotka-Volterra model (with logistic prey) ## ======================================================================= LVmod <- function(Time, State, Pars) { with(as.list(c(State, Pars)), { # Now there are different species of Prey so Prey is a one dimensional vector, #Ingestion is also a one-dimensional vector. The number of species is not defined a priory Ingestion <- rIng * Prey * Predator GrowthPrey <- rGrow * Prey * (1 - Prey/K) MortPredator <- rMort * Predator dPrey <- GrowthPrey - Ingestion # the growth of predator would...
2017 Sep 06
0
3.10.5 vs 3.12.0 huge performance loss
On 09/06/2017 05:48 AM, Serkan ?oban wrote: > Hi, > > Just do some ingestion tests to 40 node 16+4EC 19PB single volume. > 100 clients are writing each has 5 threads total 500 threads. > With 3.10.5 each server has 800MB/s network traffic, cluster total is 32GB/s > With 3.12.0 each server has 200MB/s network traffic, cluster total is 8GB/s > I did not change any...
2017 Oct 18
0
rsync ingest to new storage environment
If rsync isn't doing the networking you are better off with cp -au instead of rsync. It should be significantly faster and you can do a final pass with rsync to get any files that got truncated by a ^C (cp can only skip files that are newer not files that are not different and a truncated file will be newer since it never got back-dated). > rsync -av --no-perms --no-owner --no-group
2017 Oct 18
2
rsync ingest to new storage environment
All, I am seeding a new storage environment (Glusterfs on XFS) and would like to gather advise on best practices. This data is primarily all media data, so not good with compression. I currently have made one pass on at 20TB directory tree into the environment as: - nfs mount from old storage to new storage - rsync -av /old/storage/* /new/storage/directory Once the directories and files were
2017 Sep 07
2
3.10.5 vs 3.12.0 huge performance loss
It is sequential write with file size 2GB. Same behavior observed with 3.11.3 too. On Thu, Sep 7, 2017 at 12:43 AM, Shyam Ranganathan <srangana at redhat.com> wrote: > On 09/06/2017 05:48 AM, Serkan ?oban wrote: >> >> Hi, >> >> Just do some ingestion tests to 40 node 16+4EC 19PB single volume. >> 100 clients are writing each has 5 threads total 500 threads. >> With 3.10.5 each server has 800MB/s network traffic, cluster total is >> 32GB/s >> With 3.12.0 each server has 200MB/s network traffic, cluster total is >> 8...
2017 Oct 19
1
Fwd: rsync ingest to new storage environment
> If rsync isn't doing the networking you are better off with cp -au > instead of rsync. It should be significantly faster and you can do a > final pass with rsync to get any files that got truncated by a ^C (cp > can only skip files that are newer not files that are not different and > a truncated file will be newer since it never got back-dated). Thanks, I will run some
2015 Oct 17
3
Problems with TDBs on CTDB-managed Samba instance
Hi Jeremy, Thanks so much for your reply! As a matter of fact, we did just that around 3:45p yesterday when our CTDB cluster was unable to self-heal from the latest in this series of failover events. Here's how the situation went down: 1) We saw flapping identical to that described in my original post 2) After about 30 minutes of waiting, CTDB was just spinning with `smbd` repeatedly
2019 Sep 13
3
[PATCH 4.19 092/190] drm/nouveau: Dont WARN_ON VCPI allocation failures
On Fri, Sep 13, 2019 at 09:33:36AM -0400, Ilia Mirkin wrote: >Hi Greg, > >This feels like it's missing a From: line. > >commit b513a18cf1d705bd04efd91c417e79e4938be093 >Author: Lyude Paul <lyude at redhat.com> >Date: Mon Jan 28 16:03:50 2019 -0500 > > drm/nouveau: Don't WARN_ON VCPI allocation failures > >Is this an artifact of your
2019 Sep 13
4
[PATCH 4.19 092/190] drm/nouveau: Dont WARN_ON VCPI allocation failures
On Fri, Sep 13, 2019 at 03:54:56PM +0100, Greg Kroah-Hartman wrote: >On Fri, Sep 13, 2019 at 10:46:27AM -0400, Sasha Levin wrote: >> On Fri, Sep 13, 2019 at 09:33:36AM -0400, Ilia Mirkin wrote: >> > Hi Greg, >> > >> > This feels like it's missing a From: line. >> > >> > commit b513a18cf1d705bd04efd91c417e79e4938be093 >> > Author:
2013 Dec 12
0
wide softlink to different partition copy fails
Hi All, (I've also posted this to the CentOS forum - so copy and pasted for simplicity) I'm having an unusual issue with Samba server package 3.6.9-164.el6 When sharing out a directory containing a soft symlink pointing to a directory outside of the share and a different filesystem/block device. When a client mounts the partition (Linux and Mac OSX Clients tested) and attempts to copy a
2017 Sep 11
0
3.10.5 vs 3.12.0 huge performance loss
...ential write with file size 2GB. Same behavior observed with > 3.11.3 too. > > On Thu, Sep 7, 2017 at 12:43 AM, Shyam Ranganathan <srangana at redhat.com> wrote: >> On 09/06/2017 05:48 AM, Serkan ?oban wrote: >>> >>> Hi, >>> >>> Just do some ingestion tests to 40 node 16+4EC 19PB single volume. >>> 100 clients are writing each has 5 threads total 500 threads. >>> With 3.10.5 each server has 800MB/s network traffic, cluster total is >>> 32GB/s >>> With 3.12.0 each server has 200MB/s network traffic, cluster tot...
2012 Sep 27
4
collecting the differences between a local host and remote archive to third local location (a usb device)
Hi everyone, I'm trying to archive to a remote host but the size of the data to copy is prohibitively large to consider doing the sync over the wire (it's TBs of raw video), so i was wondering if it was possible to use a usb attached storage device as the transport medium. Is it possible for rsync to compare the two systems (over the network) finding any newer or different files on the
2007 Jul 13
3
stack level too deep when parsing xml
I''m trying to figure out why I''m getting a stack level too deep error. I have controller which parses xml (about 1400 lines) and ingests it into mysql. First I was getting a system stack error every time, but then I found the ulimit -s command which allows me to raise it from 8mb to 64mb. That solved the problem I thought, But now, I can parse the xml once, but when I do it
2008 Feb 14
2
kickstart file problem
I have a kickstart file that I am using to install multiple machines. If I install with no %post script, everything runs great. When I add the following %post section, if fails. I have been working on this for a few days now without luck, Any help would be appreciated. Here is the error, the script follows. Traceback (most recent call first): File
2019 Sep 13
0
[PATCH 4.19 092/190] drm/nouveau: Dont WARN_ON VCPI allocation failures
...l go add it. > > But... why do you actually care? Just a hygiene thing. Everyone else sends patches the normal way, with accurate attribution. Why should stable be different? (I was surprised to see Greg contributing to nouveau when I first saw the patch. But then realized it was the stable ingestion notification.) -ilia
2015 Oct 18
0
Problems with TDBs on CTDB-managed Samba instance
On Sat, Oct 17, 2015 at 04:13:30PM +0000, Howard, Stewart Jameson wrote: > gencache_notrans.tdb > gencache.tdb > mutex.tdb Just a side-remark: These tdbs have nothing to do with ctdb, they are purely local. > Because of the current steady size of this file compared > to its repeated, intermittent, and rapid inflation, we > suspect that there is some operational condition which
2006 Jun 30
1
Help: Need tips for file manipulation
Hello all! I''m just starting with Ruby on Rails and need to ingest a .csv (Excel) file, and use the data it contains to be shown on screen. Can anyone show me where to start with this script? Thanks -- Posted via http://www.ruby-forum.com/.
2011 May 07
2
hivexml rewrite
Greetings. I am new to this list. I am writing to you about hivexml. Richard Jones told me that he was considering abandoning this program. Instead, I am willing to take over maintenance of it. I am involved in computer forensics. I are in the midst of developing an XML standard to describe the Windows Registry. There are several programs that export the windows registry at XML. I have
2016 Aug 23
2
[XRay][RFC] Tooling for XRay Trace Analysis
Hi llvm-dev, I've been implementing a tool for analysing XRay traces. A recap of XRay's original RFC [0] mentions a tool that does function call accounting as a starting point. This is implemented currently in D21987 [1], and is being reviewed by David Blaikie. One key issue in that review is the dependency between the log format determined by the XRay runtime implementation in