search for: ingest

Hi, Just do some ingestion tests to 40 node 16+4EC 19PB single volume. 100 clients are writing each has 5 threads total 500 threads. With 3.10.5 each server has 800MB/s network traffic, cluster total is 32GB/s With 3.12.0 each server has 200MB/s network traffic, cluster total is 8GB/s I did not change any volume options i...

...# Example1: Predator-Prey Lotka-Volterra model (with logistic prey) ## ======================================================================= LVmod <- function(Time, State, Pars) { with(as.list(c(State, Pars)), { # Now there are different species of Prey so Prey is a one dimensional vector, #Ingestion is also a one-dimensional vector. The number of species is not defined a priory Ingestion <- rIng * Prey * Predator GrowthPrey <- rGrow * Prey * (1 - Prey/K) MortPredator <- rMort * Predator dPrey <- GrowthPrey - Ingestion # the growth of predator wo...

On 09/06/2017 05:48 AM, Serkan ?oban wrote: > Hi, > > Just do some ingestion tests to 40 node 16+4EC 19PB single volume. > 100 clients are writing each has 5 threads total 500 threads. > With 3.10.5 each server has 800MB/s network traffic, cluster total is 32GB/s > With 3.12.0 each server has 200MB/s network traffic, cluster total is 8GB/s > I did not change...

...ions that should be used? >      - Any specific rsync flags (I've tested with and without 'z' flag > and it does not help with this data) or best practices? > > Questions regarding rsync behavior: > > - When I test individual directory resync's within the initial ingest > tree, a command such as: > >      rsync -av --no-perms --no-owner --no-group /old/storage/dir > /new/storage/directory/dir > >  Lists all of the directories under 'dir' in the shell.  But if I rerun > the command immediately thereafter, nothing is listed in the shel...

...o are there specific mount options that should be used? - Any specific rsync flags (I've tested with and without 'z' flag and it does not help with this data) or best practices? Questions regarding rsync behavior: - When I test individual directory resync's within the initial ingest tree, a command such as: rsync -av --no-perms --no-owner --no-group /old/storage/dir /new/storage/directory/dir Lists all of the directories under 'dir' in the shell. But if I rerun the command immediately thereafter, nothing is listed in the shell. Where is this 'metadata'...

It is sequential write with file size 2GB. Same behavior observed with 3.11.3 too. On Thu, Sep 7, 2017 at 12:43 AM, Shyam Ranganathan <srangana at redhat.com> wrote: > On 09/06/2017 05:48 AM, Serkan ?oban wrote: >> >> Hi, >> >> Just do some ingestion tests to 40 node 16+4EC 19PB single volume. >> 100 clients are writing each has 5 threads total 500 threads. >> With 3.10.5 each server has 800MB/s network traffic, cluster total is >> 32GB/s >> With 3.12.0 each server has 200MB/s network traffic, cluster total is >&gt...

...ptions that should be used? > - Any specific rsync flags (I've tested with and without 'z' flag > and it does not help with this data) or best practices? > > Questions regarding rsync behavior: > > - When I test individual directory resync's within the initial ingest > tree, a command such as: > > rsync -av --no-perms --no-owner --no-group /old/storage/dir > /new/storage/directory/dir > > Lists all of the directories under 'dir' in the shell. But if I rerun > the command immediately thereafter, nothing is listed in the shell....

...gencache_notrans.tdb|less` during the trouble reveals a long series of Windows SID entries followed eventually by a *very large* number of the ASCII character "B" (presumably going all the way to the end of the file. Our current suspicion in that there is some ADS user whose record, when ingested, somehow corrupts the TDB. Our investigations into the last *successfully-ingested* SID in the corrupt TDB will continue on Monday morning. Of course, we may be wrong in this hypothesis. Can you (or anyone else on the list) comment on the apparent correctness of this assessment and possibly sh...

...1c417e79e4938be093 >Author: Lyude Paul <lyude at redhat.com> >Date: Mon Jan 28 16:03:50 2019 -0500 > > drm/nouveau: Don't WARN_ON VCPI allocation failures > >Is this an artifact of your notification-of-patches process and I >never noticed before, or was the patch ingested incorrectly? It was always like this for patches that came through me. Greg's script generates an explicit "From:" line in the patch, but I never saw the value in that since git does the right thing by looking at the "From:" line in the mail header. The right thing is be...

...icecasting amigos! I?ve had an incredibly frustrating journey getting a new icecast origin server going to supplant an older machine set for retirement. The setup is relatively simple ? a beefy Debian bookworm host running icecast as a relaying slave pulling the streamlist from an icecast2 2.4.4 ingest server, for mass distribution. The ingest / origin server runs fine. I opted for compiling the latest icecast-kh for the slave, but ran into issues with the host unable to fetch the master streamlist to relay. (I think due to compiling without explicitly including libcurl?) I then got the prior i...

...dhat.com> >> > Date: Mon Jan 28 16:03:50 2019 -0500 >> > >> > drm/nouveau: Don't WARN_ON VCPI allocation failures >> > >> > Is this an artifact of your notification-of-patches process and I >> > never noticed before, or was the patch ingested incorrectly? >> >> It was always like this for patches that came through me. Greg's script >> generates an explicit "From:" line in the patch, but I never saw the >> value in that since git does the right thing by looking at the "From:" >> lin...

...he symlink is pointing to, to the shared directory. my smb.conf contains the following: CODE: SELECT ALL <https://www.centos.org/forums/viewtopic.php?f=13&t=43976#> [global] unix extensions = no [ol01_edit] path = /media/stor0/user follow symlinks = yes wide links = yes [ol01_ingest] path = /media/stor1/user follow symlinks = yes wide links = yes The files in question are as follows: on the server: /media/stor0 is an XFS filesystem /media/stor1 is an XFS filesystem /media/stor0/user/edit_ready is a folder with 775 permissions /media//stor1/user/edit_ready -> /med...

...ential write with file size 2GB. Same behavior observed with > 3.11.3 too. > > On Thu, Sep 7, 2017 at 12:43 AM, Shyam Ranganathan <srangana at redhat.com> wrote: >> On 09/06/2017 05:48 AM, Serkan ?oban wrote: >>> >>> Hi, >>> >>> Just do some ingestion tests to 40 node 16+4EC 19PB single volume. >>> 100 clients are writing each has 5 threads total 500 threads. >>> With 3.10.5 each server has 800MB/s network traffic, cluster total is >>> 32GB/s >>> With 3.12.0 each server has 200MB/s network traffic, cluster...

...newer or different files on the local system as compared to the remote archive (ignoring local deletes), then copy only those new/differences to a locally attached portable drive so that the portable drive can be physically taken across town to the other system, plugged in and then the new data be ingested so that a subsequent rsync between the the two systems would see those files as synchronised? I thought the --compare-dest option might be the way to go, as per this post: http://lists.samba.org/archive/rsync/2006-June/015827.html but it seems to not behave the way i thought it would. Thanks...

...; > > I?ve had an incredibly frustrating journey getting a new icecast origin server going to supplant an older machine set for retirement. > > The setup is relatively simple ? a beefy Debian bookworm host running icecast as a relaying slave pulling the streamlist from an icecast2 2.4.4 ingest server, for mass distribution. > The ingest / origin server runs fine. > > I opted for compiling the latest icecast-kh for the slave, but ran into issues with the host unable to fetch the master streamlist to relay. (I think due to compiling without explicitly including libcurl?) This lis...

I''m trying to figure out why I''m getting a stack level too deep error. I have controller which parses xml (about 1400 lines) and ingests it into mysql. First I was getting a system stack error every time, but then I found the ulimit -s command which allows me to raise it from 8mb to 64mb. That solved the problem I thought, But now, I can parse the xml once, but when I do it for a second time, I get the stack level too deep erro...

...tmp|echo "relocate root"|rm -rf /tmp|ln -s /var/tmp /tmp|# add lustre module configuration|echo "add lustre module configuration"|echo "options lnet networks=tcp0(eth1,eth0)" >> /etc/modprobe.conf|# create motd|echo "set motd"|echo "Built as admin/ingest using VIPER install 1.0" > /etc/motd|echo "Adding level3 with bad password set"|/usr/sbin/useradd -d /home/level3 -m -u 100 -g 100 -p BLOCKED level3|' i: /bin/sh c: 1) messages: /mnt/sysimage/root/post-install.log scriptRoot: /mnt/sysimage chroot: /mnt/sysimage fd: 31 rc: 0 pa...

...; Date: Mon Jan 28 16:03:50 2019 -0500 > >> > > >> > drm/nouveau: Don't WARN_ON VCPI allocation failures > >> > > >> > Is this an artifact of your notification-of-patches process and I > >> > never noticed before, or was the patch ingested incorrectly? > >> > >> It was always like this for patches that came through me. Greg's script > >> generates an explicit "From:" line in the patch, but I never saw the > >> value in that since git does the right thing by looking at the "From...

...` > during the trouble reveals a long series of Windows SID > entries followed eventually by a *very large* number of > the ASCII character "B" (presumably going all the way to > the end of the file. Our current suspicion in that there > is some ADS user whose record, when ingested, somehow > corrupts the TDB. Our investigations into the last > *successfully-ingested* SID in the corrupt TDB will > continue on Monday morning. We should never go beyond a few MBs for gencache_notrans.tdb. What version of Samba are you running, in particular what version of tdb? The...

Hello all! I''m just starting with Ruby on Rails and need to ingest a .csv (Excel) file, and use the data it contains to be shown on screen. Can anyone show me where to start with this script? Thanks -- Posted via http://www.ruby-forum.com/.