search for: nh2

Displaying 20 results from an estimated 31 matches for "nh2".

Did you mean: nb2
2011 Apr 15
3
Rsquared for anova
I calculate an anova test in the following way: expdata<-read.table("/home/dorien/UA/meta-music/optimuse/optimuse1-build-desktop/results/results_processedCP", header=TRUE) names(expdata)<-c('nh1','nh2','nh3','randsize','aweights','tt1','tt2','tt3','path','iters','type','length','tos','tws','time') fit<-(aov(tos~nh1*nh2*nh3*randsize*aweights*tt1*tt2*tt3*iters*length, data=expdata)) sum...
2017 Jan 27
1
Disallow binding via tinc
...arder to configure though and easier to get wrong. If I could avoid having the tun0, that would trivially solve the problem. On 27/01/17 09:41, Azul wrote: > Why not just firewall incoming traffic on the clients? > > > On 27 Jan 2017 8:37 am, "Niklas Hambüchen" <mail at nh2.me > <mailto:mail at nh2.me>> wrote: > > I'm looking for a way to add some (Linux) participants into my tinc > network, but I want to protect them from accidentally binding a port so > that it's accessible via tinc. > > For example, `nc -l` by...
2005 Jan 28
4
extracting from a data.frame
...ot;CE" "CE1" "CE2" "CE3" "CG" [12] "CG1" "CG2" "CH2" "CZ" "CZ2" "CZ3" "N" "ND1" "ND2" "NE" "NE1" [23] "NE2" "NH1" "NH2" "NZ" "O" "OD1" "OD2" "OE1" "OE2" "OG" "OG1" [34] "OH" "OXT" "SD" "SG" Now I would like to get all rows of a, that have the value "O" in V3. I tried a lot of...
2018 Feb 04
2
Very slow rsync to gluster volume UNLESS `ls` or `find` scan dir on gluster volume first
...fter I started stracing rsync, all I could see was lstat calls, quite slow ones, over and over, which is expected. For example: lstat("uploads/2016/10/nexus2cee_DSC05339_thumb-161x107.jpg", {st_mode=S_IFREG|0664, st_size=4043, ...}) = 0 I googled around and found https://gist.github.com/nh2/1836415489e2132cf85ed3832105fcc1, which is seeing this exact issue with gluster, rsync and xfs. Here's the craziest finding so far. If while rsync is running (or right before), I run /bin/ls or find on the same gluster dirs, it immediately speeds up rsync by a factor of 100 or maybe even 1000....
2017 Jan 27
4
Disallow binding via tinc
I'm looking for a way to add some (Linux) participants into my tinc network, but I want to protect them from accidentally binding a port so that it's accessible via tinc. For example, `nc -l` by default listens to all interfaces. Similarly, some software (I think mongodb < 2.6 was among those) bind to all interfaces AND allow unauthenticated access that can do remote code execution,
2018 Feb 05
0
Very slow rsync to gluster volume UNLESS `ls` or `find` scan dir on gluster volume first
...l I could see was lstat calls, quite slow > ones, over and over, which is expected. > > For example: lstat("uploads/2016/10/nexus2cee_DSC05339_thumb-161x107.jpg", > {st_mode=S_IFREG|0664, st_size=4043, ...}) = 0 > > I googled around and found > https://gist.github.com/nh2/1836415489e2132cf85ed3832105fcc1, which is > seeing this exact issue with gluster, rsync and xfs. > > Here's the craziest finding so far. If while rsync is running (or right > before), I run /bin/ls or find on the same gluster dirs, it immediately > speeds up rsync by a factor of...
2017 May 18
1
Improving packets/sec and data rate - v1.0.24
...inc config, and using full host declerations for routs rather than dumping things to the tun interface ambiguously. "Forwarding = kernel" ip route add 1.2.3.4 via 4.3.2.1 dev tun -instead of- ip route add 1.2.3.4 dev tun On May 17, 2017 3:10 PM, "Niklas Hambüchen" <mail at nh2.me> wrote: > On 17/05/17 21:50, Jared Ledvina wrote: > > Were you ever able to make any further > > progress on adjusting Tinc based on the investigation in > > https://github.com/gsliepen/tinc/issues/110 ? > > Hi Jared, > > No, not yet. > > I list a few w...
2018 Feb 05
2
Very slow rsync to gluster volume UNLESS `ls` or `find` scan dir on gluster volume first
...> > ones, over and over, which is expected. > > > > For example: lstat("uploads/2016/10/nexus2cee_DSC05339_thumb- > 161x107.jpg", > > {st_mode=S_IFREG|0664, st_size=4043, ...}) = 0 > > > > I googled around and found > > https://gist.github.com/nh2/1836415489e2132cf85ed3832105fcc1, which is > > seeing this exact issue with gluster, rsync and xfs. > > > > Here's the craziest finding so far. If while rsync is running (or right > > before), I run /bin/ls or find on the same gluster dirs, it immediately > > speed...
2017 Jan 27
0
Disallow binding via tinc
Why not just firewall incoming traffic on the clients? On 27 Jan 2017 8:37 am, "Niklas Hambüchen" <mail at nh2.me> wrote: > I'm looking for a way to add some (Linux) participants into my tinc > network, but I want to protect them from accidentally binding a port so > that it's accessible via tinc. > > For example, `nc -l` by default listens to all interfaces. > > Similarly,...
2017 Oct 24
0
create volume in two different Data Centers
Il 24/10/2017 12:45, atris adam ha scritto: > thanks for answering. But I have to setup and test it myself and > record the result. Can you guide me a little more. The problem is, one > valid ip for each data centers exist, and each data centers have 3 > servers. How should I config the network in which the server bricks > see each other to create a glusterfs volume? > I would
2017 Sep 17
3
Confusing lstat() performance
On 17/09/17 18:03, Niklas Hamb?chen wrote: > So far the only difference between `ls` and `bup index` I could observe > is that `bup index` chdir()s into the directory to index, ls doesn't. > > But when I `cd` into the dir and run `ls` without directory argument, it > is still much faster than bup index for each stat(). Hmm, bup uses the fchdir() syscall to go into the target
2017 Sep 18
2
Confusing lstat() performance
Hi Ben, do you know if the smallfile benchmark also does interleaved getdents() and lstat, which is what I found as being the key difference that creates the performance gap (further down this thread)? Also, wouldn't `--threads 8` change the performance numbers by factor 8 versus the plain `ls` and `rsync` that I did? Would you mind running those commands directly/plainly on your cluster to
2017 Sep 18
0
Confusing lstat() performance
----- Original Message ----- > From: "Niklas Hamb?chen" <mail at nh2.me> > To: "Ben Turner" <bturner at redhat.com> > Cc: gluster-users at gluster.org > Sent: Sunday, September 17, 2017 9:49:10 PM > Subject: Re: [Gluster-users] Confusing lstat() performance > > Hi Ben, > > do you know if the smallfile benchmark also does...
2017 Sep 17
0
Confusing lstat() performance
I found the reason now, at least for this set of lstat()s I was looking at. bup first does all getdents(), obtaining all file names in the directory, and then stat()s them. Apparently this destroys some of gluster's caching, making stat()s ~100x slower. What caching could this be, and how could I convince gluster to serve these stat()s as fast as if a getdents() had been done just before
2017 Oct 24
2
create volume in two different Data Centers
thanks for answering. But I have to setup and test it myself and record the result. Can you guide me a little more. The problem is, one valid ip for each data centers exist, and each data centers have 3 servers. How should I config the network in which the server bricks see each other to create a glusterfs volume? On Tue, Oct 24, 2017 at 1:47 PM, <lemonnierk at ulrar.net> wrote: > Hi,
2017 Sep 14
5
Confusing lstat() performance
Hi, I have a gluster 3.10 volume with a dir with ~1 million small files in them, say mounted at /mnt/dir with FUSE, and I'm observing something weird: When I list and stat them all using rsync, then the lstat() calls that rsync does are incredibly fast (23 microseconds per call on average, definitely faster than a network roundtrip between my 3-machine bricks connected via Ethernet). But
2017 Sep 18
1
Confusing lstat() performance
On 18/09/17 17:23, Ben Turner wrote: > Do you want tuned or untuned? If tuned I'd like to try one of my tunings for metadata, but I will use yours if you want. (Re-CC'd list) I would be interested in both, if possible: To confirm that it's not only my machines that exhibit this behaviour given my settings, and to see what can be achieved with your tuned settings. Thank you!
2017 Sep 18
0
Confusing lstat() performance
...clients and servers(echo 3 > /proc/sys/vm/drop_caches) before running your tests to eliminate server and client side caching. If you are not dropping cache this could also cause the differences you are seeing. -b ----- Original Message ----- > From: "Niklas Hamb?chen" <mail at nh2.me> > To: gluster-users at gluster.org > Sent: Thursday, September 14, 2017 8:42:44 AM > Subject: [Gluster-users] Confusing lstat() performance > > Hi, > > I have a gluster 3.10 volume with a dir with ~1 million small files in > them, say mounted at /mnt/dir with FUSE,...
2018 Feb 05
0
Very slow rsync to gluster volume UNLESS `ls` or `find` scan dir on gluster volume first
...er, which is expected. >> > >> > For example: lstat("uploads/2016/10/nexus2c >> ee_DSC05339_thumb-161x107.jpg", >> > {st_mode=S_IFREG|0664, st_size=4043, ...}) = 0 >> > >> > I googled around and found >> > https://gist.github.com/nh2/1836415489e2132cf85ed3832105fcc1, which is >> > seeing this exact issue with gluster, rsync and xfs. >> > >> > Here's the craziest finding so far. If while rsync is running (or right >> > before), I run /bin/ls or find on the same gluster dirs, it immediately...
2017 Sep 15
0
Confusing lstat() performance
Hi Niklas, Out of interest have you tried testing performance with performance.stat-prefetch enabled? -- Sam McLeod @s_mcleod https://smcleod.net > On 14 Sep 2017, at 10:42 pm, Niklas Hamb?chen <mail at nh2.me> wrote: > > Hi, > > I have a gluster 3.10 volume with a dir with ~1 million small files in > them, say mounted at /mnt/dir with FUSE, and I'm observing something weird: > > When I list and stat them all using rsync, then the lstat() calls that > rsync does are i...