similar to: sync 54 million files, tuning rsync?

Displaying 20 results from an estimated 9000 matches similar to: "sync 54 million files, tuning rsync?"

2005 Sep 29
2
SAMBA 3.0.14a getpwent() usage with LDAP backend -- URGENT HELP!!!
Hi, We're being hit by occasional very high load (up to 23 on a SUN Fire v440) on our LDAP server coming from a query of (objectClass=posixAccount). This currently returns over 54,000 entries ... This is coming from the getpwent() call in util_getent.c:getpwent_list() This is coming from srv_samr_nt.c:get_memberuids() But we're having trouble working out what triggers this call: it
2008 Jan 15
4
Moving zfs to an iscsci equallogic LUN
We have a Mirror setup in ZFS that''s 73GB (two internal disks on a sun fire v440). We currently are going to attach this system to an Equallogic Box, and will attach an ISCSCI LUN from the Equallogic box to the v440 of about 200gb. The Equallogic Box is configured as a Hardware Raid 50 (two hot spares for redundancy). My question is what''s the best approach to moving the ZFS
2005 Oct 10
1
excessive lpstat calls
I run a fairly busy samba server that only serves up users' home directory. I am running Samba v3.0.20 under Solaris 10 on a Sun v440. I'm seeing a large number of calls to '/usr/bin/lpstat -v'. These are probably occuring everytime a new client connects, but I'm not positive. The server does not have any printers attached to it, has no entries in /etc/printers.conf, and
2007 Aug 16
4
High CPU utilization on Solaris 10
I've read similar post about such an issue, but have not seen any posted solutions. I have a clean install of Solaris 10 running a Sunfire v440 w/postfix. I am using dovecote solely for SMTP authentication, and it is working just fine except while running top I constantly see: 548 root 1 30 0 5240K 3416K run 522:51 49.45% dovecot-auth The process never crashes, nor are there
2007 Sep 21
1
Rsync Truecrypt
I have seen people say both that rsync can efficiently copy truecrypt volumes. I got it working once with deltacopy but as I'm trying to get it to work from the command line, I cannot. It just transfers the whole file. I am using -rvs -inplace switches. Does anybody have any suggestions? _____________________________ Stephen Zemlicka Integrated Computer Technologies PH.
2006 Mar 01
6
Dtrace not working for processes running after a couple of hours
Hi, all, I''m a newbie on dtrace and the problem I am having is: For processes which have been running for more than a couple of hours, dtrace doesn''t seem to be able to trace(I waited for at least one hour and didn''t see anything happening). However, it works every time for a relatively new process. Any insight or help will be appreciated. This is my machine:
2012 Feb 01
3
A Billion Files on OCFS2 -- Best Practices?
We have an application that has many processing threads writing more than a billion files ranging from 2KB ? 50KB, with 50% under 8KB (currently there are 700 million files). The files are never deleted or modified ? they are written once, and read infrequently. The files are hashed so that they are evenly distributed across ~1,000,000 subdirectories up to 3 levels deep, with up to 1000 files
2008 Nov 24
3
debugging a faulty jboss/application
>From time to time a jboss process would end eating all, the available CPU and the load avg would skyrocket. Once the operators restarted jboss, the system''d be normal again (sometimes for weeks) until the next incident Since we moved the app from a v440 running Solaris 10 8/07 to a t2000 running Solaris 10 5/08 the problem started to happen more frequently (2-3 times a week). The
2005 Jun 10
1
Performance difference between 32-bit build and 64-bit build on Solaris 8
Hi everyone - I'm seeing a 32-bit build perform significantly faster (up to 3x) than a 64 bit build on Solaris 8. I'm running R version 2.1.0. Here are some of my system details, and some resulting timings: >uname -a SunOS lonetree 5.8 Generic_117350-16 sun4u sparc SUNW,Sun-Fire-V440 lonetree /home/sgilpin >gcc -v Reading specs from
2005 Jun 11
2
Performance difference between 32-bit build and 64-bit bu ild on Solaris 8
I'm not familiar with Solaris, so take this with appropriate dose of NaCl... For the 64-bit build, why not have the -O2 for gcc, since you have it for g77 and g++? If you just run vanilla configure for the 32-bit build, I believe it uses -O2 for all three compilers by default. If that's the difference, perhaps it's sufficient to explain the performance difference. The other thing
2007 Feb 12
17
NFS/ZFS performance problems - txg_wait_open() deadlocks?
Hi. System is snv_56 sun4u sparc SUNW,Sun-Fire-V440, zil_disable=1 We see many operation on nfs clients to that server really slow (like 90 seconds for unlink()). It''s not a problem with network, there''s also plenty oc CPU available. Storage isn''t saturated either. First strange thing - normally on that server nfsd has about 1500-2500 number of threads. I did
2006 Dec 08
22
ZFS Usage in Warehousing (lengthy intro)
Dear all, we''re currently looking forward to restructure our hardware environment for our datawarehousing product/suite/solution/whatever. We''re currently running the database side on various SF V440''s attached via dual FC to our SAN backend (EMC DMX3) with UFS. The storage system is (obviously in a SAN) shared between many systems. Performance is mediocre in terms
2017 Oct 24
2
Samba 4.6.7 AD, Netapp CDOT 9.2 and missing "Domain Users" membership
On 10/23/2017 10:26 AM, Rowland Penny via samba wrote: > OK, have you tried asking the Netapp company, 'how do I use this with > Active Directory' ? In this specific case no, but I already tried to open CIFS support cases but at the end they tell me that It works as expected with a MS DC and that Samba DC is not supported by them. I cannot omit that I use Samba because they always
2007 Aug 02
3
Dovecot strong or not for a big Webmail architecture
Hello, Do you think Dovecot could handle millions of active users in a big architecture ? This cluster could be for example (each server is a bi quad Xeon 2.66 Ghz) : - 40 Dovecot servers - 4 LVS - 20 Apache+PHP - 2 Openldap - 20 Postfix + ClamAV + SpamAssassin - 1 NFS Netapps For millions of user it could be multiple different clusters of 40 Dovecot servers with 1 Netapp for each cluster. I
2010 Sep 20
5
create mirror copy of existing zfs stack
Hi, I have a mirror pool tank having two devices underneath. Created in this way #zpool create tank mirror c3t500507630E020CEAd1 c3t500507630E020CEAd0 Created file system tank/home #zfs create tank/home Created another file system tank/home #zfs create tank/home/sridhar After that I have created files and directories under tank/home and tank/home/sridhar. Now I detached 2nd device i.e
2015 Jan 20
2
smbclient using SMB2+ against NetApp OnTap 8.2 anyone ?
So I just spent a frustrating day trying to get smbclient from 4.2.x and master connecting to a NetApp 8.2 box using SMB2 or SMB3 with NTLM auth. Short answer - it doesn't work :-(. Longer answer - the NetApp is choking on something inside the SPNEGO NTLMSSP packets we're sending it - giving the error that it couldn't parse the SPNEGO packet. Unfortunately (and knowing bugger-all
2011 Apr 26
1
Connection to rsyncd over ssh tunnel seems to choke up (v2.6.9 Ubuntu)
I have been running the following (from a cron script with a non password authorized_key exchange) ... rsync -aP -vv --exclude=".*/" -e 'ssh -fN user at site.com.au -L 8873:127.0.0.1:873' rsync://localhost:8873/data/ /data/ ... and not getting much to happen as either evidenced in /var/log/rsyncd.log or as artefacts on the local file system. Then I started to execute the
2012 Nov 18
6
Xen + IPv6 + Netapp = NFS read problem
Hello Maybe someone could direct us to right solution with the problem descibed below. We tried different trick bo no success stories. We have a development cluster based on Dell R815 servers (+-30) and a storage server - Netapp FAS 3240 runnig Data Ontap 8.1p2. We have some 100 virtual servers - we use Xen 4.1 for virtualisation. A basics OS is Debian Squeeze with some backports packages
2015 Feb 17
2
Using rpcclient with my NetApp fails
Hello: I have a Netapp 8.2.2P1 7-Mode connected to my Active Directory domain and the following rpcclient command on CentOS 6.5 is bailing on the following error: could not obtain sid for domain QUEST error: NT_STATUS_ACCESS_DENIED I've tested this with all stable version of 3.6 etc. I have not tried the python based rpcclient command yet though. But after a bit of debugging, it seems that
2011 Aug 07
3
Printing data frame with million rows
Dear all, I was working on number of files and at the end I got a data frame with approx. million rows.To prin this data frame in output, I used capture.output(print.data.frame(end,row.names=F), file = "summary", append = FALSE) where end is the name of my data frame and summary is the name of my output file. but when I checked the output there were only 10000 rows and at the last it