similar to: rsync taking a while on really large files

Displaying 20 results from an estimated 20000 matches similar to: "rsync taking a while on really large files"

2001 Oct 19
10
Winbind/RH7.1...More Help
The winbind now works...my getent passwd & groups returns the domain users/groups What should be the next step? my clients (Win2K & Win9x) are still prompting for a password and I cannot login to my linux box using DOMAIN*domainuser. Must I add each domain user as a user on the linux box? Regards Winston Nimchan -----Original Message----- From: Sean Trammell
2007 Sep 30
6
Switching to user mode from domU kernel
I''m having trouble switching into user mode with my domU kernel -- everytime I call __HYPERVISOR_iret, the hypervisor calls into my kernel via the registered callback handler. None of the bits in the event channel pending arrays are set. If I return via the iret call, the hypervisor immediately calls back into the handler. The user RIP never changes, so it is clearly not making forward
2009 May 28
6
Users with large (4GB) inboxes crippling dovecot
Hi all, I'm new here and would very much appreciate any help you can give me. We are running a rather outdated mail server that until recently has been running beautifully. Under the pretense of "it is ain't broke, don't fix it" it hasn't been updated so is running Fedora Core 4 and dovecot v0.99.14. What is happening is that as users log in (via thunderbird), they
2004 Dec 04
2
RSync with /really/ long file lists
Hi everyone! rsync 2.5.7 linux RHES v3 We need to sync over 4 Million files, and when we run rsync we run out of memory! :( We were going to batch things, but the build in Batch mode still will use a large amount of memory. Any manualy batching is proving to be harder than you'd think, even with --include and --exclude flags. The flags actually make it still have to recurse the whole
2012 Jul 05
4
rsync based on checksum only
Is it possible to tell rsync *not* to use file names, date stamps, etc and only use the checksum for deciding if a file is the same? the remote machine "normalizes" a set of file names to remove all punctuation marks and forces all file names to lower case. The files themselves are unchanged. --checksum looks promising but it does not say anything about file names: -c, --checksum
2007 Jun 20
2
Page fault on mapped pages with reserved bits set
I''m porting a light weight kernel to run under the Xen hypervisor and have run into a problem while trying to switch to my page tables on x86-64. After a minor problem with switching to the new PML4 table that was cleared up when Mark Williamson suggested mapping everything read-only in the current map before switching, as well as switching the memory management code to use the
2009 Aug 16
1
Rsync completed successfully, but files are not identical
Hi All, I came into a strange issue running rsync on directory with ~500,000 files. Some of the file, although with same time stamps and size on source and destination, were different on the destination. The destination is just a mirrored area, and the data written to it, is just the one that comes through rsync. Needless to mentioned, that when I remove files and synced them again it works, or
2006 May 26
2
Do I need large Cyrus DB files?
While investigating my earlier Sendmail confusion I noticed these files: # ll /var/lib/imap/db/ total 15952 -rw------- 1 cyrus mail 16384 Jan 22 04:02 __db.001 -rw------- 1 cyrus mail 663552 Jan 22 04:02 __db.002 -rw------- 1 cyrus mail 98304 Jan 22 04:02 __db.003 -rw------- 1 cyrus mail 22568960 Jan 22 04:02 __db.004 -rw------- 1 cyrus mail 32768 Jan 22 04:02 __db.005 -rw-------
2010 Mar 08
1
Time stamps
I am new to SAMBA and I have what I'm not even sure is an issue. I am aware of the difference in time stamps between *nix and Windows. What I don't understand is this: I used touch to modify the time stamps of a large number of files on the file server from the server side to match the time in the file name. They were video files from my Digital Video Cam and the import program used
2009 Mar 09
1
How to exclude directories from getting their metadata updated? (Macintosh HFS+ with rsync 3.0.5)
Hello everyone! FOREWORD: I respect your time and resources, I hope to not bother people on this mailinglist! To my defense: This question is far easier towards humans than to mailinglist and web search-engines as the search terms in relation to each other are highly in-causal or paradoxical, and hence lead to poor results. Of course the manpage was the first place where I looked
2017 Feb 22
2
which rsync command?
All the files and directories I want to talk about are on the same machine (a Mac). I have a directory that I will call SOURCE. This contains a a number of files, some of which are directories containing further files. I want to copy these files to another directory, which I will call TARGET. Please assume that SOURCE and TARGET include absolute path-names. I think they should also end in a slash
2002 Oct 05
4
Implementation of S-Plus "nlmib" routine in R
Where can I find a package with an R implementation of the S-Plus "nlmib" general minimzation routine described in Venables & Ripley's "Modern Applie Statistics with S-Plus", 3rd Ed., pp 267 - 270? Thanks, David Stamps stamps.d.a at att.net -.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.- r-help mailing list -- Read
2006 Feb 19
1
Do we have one make more than necessary?
Hi, I was noticing that our debian/rules did: ... debian/stamps/build: mkdir -p $(@D) rm -rf debian/install $(MAKE) all DESTDIR=$(CURDIR)/debian/install KERNELS= GCC=$(CC) CC=$(CC) HOSTCC=$(CC) touch $@ install: debian/stamps/build rm -rf debian/install $(MAKE) dist DESTDIR=$(CURDIR)/debian/install KERNELS= XEN_PYTHON_NATIVE_INSTALL=1 CC=$(CC)
2003 Sep 12
2
Transferring large files using rsync
I am running into an issue with rsync that I need some help with. When syncing large files (e.g. 1GB), the rsync algorithm creates a temporary 1GB file and then renames it when the transfer is finished. The issue I am running into is if the two large files have very few differences between them, the bottleneck is creating the 1GB temporary file on the target box. This process takes several
2008 Feb 27
1
Warnings generated by log2()/log10() are really large/takes a long time to display
x <- rnorm(1e6); y <- log(x); # or logb(x) or log1p(x) w <- warnings(); print(object.size(w)); ## [1] 480 str(w); $ NaNs produced: language log(x) - attr(*, "dots")= list() - attr(*, "class")= chr "warnings" y <- log2(x); # or log10(x) w <- warnings(); print(object.size(w)); ## [1] 8000536 str(w); ## List of 1 ## $ NaNs produced: language
2011 Sep 07
2
finding events in a time duration.
Hi, Premises: I have a database which contain the list of events and their time stamps (This is a Unix time stamps) What I want to do : I want know how much is the maximum occurrence of this in any a time period of 7 days or does a event occur es more than "N" (say 5) times in a period of 7 days. This time period is not fixed with "week
2011 Feb 16
2
help migrating from file server to NAS w/ Active Directory
hello, I'm having a problem I hope will be easy for someone to explain to me how to fix. I need to migrate from an old server to a new Cisco Smart Storage NAS, which runs some flavor of linux and is Active Directory aware. Using something like Robocopy from the AD server, or rsync or tar from the file server does not preserve user/group identities or directory date stamps (maybe rsync
2007 Mar 30
3
Timestanp question
I've now got scripts that correctly backup all my primary partitions to a second drive. The original problem was that I copied them over without a time stamp, so that the first rsync run found no timestamps and wanted to copy them all over again. So I used: 'rsync -r -t -v --size-only $SOURCE $TARGET' My question is this: do I need to continue to use --size-only, or has the
2003 Nov 15
1
"touch" option for -c ?
Hi, I hope this hasn't been asked before ... I couldn't find it anyway. To the best of my knowledge, without the -c option rsync judges file differences based on date stamp and file size. This speeds things up of course but can be problematic when date stamps of two otherwise identical files are uncontrollable (say when they come from two different sources, such as installed from CD vs
2008 May 10
1
irregular time series and multiple, overlaid plots
I am new to R and am trying to solve the following problem: I have a data file containing tick-by-tick, millisecond level prices for some stocks. I have another file or two containing orders and trades, again, with millisecond time-stamps. Both of these files are irregularly spaced and the time stamps are in an iso format (<date> <time>.<millisecond>) I would like to create a