Displaying 20 results from an estimated 4000 matches similar to: "rsync and many files"
2004 Apr 21
2
Resizing a ListCtrl
Hi Guys,
I''m having serious troubles resizing a dialog with a ListCtrl. The ctrl
will not resize horizontally no matter what I''m doing. I''ve attached a
sample code below. Any help will be greatly appreciated, as I really
like wxRuby :)
I''ve also tried to copy from the example from listtest.rbw, but that
also doesn''t seem to work.
Another thing
2012 Jun 18
1
Changing many csv files using apply?
Dear all,
I have many csv files whose contents I want to change a bit en masse. So far, I've written code that can change them in a for loop, like so:
# Subset of files in the folder I want to change
subset = "somestring"
# Retrieve list of files to change
filelist=list.files()
filelist = filelist[grep(subset, filelist)]
for(i in 1:length(filelist)){
setwd(readdir)
2009 Feb 19
2
read.table : how to condition on error while opening file?
Hi,
I'm using read.table in a loop, to read in multiple files. The problem
is that when a file is missing there is an error message and the loop is
broken; what I'd like to do is to test for the error and simply do
"next" instead of breaking the loop. Anybody knows how to do that?
Example:
filelist <- c("file1.txt", "file2.txt",
2003 Feb 12
2
Filelist caching
Hi,
I've noticed every time someone does an rsync-request on my ftp-site
(which also provides rsync as mirror method), rsyncd creates a filelist.
This is a quite IO and CPU intensive procedure, especially for things
mirrors like FreeBSD with lots of little files.
I was wondering... is there a way to cache that filelist? Our mirrors
are updated once, or twice a day, it could speed up
2010 Feb 19
3
Plotting multiple table automatically
Hi All,
I have a slight issue getting R to plot a series of tables automatically.
Essentially I have a series of tables that I wish to plot. They are named
on_2, on_3 etc. based on the file name when they were read in. I have
filelist <- list.files() to give me list of the table names. I wish to plot
each table, so I was thinking along some kind of for loop as below:
for (i in 1:Number_Files)
2009 Mar 23
2
Looping of read.table and assignment
Dear all,
I am trying to read in and assign data from 50 tables in an automated fashion. I have the following code, which I created with the help of textbooks and the internet, but it only seems to read in the final data file over and over again. For example, when I type:> table_1951 I get the same values in the table as when I type> table_2000 despite the values in the source tables
2009 Mar 27
2
Assignment to variables fails to loop
Dear all,
I think I'm nearly there in writing R code which will read in files with two variable parts to the file name and then assigning these file names to objects, which also have two variable parts. I have got the code running without encountering errors, however, I receive 50+ of the same warnings:
1: In assign(paste("Fekete_", index$year, index$month, sep = ""),
2024 Nov 06
1
Using multiple dat files
"It seems therefore that there is no other way than read in individually >
100 weather tables using read.tables., right? Using file.choose() doesn't
change the work."
Yes. With that many files, file.choose() does not make sense. However, I
still do not understand what is the problem with using lapply() on the
character vector of file names with read.table() as you did in your
2007 Dec 26
1
scope of plugns
After more than one hour of countless tries, I ask myself a simple question :
On what items are plugins supposed to execute ?
I''ve tried to create a filelist plugin which, for a page, displays all
file in the same directory (a rather old school view of website, where
each directory contains an entry point).
But, whatever I try, my plugin code is never invoked, and my page
content is never
2011 Apr 23
1
rake spec fails where rake spec:(models|controllers|views) pass
I''m still trying to work into Ruby 1.9.2 and am now experiencing
something that makes no sense to me. Using rspec 1.3.2 and rspec-rails
1.3.4 with rails 2.3.11 on ruby 1.9.2-p180, when I
$ rake spec:models
they all pass. When I
$ rake spec:controllers
they all pass. When I
$ rake spec:views
they all pass. But when I
$ rake spec
I get
<path to
2009 Jun 30
3
sync performance falls off a cliff
Hi,
I've got identical servers. One is primary the other is backup
receiving rsyncs from the primary. I'm backing up a file system to
disk and the files are small and there are lots of directories.
The overall problem seems to be the total number of files.
When I had ~375,000 files, the total rsync time was under a minute.
With ~425,000 files, the total rsync time is 10 minutes.
Last
2009 Dec 28
1
accessing members of a data.frame
I have the following code
fileList <-list.files(path = ".", pattern = "[^a-z].txt$", all.files =
FALSE, full.names = FALSE, recursive = FALSE, ignore.case = FALSE)
for (x in 1:length(fileList)){
fileLines <- data.frame(read.table(fileList[x]))
print(string)
}
the lines of the file all have the following format...
AB,20091224,156,156,154,154,55,1198
Can I access
2005 May 23
3
filelist caching optimization proposal
Hi,
As a gentoo-user i frequently run the emerge sync command, which in turn does
a rsync with the mainserver. The 'problem' is that the portage directory tree
contains about 19.000 directories and 96.000 files. So building the filelist
takes a pretty long time, because of the many disk accesses that are
neccesary. On the server side the disk-io problem is probably less worse
since
2003 Sep 12
1
Using the system command
Hello, I am currently taking a statistics course and we are to do a project producing a graph using multiple input files.
In R, I'm trying to build a filelist based on a pattern. For some reason, if I do the command interactively and not assign it to an array variable I get what I thought I should, but if I do this inside my R program it chops off some file names and thinks there are two.
2007 May 09
1
Including data when building an R package in windows
I've done this before, but when I tried the same thing this time, it didn't work.
I'm using R 2.4.1 on windows.
I have 6 data frames that I want to include in a package I am building. Instead of making users issue six different "data(...)" commands, I want to wrap them all up in one file so that users issue one "data(...)" command and have access to all six data
2009 Dec 30
1
seg-fault... but on what
I got the following after running succesfully through this loop 28 million
times... the loop opens text files in a directory and inserts line by line
into a database...
*** caught segfault ***
address 0xc0000010, cause 'memory not mapped'
Traceback:
1: .getGeneric(f, where, package)
2: getGeneric("coerce", where = where)
3: as(obj, "integer")
4:
2023 Dec 21
1
rsync over ssh fails with --files-from
Hi,
On Wed, Dec 20, 2023 at 11:03?AM Kevin Korb via rsync <rsync at lists.samba.org>
wrote:
> What is the error? I assume you know that with that syntax the
> filelist.txt is local rather than remote.
>
Yes, I do know it refers to the list of local files.
There is no error - it just hangs indefinitely until some timeout period.
This is what it looks like on the remote side:
$
2023 Dec 20
1
rsync over ssh fails with --files-from
What is the error? I assume you know that with that syntax the
filelist.txt is local rather than remote.
On 12/20/23 09:50, Alex via rsync wrote:
> Hi, I've been using rsync on fedora over ssh to sync directories for
> decades, but suddenly having a problem with transferring multiple files
> at a time to one specific host using --files-from. I can't think of what
> might
2008 Jul 06
3
Lots of huge matrices, for-loops, speed
Hello,
we have 80 text files with matrices. Each matrix represents a map (rows for
latitude and columns for longitude), the 80 maps represent steps in time. In
addition, we have a vector x of length 80. We would like to compute a
regression between matrices (response through time) and x and create maps
representing coefficients, r2 etc. Problem: the 80 matrices are of the size
4000 x 3500 and we
2023 Dec 21
1
rsync over ssh fails with --files-from
Can someone help me determine if these errors are normal or if this could
somehow be the cause? I've removed the last three columns for readability -
they were all zeros.
# column -t /proc/net/dev
Inter-| Receive | Transmit
face |bytes packets errs drop fifo frame compressed
multicast|bytes packets errs drop fifo
lo: 133093161 146045 0