similar to: Speeding reading of large file

Displaying 20 results from an estimated 100 matches similar to: "Speeding reading of large file"

2012 Mar 28
2
Data extraction
Dear ReXperts, I have the below text file output. I need to extract the T, QC, QO, QO-QC and WT columns for the data between T = 10 and T=150. Any ideas? Thanks in advance. ======================================================================================== 1 D C ---CAT-- T THETA QC QO QO-QC QC/QO WT FSD 8 1 0 1.0000E+01
2012 Feb 16
2
help with e+01 number abbreviations
Dear List, I will appreciate any advice regarding how to convert the following numbers [I got in return by taxondive()] in numeric integers without the e.g. 6.4836e+01 abbreviations. Thank you very much in advance, Gian > taxa_dive Species Delta Delta* Lambda+ Delta+ S Delta+ Nat1 5.0000e+00 6.4836e+01 9.5412e+01 6.7753e+02 8.7398e+01 436.99 Nat2
2012 Oct 18
4
speeding read.table
R 2.15.1 OS X Colleagues, I am reading a 1 GB file into R using read.table. The file consists of 100 tables, each of which is headed by two lines of characters. The first of these lines is: TABLE NO. 1 The second is a list of column headers. For example: TABLE NO. 1 COL1 COL2 COL3 COL4 COL5 COL6 COL7 COL8 COL9 COL10
2008 Sep 05
0
help for color parameter
Dear all: I attached the dataset with this email and post codes as below. My questions is related to the 'col=temp.col' for the line and pch in my code, I have 4 IDs, 10 DIDs and each ID include different DIDs, for example, first ID has 3 DIDs, then the color is the first three colors(black, red, green) in the first plot, but in the second plot, why the color change to pink which is
2008 Dec 22
1
questions about read datafile into R
Dear all: I have been thinking to import below one data file (.txt)into R by read.table(..,skip=1, header=T). But How can I deal with the repeated rows of TABLE NO.1 and names of data variables in the middle of this data file. The similar block will be repeated 100 times, here only show 4 of them and within each block, data records also can vary, here only paste 4 rows for example. I appreciate
2008 Dec 22
1
question about read datafile
Dear all: I have been thinking to import below one data file (.txt)into R by read.table(..,skip=1, header=T). But How can I deal with the repeated rows of TABLE NO.1 and names of data variables in the middle of this data file. The similar block will be repeated 100 times, here only show 4 of them and within each block, data records also can vary, here only paste 4 rows for example. I appreciate
2002 Sep 09
3
loading data from a specified directory
System info: Linux slackware R Version 1.5.1 (2002-06-17) ESS 5.1.21 Emacs 21.2.1 ------------------- Colleagues I have some text files in a certain directory and want to process them sequentially. So I want to pass the filename identifier into a function and loop through the processing of each file in turn.I've called the file identifier f in this code segment: image.dvm <- function
2008 Dec 29
0
Serial Correlation Test for Short Time Series
Hello, Are there any R functions available for performing a serial correlation test for short time series (e.g, series having between 10-14 observations)? Many thanks! Isabella R. Ghement, Ph.D. Ghement Statistical Consulting Company 301-7031 Blundell Road, Richmond, B.C., Canada, V6Y 1J5 Tel: 604-767-1250 Fax: 604-270-3922 E-mail: isabella at ghement.ca Web: www.ghement.ca -----Original
2009 Jan 18
1
?grep
Dear Rxperts, I have the following data: Study Study.Name C Category TC Time QC QO SD FSD Theta 1 NONE 0 P(22) 0 0.00 7.5596 0 0 8.0361e-03 0 1 NONE 6 G(50) 0 0.00 1.0000 0 0 0.0000e+00 0 1 NONE 2 F(02) 0 0.00 100.0000 0 0 0.0000e+00 0 1 NONE 3 F(03) 0 0.00 13.2280 0 0 1.6732e-02 0
2008 Aug 29
1
significance of random effects in poisson lmer
Hi, I am having problems trying to assess the significance of random terms in a generalized linear mixed model using lme4 package. The model describes bird species richness R along roads (offset by log length of road log_length) as a function of fixed effects Shrub (%shrub cover) and Width (width of road), and random effect Site (nested within Site Cluster). >From reading answers to previous
2008 Jun 03
0
Summarizing dummy coefficients in sem package
Greetings, I am working in the sem package on a model with 3 exogenous variables (2 are nominal-categorical), and 4 endogenous, continuous variables. To use sem with the nominal variables, I created dummy variables. Now, in my sem output I have estimates for path coefficients for the relationship between each level of the nominal variables and the endogenous variables they are associated
2001 Jun 26
5
breaks in hist()
I was using the hist() function to create a frequency table of some network traffic data. The range in values is rather large, from 0 till just under 10e12. Calling hist(x, breaks=c(0,1000,1e6,1e9,1e12),plot=F,freq=T) causes hist() to return : $breaks [1] -1.0000e+05 1.0100e+05 1.1000e+06 1.0001e+09 1.0000e+12 Is this recalculation of the breaks by hist() intended? Maarten van Gelder.
2006 Aug 22
1
Total (un)standardized effects in SEM?
Hi there, as a student sociology, I'm starting to learn about SEM. The course I follow is based on LISREL, but I want to use the SEM-package on R parallel to it. Using LISREL, I found it to be very usable to be able to see the total direct and total indirect effects (standardized and unstandardized) in the output. Can I create these effects using R? I know how to calculate them
2008 Dec 22
1
sem package fails when no of factors increase from 3 to 4
#### I checked through every 3 factor * 3 loading case. #### While, 4 factor * 3 loading failed. #### the data is 6 factor * 3 loading require(sem); cor18<-read.moments(); 1 .68 1 .60 .58 1 .01 .10 .07 1 .12 .04 .06 .29 1 .06 .06 .01 .35 .24 1 .09 .13 .10 .05 .03 .07 1 .04 .08 .16 .10 .12 .06 .25 1 .06 .09 .02 .02 .09 .16 .29 .36 1 .23 .26 .19 .05 .04 .04 .08 .09 .09 1 .11 .13 .12 .03 .05 .03
2002 Apr 01
3
svd, La.svd (PR#1427)
(I tried to send this earlier, but it doesnt seem to have come through, due to problems on my system) Hola: Both cannot be correct: > m <- matrix(1:4, 2) > svd(m) $d [1] 5.4649857 0.3659662 $u [,1] [,2] [1,] -0.5760484 -0.8174156 [2,] -0.8174156 0.5760484 $v [,1] [,2] [1,] -0.4045536 0.9145143 [2,] -0.9145143 -0.4045536 > La.svd(m) $d [1]
2008 Mar 08
1
analysing mixed effects/poisson/correlated data
I am attempting to model data with the following variables: timepoint - n=48, monthly over 4 years hospital - n=3 opsn1 - no of outcomes total.patients skillmixpc - skill mix percentage nurse.hours.per.day Aims To determine if skillmix affects rate (i.e. no.of.outcomes/total.patients). To determine if nurse.hours.per.day affects rate. To determine if rates vary between
2006 Jun 12
1
r's optim vs. matlab's fminsearch
Hi, I'm having a problem converting a Matlab program into R. The R code works almost all the time, but about 4% of the time R's optim function gets stuck on a local minimum whereas matlab's fminsearch function does not (or at least fminsearch finds a better minimum than optim). My understanding is that both functions default to Nelder-Mead optimization, but what's different about
1998 Apr 07
3
R-beta: spline problems(?)
Hi, I am a total beginner with this whole thing so please have patience! I am trying to run an S-plus program with a certain line: spline(1:nrow(y), y[,1],n=100); This crashes with: Error: NAs in foreign function call (arg 8) Apparently, this is caused by the last command of spline: u <- seq(xmin, xmax, length.out = n) .C("spline_eval", z$method, length(u), x = u, y =
2010 Sep 09
5
Highlighting a few bars in a barplot
Hello, I have a bar plot where I am already using colour to distinguish one set of samples from another. I would also like to highlight a few of these bars as ones that should be looked at in detail. I was thinking of using hatching, but I can't work out how or if you can have a background colour and hatching which is different between bars. Any suggestions on how I should do this? Thanks
2008 Sep 24
1
Logistic regression
Dear all, I am currently learning to run logistic regression models with R. Would someone tell me what this exactly means: Estimated scale (compare to 1 ) 1.746724 If the value is higher or lower than 1, what should I do? The complete results of the model were as follows: Generalized linear mixed model fit using Laplace Formula: success ~ diffca + (1 | partner1) + (1 | partner2) + (1 |