Displaying 3 results from an estimated 3 matches for "andy1983".
2007 Feb 12
3
processing a large matrix
I would like to compare every column in my matrix with every other column and
get the r-squared.
I tried using the following formula and looping through every column:
> summary(lm(matrix[,x]~matrix[,y]))$r.squared
If I have 10,000 columns, the loops (10,000 * 10,000) take forever even if
there is no formula inside.
Then, I attempted to vectorize my code:
> cor(matrix)^2
With 10,000
2007 Feb 27
1
read.csv size limits
I have been using the read.csv function for a while now without any problems.
My files are usually 20-50 MBs and they take up to a minute to import. They
have all been under 50,000 rows and under 100 columns.
Recently, I tried importing a file of a similar size (which means about the
same amount of data), but with ~500,000 columns and ~20 rows. The process is
taking forever (~1 hour so far). In
2007 Feb 08
1
loop issues (r.squared)
I would like to compare every column in my matrix with every other column and
get the r-squared. I have been using the following formula and loops:
summary(lm(matrix[,x]~matrix[,y]))$r.squared
where x and y are the looping column numbers
If I have 100 columns (10,000 iterations), the loops give me results in a
reasonable time.
If I try 10,000 columns, the loops take forever even if there is no