similar to: Efficient Package for Huge datasets in R

Displaying 20 results from an estimated 1000 matches similar to: "Efficient Package for Huge datasets in R"

2013 Feb 27
0
Bigalgebra and irlba error
When running irlba on a big.matrix as in the example from the vignette (on Windows R 2.15.2 64 bit) it returns with an error (see below). irlba works fine on a regular R matrix > library(bigalgebra) > library(irlba) Loading required package: Matrix Loading required package: lattice > matmul <- function(A, x, transpose=FALSE) + { + if(transpose) {return(t( t(x) %*% A))}# i.e.,
2002 Oct 29
0
patch to mva:prcomp to use La.svd instead of svd (PR#2227)
Per the discussion about the problems with prcomp() when n << p, which boils down to a problem with svd() when n << p, here is a patch to prcomp() which substitutes La.svd() instead of svd(). -Greg (This is really a feature enhancement, but submitted to R-bugs to make sure it doesn't get lost. ) *** R-1.6.0/src/library/mva/R/prcomp.R Mon Aug 13 17:41:50 2001 ---
2012 Sep 13
0
bigmatrix and irlba
Hello, good mornig, i have one questions, anybody know how to calculate svd of a matrix of the library bigmatrix with library irlba? thanks [[alternative HTML version deleted]]
2017 Sep 15
0
Regarding Principal Component Analysis result Interpretation
First, see the example at https://isezen.github.io/PCA/ > On 15 Sep 2017, at 13:43, Shylashree U.R <shylashivashree at gmail.com> wrote: > > Dear Sir/Madam, > > I am trying to do PCA analysis with "iris" dataset and trying to interpret > the result. Dataset contains 150 obs of 5 variables > > Sepal.Length Sepal.Width Petal.Length Petal.Width
2017 Sep 15
3
Regarding Principal Component Analysis result Interpretation
Dear Sir/Madam, I am trying to do PCA analysis with "iris" dataset and trying to interpret the result. Dataset contains 150 obs of 5 variables Sepal.Length Sepal.Width Petal.Length Petal.Width Species 1 5.1 3.5 1.4 0.2 setosa 2 4.9 3.0 1.4 0.2 setosa
1998 Apr 24
1
Warning: ignored non function "scale"
I've been working on a revised version of prcomp and princomp. Below is my current draft of prcomp, which is marginally different from V&R. I've added center and scale as optional arguments. However, scale causes the following: > zi _ prcomp(iris[,,2]) Warning: ignored non function "scale" because scale is both a variable and a function. Is there any way to avoid this
2007 Apr 12
2
Asterisk 1.2.17 and Cisco 7940/SIP: bug or what?
Hi. I'm stuck into an odd situation. Here's what happens: 4 Thomson ST2030S 2 Cisco 7912 3 Cisco 7940 2 AAstra 480i Asterisk 1.2.17 Diva 4BRI + chan_capi I've just upgraded yesterday from Asterisk 1.2.13 to 1.2.17. Until yesterday, everything was just fine with 1.2.13. Immediately after the upgrade, *all* the 7940 are no more able to make calls, just receive them, while 7912
2000 Apr 26
1
Factor Rotation
How does one rotate the loadings from a principal component analysis? Help on function prcomp() from package mva mentions rotation: Arguments retx a logical value indicating whether the rotated variables should be returned. Values rotation the matrix of variable loadings (i.e., a matrix whose olumns contain the eigenvectors). The function princomp returns this in the element
2011 Nov 12
1
Use of Matrix within packages in R-2.14.0
Dear R-devel readers: I am really stuck trying resolving an issue with the use of the Matrix in one of my packages, irlba, with R-2.14.0. When I use crossprod with at least one sparse argument in the packaged code I receive the error: Error in crossprod(x, y) : requires numeric/complex matrix/vector arguments However, when I run the code outside of the context of the package it works fine.
2005 Feb 03
0
Interpretation of PC loadings
Hello, Following on from a paper by Ludwig, Horel and Whiteman in 2004, I have been using PCA to identify surface wind patterns. In the paper they approach the problem using the "real vector approach", that is, they create paired (u,v) vectors for the wind data, in effect artificially doubling the number of variables, then perform the pca, subsequently repairing the output and plotting
2011 Sep 28
0
PCA: prcomp rotations
Hi all, I think I may be confused by different people/programs using the word rotation differently. Does prcomp not perform rotations by default? If I understand it correctly retx=TRUE returns ordinated data, that I can plot for individual samples (prcomp()$x: which is the scaled and centered (rotated?) data multiplied by loadings). What does it mean that the data is rotated from the
2004 Nov 14
2
Exporting to file: passing source name to file name in loop
Hi, I'm having a mental block as to how I can automatically assign filenames to the output of the following code. I am wishing to create a separate .png file for every image created, each of them having a sequential filename ie "sourcefile_index.png" so that I can create a movie from them. Please could someone tell me where I am going wrong? the following code works fine and
1998 Aug 26
0
prcomp & princomp - revised
My previous post about prcomp and princomp was done in some haste as I had long ago indicated to Kurt that I would try to have this ready for the June release, and it appeared that I would miss yet another release. I also need to get it out before it becomes hopelessly buried by other work. Brian Ripley kindly pointed out some errors, and also pointed out that I was suggesting replacing some
2016 Apr 20
0
Solving sparse, singular systems of equations
This is kind of like asking for a solution to x+1=x+1. Go back to linear algebra and look up Singular Value Decomposition, and decide if you really want to proceed. See also ?svd and package irlba. -- Sent from my phone. Please excuse my brevity. On April 20, 2016 4:22:34 AM PDT, A A via R-help <r-help at r-project.org> wrote: > > > >I have a situation in R where I would like
2013 Dec 17
1
Polychoric Principal Component Analysis (pPCA)
I have data set with binary responses. I would like to conduct polychoric principal component analysis (pPCA). I know there are several packages used in PCA but I could not find one that directly estimate pPCA and graph the individuals and variables maps. I will appreciate any help that expand these reproducible scripts. #How to conduct polychoric principal component analysis pPCA using #either
2008 Jul 03
2
PCA on image data
Dear R users, i would like to apply a PCA on image data for data reduction. The image data is available as three matrices for the RGB values. At the moment i use x <- data.frame(R,G,B)#convert image data to data frame pca<-princomp(x,retx = TRUE) This is working so far. >From this results then i want to create a new matrix from the first (second..) principal component. Here i stuck.
2008 Jun 11
3
Finding Coordinate of Max/Min Value in a Data Frame
Hi, Suppose I have the following data frame. __BEGIN__ > library(MASS) > data(crabs) > crab.pca <- prcomp(crabs[,4:8],retx=TRUE) > crab.pca$rotation PC1 PC2 PC3 PC4 PC5 FL 0.2889810 0.3232500 -0.5071698 0.7342907 0.1248816 RW 0.1972824 0.8647159 0.4141356 -0.1483092 -0.1408623 CL 0.5993986 -0.1982263 -0.1753299 -0.1435941 -0.7416656 CW
2006 Feb 27
1
question about Principal Component Analysis in R?
Hi all, I am wondering in R, suppose I did the principal component analysis on training data set and obtain the rotation matrix, via: > pca=prcomp(training_data, center=TRUE, scale=FALSE, retx=TRUE); Then I want to rotate the test data set using the > d1=scale(test_data, center=TRUE, scale=FALSE) %*% pca$rotation; > d2=predict(pca, test_data, center=TRUE, scale=FALSE); these two
2008 Feb 14
1
Principal component analysis PCA
Hi, I am trying to run PCA on a set of data with dimension 115*300,000. The columns represnt the snps and the row represent the individuals. so this is what i did. #load the data code<-read.table("code.txt", sep='\t', header=F, nrows=300000) # do PCA # pr<-prcomp(code, retx=T, center=T) I am getting the following error message "Error: cannot allocate vector of
2008 Jun 10
1
Concat Multiple Plots into one PNG figure
Dear experts, I tried to put the two plots into one final PNG figure with the following script. However instead of giving 2 plots in one figure, it only gives the the last plot in one figure. What's wrong with my script below? __BEGIN__ in_fname <- paste("mydata.txt.",sep="") out_fname <- paste("finalplot.png",sep="") dat <-