similar to: lm handling of ill-conditioned systems

Dear R users, I'm wondering about the singular.ok option in lm. If singular.ok is set to TRUE does it mean that we allow the generalized inverse of (X'X)^-1 (where X are the independent variables and ' denotes the transpose)? Or is the singularity handled in some other way? Thank you! Best regards, Martin. ======================================== Martin Eklund PhD Student

>I'm rusty, but not *that* rusty here, I hope. > >If W (=Z*Z' in your case) is singular, it can not have >inverse, which by >definition also mean that nothing multiply by it will >produce the identity >matrix (for otherwise it would have an inverse and >thus nonsingular). > >The definition of a generalized inverse is something >like: If A is a >non-null

Is there a function in R to calculate the generalized determinant of a singular matrix? - similar to the ginv() used to compute the generalized inverse. I can't seem to find any R related posts at all. Thanks in advance, Sean O'Riordain Trinity College Dublin -- View this message in context: http://r.789695.n4.nabble.com/Moore-Penrose-Generalized-determinant-tp4471629p4471629.html Sent

Thorsten is right. There is a direct formula for computing the Moore-Penrose inverse using the singular value composition of a matrix. This is incorporated in the following: mpinv <- function(A, eps = 1e-13) { s <- svd(A) e <- s$d e[e > eps] <- 1/e[e > eps] return(s$v %*% diag(e) %*% t(s$u)) } Hope it helps. Dietrich

I haven't found a function that directly calculates the matrix inverse, does it exist? Otherwise what would be the fastest way to do it? Patrik Waldmann -.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.- r-help mailing list -- Read http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html Send "info", "help", or "[un]subscribe" (in the

I'm very new to R so maybe i'm doing something wrong so please let me know it that is that case. Here is an example where the summary() and residuals() applied to lm object produce different results (I think the residuals() results is correct since SAS produces those numbers - the second residual corresponding to observation with weight 4 is wrong in summary()). x <- c( 10, 20, 30, 40

I have a simple system of linear equations to solve for X, aX=b: > a [,1] [,2] [,3] [,4] [1,] 1 2 1 1 [2,] 3 0 0 4 [3,] 1 -4 -2 -2 [4,] 0 0 0 0 > b [,1] [1,] 0 [2,] 2 [3,] 2 [4,] 0 (This is ex Ch1, 2.2 of Artin, Algebra). So, 3 eqs in 4 unknowns. One can easily use row-reductions to find a homogeneous solution(b=0) of: X_1

Hi, is there a function in R that will give me the variances of a predicted values obtained using predict.lm(). If no function is available I would need to calculate them myself - which involves taking the inverse of X'X (' indicating transpose) where X is my model matrix. I know that calculating an inverse directly is not a good idea in general - could anybody suggest a way around

Dear All, While inverting a matrix the following error appears on my console: Error in solve.default(my_matrix) : Lapack routine dgesv: system is exactly singular With this respect, I have been replacing the solve() function with ginv(): the Moore-Penrose generalized inverse of a matrix. These are the questions I would like to ask you: 1. Would you also replace solve() with ginv() in

I am using the ginv function from MASS and have run across this problem that I do not understand. If I define the matrix A as below, its g-inverse does not satisfy the Moore-Penrose condition A %*% ginv(A) %*% A = A. The matrix A is X'WX in a quadratic regression using some very large dollar values. The much simpler matrix B does satisfy the MP condition. Am I doing something wrong? Is

Can someone explain why I am getting the following error: in the r code below? Error in solve.default(diag(2) + ((1/currvar) * (XX1 %*% t(XX1)))) : system is computationally singular: reciprocal condition number = 0 In addition: There were 50 or more warnings (use warnings() to see the first 50) The R code is part of a bigger program. ##sample from full conditional

i am trying to use matinv from the Design package to compute the generalized inverse of the normal equations of a 3x3 design via the sweep operator. That is, for the linear model y = ? + x1 + x2 + x1*x2 where x1, x2 are 3-level factors and dummy coding is being used the matrix to be inverted is X'X = 9 3 3 3 3 3 3 1 1 1 1 1 1 1 1 1 3 3 0 0 1 1 1 1 0 0 1 0 0 1 0 0 3 0 3 0 1 1 1 0 1 0 0 1

I get this error while computing partial correlation. *Error in solve.default(Szz) : system is computationally singular: reciprocal condition number = 4.90109e-18* Why is it?Can anyone give me some idea ,how do i get rid it it? This is the function i use for calculating partial correlation. pcor.mat <- function(x,y,z,method="p",na.rm=T){ x <- c(x) y <- c(y)

Dear R-devel: I could use some advice about matrix calculations and steps that might make for faster computation of generalized inverses. It appears in some projects there is a bottleneck at the use of svd in calculation of generalized inverses. Here's some Rprof output I need to understand. > summaryRprof("Amelia.out") $by.self self.time self.pct

> Date: Wed, 30 Jun 1999 11:12:24 +0200 (MET DST) > From: Torsten Hothorn <hothorn at amadeus.statistik.uni-dortmund.de> > > yesterday I had a little shock using qr (or lm). having a matrix > > X <- cbind(1,diag(3)) > y <- 1:3 > > the qr.coef returns one NA (because X is singular). So I computed the > Moore-Penrose inverse of X (just from the

Speaking of optimization and speeding up R calculations... I mentioned last week I want to speed up calculation of generalized inverses. On Debian Wheezy with R-2.15.2, I see a huge speedup using a souped up generalized inverse algorithm published by V. N. Katsikis, D. Pappas, Fast computing of theMoore-Penrose inverse matrix, Electronic Journal of Linear Algebra, 17(2008), 637-650. I was so

Hi, While exploring how summary.lm generated its output I came across a section that left me puzzled. at around line 57 R <- chol2inv(Qr$qr[p1, p1, drop = FALSE]) se <- sqrt(diag(R) * resvar) I'm hoping somebody could explain the logic of these to steps or alternatively point me in the direction of a text that will explain these steps. In particular I'm puzzled

?ginv provides 'Modern Applied Statistics with S' (MASS), 3rd, by Venables and Ripley as the sole reference. I happen to have this book (4th ed) on loan from our library, and as far as I can see, ginv is mentioned there twice, and it is *used*, not *explained* in any way. (It is used on p. 148 in the 4th edition.) ginv does not appear in the index of MASS. ginv is an implementation of

dear R experts: ?I am writing my own little newey-west standard error function, with heteroskedasticity and arbitrary x period autocorrelation corrections. ?including my function in this post here may help others searching for something similar. it is working quite well, except on occasion, it complains that Error in solve.default(crossprod(x.na.omitted, x.na.omitted)) : system is

Hello, I am trying to run a linear regression analysis on my data set. For some reason most variables are removed due to singularities. My linear regression looks this way (I am using only partial data, which is selected by flags): fm<-lm(log(cplex6.time..sec..[flags]) ~ cplex6.cities[flags] + log(1/features.meanOver.frust[flags]) + log(1/features.meanOver.minDist[flags]) + [...]