Displaying 20 results from an estimated 100 matches similar to: "Efficient distance calculation on big matrix"
2017 Jun 18
2
dist function in R is very slow
Hi Stefan,
Thank you very much for pointing me to the wordspace package. It does the job a bit faster than my C code but is 100 times more convenient.
By the way, since the tcrossprod function in the Matrix package is so fast, the Euclidean distance can be computed very fast:
euc_dist <- function(m) {mtm <- Matrix::tcrossprod(m); sq <- rowSums(m*m);? sqrt(outer(sq,sq,"+") -
2008 Feb 15
1
OT: installing the XML package - xmlOutputBufferCreateBuffer problem
Hi,
first of, my apologies for the possibly off-topic message regarding a
problem when installing the XML package (I meant to post at omegahat-
help, but I get 404 at http://www.omegahat.org/mailman/listinfo)
When installing the XML package using:
install.packages("XML")
everything seems to go fine... but then I try to load the package and
I get:
> library(XML)
Error in
2009 Aug 21
1
problem with plot.lm?
I'm bringing this issue to r-devel as my idea of sending it to r-help
appears to be wrong.
The following is reproducible in R-patched and R-devel (also in older
versions).
An outlier is inserted in group E and the last plot by plot.lm
suggests that the point belongs to D.
It appears to me that:
* (facval, rsp) and
* x$xlevels[[1L]][order(sapply(split(yh,mf[,1]), mean))]
are sorted
2009 Nov 28
1
Display list redraw incomplete
Hi,
I'm observing the following warning with R-2.10.0 on a machine I have remote access to. Like what happened to Roger ( http://www.mail-archive.com/r-devel at r-project.org/msg08669.html ), two extra instances of X11 are open after dev.off(). Although I'm reporting this on R-2.10.0, it's reproducible on R-devel r50541. Any thoughts about this?
Thanks a lot for any info,
b
>
2007 Jun 16
1
plot via xyplot not being saved
Hi everyone,
it's been a while I've been trying to save a plot created via
lattice:::xyplot
if I have a file tst.R with the following code:
y <- rnorm(100)
x <- rnorm(100)
z <- sample(letters[1:4], 100, rep=T)
library(lattice)
bitmap("tst.png")
xyplot(y~x|z)
dev.off()
and I source it, I get the tst.png file, which is a blank page.
If I copy and paste instead, I
2007 Jun 29
1
Comparison: glm() vs. bigglm()
Hi,
Until now, I thought that the results of glm() and bigglm() would
coincide. Probably a naive assumption?
Anyways, I've been using bigglm() on some datasets I have available.
One of the sets has >15M observations.
I have 3 continuous predictors (A, B, C) and a binary outcome (Y).
And tried the following:
m1 <- bigglm(Y~A+B+C, family=binomial(), data=dataset1, chunksize=10e6)
2006 Nov 14
2
Problem with file size
Hi everyone,
I have 2 environments (2 different R sessions) as described below:
Session 1:
Name of the environment: "CrlmmInfo"
Objects in the environment:
index1: logical index - length 238304
index2: logical index - length 238304
priors: list of 4 - (matrix 6x6, 2 vectors of length 6, vector of
length 2) - all num
params: list of 4:
centers [238304 x 3 x
2006 Nov 14
2
Problem with file size
Hi everyone,
I have 2 environments (2 different R sessions) as described below:
Session 1:
Name of the environment: "CrlmmInfo"
Objects in the environment:
index1: logical index - length 238304
index2: logical index - length 238304
priors: list of 4 - (matrix 6x6, 2 vectors of length 6, vector of
length 2) - all num
params: list of 4:
centers [238304 x 3 x
2013 Jan 29
0
Package parallel left orphan processes, how to clean-up?
Hi,
I've using package DEXSeq that implements functions with nCores for
speed-up. The functions work fine, but I found out that the children
processes were not terminated, they still hold memory, and new command
will start up new children processes. So if I don't manually kill those
orphan processes, they will cause problem. I was qlogin to SGE cluster
node to run R. From our
2010 Sep 04
1
non-zero exit status error when install GenomeGraphs
Hi,
I am trying to install GenomeGraphs package from bioconductor, but failed by
a non-zero exit error. From the error message, it seems that there is a
shared library problem. Any suggestion on fixing it? Thanks so much.
> sessionInfo()
R version 2.10.1 (2009-12-14)
x86_64-unknown-linux-gnu
locale:
[1] LC_CTYPE=en_US.iso885915 LC_NUMERIC=C
[3] LC_TIME=en_US.iso885915
2010 Jan 21
2
"stack imbalance in ..." when loading a workspace
Hi all,
I just failed in loading a saved wordspace (13MB of size), and received
these errors:
Warning: stack imbalance in 'missing', 52 then 51
Warning: stack imbalance in 'if', 50 then 53
Warning: stack imbalance in 'as.environment', 57 then 59
Warning: stack imbalance in 'ls', 54 then 53
Warning: stack imbalance in '.Internal', 54 then 53
Warning: stack
2004 May 13
1
accented characters in isolinux
hey people
I'm new to the list and would like to say thanks to everyone that has
worked on syslinux/isolinux. It's one of those tools that everyone uses
at some stage but no-one ever really takes much notice of it - mainly
because *it just works*. So congrats ...
Now onto my question - I am customizing Fedora Core and I want to change
the isolinux boot.msg screen to display some
2018 Apr 25
0
Samba 4 - ISO-8859-15 filenames not listed while browsing
Am Mittwoch, 25. April 2018, 15:31:50 CEST schrieb Ali SIMON via samba:
> Thanks Jeremy,
>
> i'm analyzing this with the application team, we'll see what we can
> find.
> > I was hoping to find a way for the samba4 server to behave like
> > samba3 (as in ignoring bad characters and replacing them with an
> > underscore character), which in the end resulted in
2008 Jan 23
3
Rsync 3.0.0pre8 and Mac OS X
Hi,
I tried Rsync 3.0.0pre8 on my mac running os X 10.5.
I was very pleased about the --iconv feature, as i have to sync some
LINUX-machines and I had really trouble with some filenames.
But I found one strange thing in connection with the mac.
First of all, the translation between the LINUX ISO-8859-15 and the
mac ut-8 works (nearly) perfect.
As I live in Germany, we have often filenames
2006 Aug 05
2
Frustrating locale setting error
Hi all,
This has been very frustrating for me trying to get this acts_as_ferret
working well on a Fedora box. On my mac it works great, no problems with
locale, but when I put the code live on my Fedora server, it complains
about the locale setting (Error occured at <analysis.c>:498 Error:
exception 2 not handled: Error decoding input string. Check that you
have the locale set
2013 Oct 03
1
Random Projection
Hello:
I was wondering, has anyone has encountered an R package that performs random projection/random mapping? RP is a procedure that is akin to Principal Components Analysis in that it accomplishes dimensionality reduction, but is far more computationally efficient. I have been searching for some time, but haven't seen anything on CRAN-r yet.
David Monaghan
Sociology Ph.D. Candidate,
2017 Jun 17
1
dist function in R is very slow
Dear R developers,
I am visualising high dimensional genomic data and for this purpose I need to compute pairwise distances between many points in a high-dimensional space (say I have a matrix of 5,000 rows and 20,000 columns, so the result is a 5,000x5,000 matrix or it's upper diagonal).Computing such thing in R takes many hours (I am doing this on a Linux server with more than 100 GB of RAM,
2004 Jul 26
1
Time out failure with mvfs on Linux
I have tried Samba 3.0.2a and 3.0.4. We use Active directory. The server
is running on RHEL3.
When I connect to the server on a share that is acutally an ext3 or NFS
file system, I have no known problems. We use ClearCase on Linux and I
am trying to access my workspace (view) as I have done many times before
on Solaris, but now we are running on Linux and with a newer version of
ClearCase
2004 Jun 04
0
CA Arcserve backups of Samba 3.0 unicode filenames?
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
(sorry about the resend forgot limits)
I've got CA Arcserve 9.0 working (sorta) by changing /etc/sysconfig/i18n
(Redhat 7.3 here) to:
LANG="en_US.utf8"
SUPPORTED="en_US.iso885915:en_US:en_US.utf8;en"
SYSFONT="lat0-sun16"
SYSFONTACM="iso15"
The issue I'm having is that a file named Bj?r???n (see
2008 Jul 15
8
DO NOT REPLY [Bug 5615] New: iconv conversion not applied to symlinks
https://bugzilla.samba.org/show_bug.cgi?id=5615
Summary: iconv conversion not applied to symlinks
Product: rsync
Version: 3.0.3
Platform: Other
OS/Version: SunOS
Status: NEW
Severity: normal
Priority: P3
Component: core
AssignedTo: wayned@samba.org
ReportedBy: nils.goroll@hamburg.de