Displaying 1 result from an estimated 1 matches for "file1_cor".
2005 Jun 10
0
Top N correlations from 'cor' for very large datasets being run many times
...ions quickly but only store the best results?
Any help would be greatly appreciated. Obi
#The nice R way to get all possible correlations quickly - too much memory used
file1 = read.table("test.txt", header=F, quote="", sep="\t", comment.char="", as.is=1)
file1_cor = cor(t(file1), method = "pearson", use = "pairwise.complete.obs")
diag(file1_cor) = NA #Set correlation to self as NA
for (i in 1:15000){
corrs=file1_cor[,i]
corrs_ordered=order(corrs,decreasing=TRUE) #Order correlations from largest to smallest
top_corrs=corrs[corrs_ord...