similar to: Read big data (>3G ) methods ?

Displaying 20 results from an estimated 6000 matches similar to: "Read big data (>3G ) methods ?"

2012 Sep 26
3
[PATCH v3] xen/tools: Add 64 bits big bar support
Currently it is assumed PCI device BAR access < 4G memory. If there is such a device whose BAR size is larger than 4G, it must access > 4G memory address. This patch enable the 64bits big BAR support on hvmloader. v3 changes from v2: - Remain original print information v2 changes from v1 as comments by Jan. 1) Set Dynamic MMIO high memory address instead of a fixed number 640G 2) Mask
2009 Jul 14
2
How to import BIG csv files with separate "map"?
Hi all, I am having problems importing a VERY large dataset in R. I have looked into the package ff, and that seems to suit me, but also, from all the examples I have seen, it either requires a manual creation of the database, or it needs a read.table kind of step. Being a survey kind of data the file is big (like 20,000 times 50,000 for a total of about 1.2Gb in plain text) the memory I have
2010 Sep 08
2
big data
Hello, I searched the internet but i didn't find the answer for the next problem: I want to do a glm on a csv file consisting of 25 columns and 4 mln rows. Not all the columns are relevant. My problem is to read the data into R. Manipulate the data and then do a glm. I've tried with: dd<-scan("myfile.csv",colClasses=classes) dat<-as.data.frame(dd) My question is: what
2013 Mar 04
56
GPU passthrough issue when VM is configured with 4G memory
Hi,all I have tried to passthrough GPU card(Nvidia quadro 4000) on the latest Xen unstable version (QEMU is using Qemu-upsteam-unstable, not traditional Qemu). This issue as below: Windows7 64-bit guest will blue screen when GPU passthrough configure 4g memory,blue screen code is 50, and SUSE 11 64-bit guest will always stay at the grub screen. I noticed that it will relocate RAM that
2007 Jul 08
2
how to revert to an older limma version?
Dear Sirs, How can I revert to an older limma version? Typing "install.packages("limma")" in R gives a list of mirrors. How can I install the version I want after I obtain and untar the file (e.g, limma_2.9.1.tar.gz)? I am running R 2.5.0 on a Linux machine (CentOS 5). When using limma it will not go past the read.maimages command. I get this error: Error in
2017 Apr 18
3
Crash after (wrongly) applying product operator on object from LIMMA package
Hi, this is a problem that occurs in the presence of two libraries (limma, xlsx) and leads to a crash of R. The problematic code is the wrong application of sweep or the product ("*") function on an LIMMA MAList object. To my knowledge, limma does not define a "*" method for MAList objects. If only LIMMA is loaded but not package xlsx, the code does not crash but rather
2017 Apr 19
2
Crash after (wrongly) applying product operator on S4 object that derives from list
Dear Hilmar Perhaps this gives an indication of why the infinite recursion happens: ## after calling `*` on ma and a matrix: > showMethods(classes=class(ma), includeDefs=TRUE, inherited = TRUE) Function: * (package base) e1="FOOCLASS", e2="matrix" (inherited from: e1="vector", e2="structure") (definition from function "Ops")
2012 May 14
7
[PATCH v3] Fix the mistake of exception execution
Fix the mistake for debug exception(#DB), overflow exception(#OF; generated by INTO) and int 3(#BP) instruction emulation. For INTn (CD ib), it should use type 4 (software interrupt). For INT3 (CC; NOT CD ib with ib=3) and INTO (CE; NOT CD ib with ib=4), it should use type 6 (software exception). For other exceptions (#DE, #DB, #BR, #UD, #NM, #TS, #NP, #SS, #GP, #PF, #MF, #AC, #MC, and #XM), it
2017 Apr 24
2
Crash after (wrongly) applying product operator on object from LIMMA package
Hi Hilmar, weird. The memory problem seems be due to recursion (my R, version 3.3.3, says: Error: evaluation nested too deeply: infinite recursion / options(expressions=)?, just write traceback() to see how it happens), but why does it segfault with xlsx? Nb xlsx is the culprit: neither rJava nor xlsxjars cause the problem. On the other hand, quick googling for r+xlsx+segfault returns tons of
2010 Apr 12
2
[LLVMdev] Why function pointer is different from other data type?
I'm sorry that I should remove the comment. In fact my question is about the "float (i32)* (float (i32)*)*", why we use this kind of return type instead of just "float (i32)*". Thanks a lot. Hao On Mon, Apr 12, 2010 at 5:42 PM, Duncan Sands <baldrick at free.fr> wrote: > Hi Hao Shen, > >> %4 = call float (i32)* (float (i32)*)* @get_ptr(float (i32)* @a1)
2008 May 30
3
loess plot
I was trying to plot some data in R. I used the following code to draw a loess fit and got the output as >?lines(lowess(log(abs(t(res))), log(abs(t(synthesised)))), col="red") Error in lowess(log(abs(t(res))), log(abs(t(synthesised)))) :?? NA/NaN/Inf in foreign function call (arg 1) Then I thought to use your Limma package for background correction. Do you think it's a right
2006 Jan 12
4
Loading Excel file into Limma
Dear mailing group, This is my first time here. Glad to have this resource! I am currently trying to load an Excel file into R (limma package loaded) using the source(*name of directory*) command, but it cannot open the file. I renamed the file as .R and .RData, to no avail. The Excel data contains one gene name per row and about 100 data points per gene (columns). I am only used to
2010 Apr 12
0
[LLVMdev] Why function pointer is different from other data type?
"float (i32)* (float (i32)*)*" is not a return type. According to the description of the 'call' instruction in LLVM Assembly Language Reference Manual (http://llvm.org/docs/LangRef.html#i_call) this is a signature of the pointer to function value being invoked (which includes the return type). In your case the full signature is printed because get_ptr returns a pointer to
2009 Nov 12
2
html help in Windows
Hi all, Another comment re: html help in Windows. It seems that we've lost the functionality of being able to browse the other functions in a package. In chm, after calling a help function on 'arrayw' in say package 'limma' in BioC, it was possible to see all of the other functions in the limma package. Now it seems we just get a flat html page with no links to the overall
2012 May 30
12
[PATCH v2 0/4] XEN: fix vmx exception mistake
Changes from v1: - Define new struct hvm_trap to represent information of trap, include instruction length. - Renames hvm_inject_exception to hvm_inject_trap. Then define a couple of wrappers around that function for existing callers, so that their parameter lists actually *shrink*. This series of patches fix the mistake for debug exception(#DB), overflow exception(#OF) and INT3(#BP),
2012 May 24
11
[PATCH 0/3] XEN: fix vmx exception mistake
This series of patches fix the mistake for debug exception(#DB), overflow exception(#OF) and INT3(#BP), INTn instruction emulation. Introduce new function vmx_inject_sw_exception() which deliver the software excetion, software interrupt and privileged software exception. Split hardware exception as a seperate function(old function vmx_inject_hw_exception()). Also Passed down intruction length
2011 Dec 02
6
[PATCH] tools/firmware: remove "_PS0/3" Method
tools/firmware: remove "_PS0/3" Method Do not expose the ACPI power management "_PS0/3" Method to guest firmware. According to section 3.4 of the APCI specification 4.0, PCI device control the device power through its own specification but not through APCI. Qemu pushes "_PS0/3" to guest will cause a mess between ACPI PM and PCI PM as a result of incorrect ACPI table
2007 Feb 28
2
topTable function from LIMMA
Dear R-Help, I am using the function "topTable" from the LIMMA package. To estimate adjusted P-values there are several options (adjust="fdr" , adjust="BH") as shown below: topTable(fit, number = 10, adjust = "BH", fit$Name) I guess any of these options (fdr, BH, etc.) is using a default of FDR=0.05 which is quite conservative (i.e., very
2010 Apr 12
5
[LLVMdev] Why function pointer is different from other data type?
Dear all, I compiled c program with llvm and found something strange with function pointer as following small example . ------------- In C Code -------------- float a (int value) { return value + 1; }; typedef float (*funcptr_t) (int); funcptr_t get_ptr(funcptr_t p) { return p; } float result = get_ptr(a)(4); ------------- In LLVM Code -------------- %4 = call float (i32)* (float
2002 Sep 18
5
newbie question: p.values in a column
Hello, I have a vector (v) with 6 columns and 2000 rows. I am trying to do one sample t.test for each row (I know this sounds crazy) and put the p.values into the 7th column. I know I can access the p.value via t.test(v[i,])[3]$p.value; I know I can do t.test on the row by apply(v, 1, t.test), but I just couldn't figure out how to fit them together. I'd very appreciate your help!!