similar to: GLM / large dataset question

Hi I have a question, as im not able to import a csv file which contains a big dataset(100.000 records) someone knows how many records R can handle without giving problems? What im facing when i try to import the file is that R generates more than 100.000 records and is very slow... thanks a lot!!!

Hi R-experts, Does anyone have experience using R for handling large scale data (millions of rows, hundreds or thousands of features)? What is the largest size of data that anyone has used with glm? Also, is there a library to read data in sparse data format (like SVMlight format)? Thanks Pradheep [[alternative HTML version deleted]]

Dear all, For an introductory course on glm?s I would like to create an example to show the difference between glm and transformation of the response. For this, I tried to create a dataset where the variance increases with the mean (as is the case in many ecological datasets): poissondata=data.frame( response=rpois(40,1:40), explanatory=1:40) attach(poissondata) However, I have run into

This is with 64k page size. Ilia Mirkin schreef op 2020-06-22 19:27: > I suspect screen tearing (as it's usually defined) is to be expected. > Can you take a photo of what you're seeing, since I'm suspecting it's > more than regular screen tearing? > > On Mon, Jun 22, 2020 at 12:08 PM Jeroen Diederen > <jjhdiederen at zonnet.nl> wrote: >>

Hi Ilia, I experience screen tearing for both 64k and 4k page size. My iMac G5 has an nVidia Geforce FX 5200 Ultra GPU. Regards, Jeroen Ilia Mirkin schreef op 2020-06-22 17:25: > Which GPU do you have? The NV40 AGP board (GeForce 6800) works > particularly poorly. However as long as you go with 4k pages (and > there's no real benefit to 64k pages for most applications), basic

Hello everyone, I have a problem with smbmount. After I mount a certain share, I can not view files with weird charaters in their name. This happends for example with the copyright char. After searching with Google I still didn't find an answer. I guess it has something to do with a 'charset' command, but I can't figure out wich one, and what character table I should use...

Hello all, I have a question concerning how to get the P-value for a explanatory variables based on GLM. I'll run multiple regressions with GLM, and I'll need the P-value for the same explanatory variable from these multiple GLM results. I check the help and there are quite a few Value options but I just can not find anyone about the p-value. Could anyone help me with that?

Hello, I am wondering if there is an easy way to combine loess() with glm() to produce a locally fitted generalised regression. I have a data set of about 5,000 observations and 5 explanatory variables, with a binary outcome. One of the explanatory variables (lets call it X) is much more predictive than the others. A single glm() regression over the entire data set produces rather poor results,

I am working with a dataset where there are 5 possible outcomes (coded 1:5), I would like to create 5 categorical variables (event1...event5). I am using a for loop an if statements, but I have a large dataset( approx 100,000 rows) it takes quite a bit of time, is there a way to speed this up? Here is some sample code of what I am currently doing. test2 <-rep(seq(1:5),2000) event1 <-

We're currently working for project OpenElec on a syslinux menu. We would like to know if it's possible to move the menu position to the middle/bottom instead of the top... Currently we simply use the Vesamenu as it doesn't require much more functionality. I saw a post regarding the option MENU STARTROW, but that doesn't seem to work (anymore?). Any suggestions are welcome.

Hi, I am trying to use glm to fit my data, wondering if there is a easy way to fit a glm without typing all the explanatory variable names. For example, if I have 100 explanatory variables x1, x2, ..., x100 and response variable is y, I don't want to do something like glm1 <- glm(y ~ x1 + x2 + ... + x100, family = gaussian, data = dataA) since it would be a lot of typing. Many thanks,

Hello all, I've been having trouble with assessing a breakpoint in a logistic GLM with two explanatory variables. For this analysis I've been using the 'segmented' package version 0.2-9.1. But I keep getting an error and I don't see where I would be going awry. The situation is the following: Two explanatory variables: bedekking - a variable with possible values between 0 and

Hi, I have some data on the effect of cycle shape (categorical) and frequency (continuous) on the efficiency of muscle contraction. My minimum adequate model is: m15<-glm(efficiency~cycle.shape*freq, family=quasipoisson) However, I wish to know where significant differences lie between specific combinations of treatments. I guess I want an equivalent of a post hoc test following an

Dear R-list. I'm doing af logistic analyses using gml. The model explaines variations in Adverse events infections (0 og 1) using age as explanatory variable. model2d<-glm(formula=AEorSAEInfecBac~Age,family=binomial("logit"),data=emrisk) I want to get predictions with 95% confidence limits for age 30 and age 60. I've been reading the "google" and "search

Hi Let's say i wanted to exclude 100.000 files by naming them one by one in a file to be used by --exclude-from. Can rsync cope with that without bigger problems? I'm currently thinking about how i could make backing up by computer more efficient and if i exclude every single file that i can reproduce an other way, the amount of files i need to back up would be reduced by a large

Hi all R users I did a logistic regression with my binary variable Y (0/1) and 2 explanatory variables. Now I try to draw my nomogram with predictive value. I visited the help of R but I have problem to understand well the example. When I use glm fonction, I have a problem, thus I use lrm. My code is: modele<-lrm(Y~L+P,data=donnee) fun<- function(x) plogis(x-modele$coef[1]+modele$coef[2])

Dear all, I have a large dataset (N=100,000 with 89 variables per subject). This dataset is stored in a 100.000 x 89 matrix where each row describes one individual and each column one variable. What is the easiest way of selecting a subset of let's say 1.000 individuals out of that whole matrix? Thanks, Michael Michael Haenlein Associate Professor of Marketing ESCP-EAP European School of

Hello to everyone. I´m writing you because I´m feeling a bit frustrated with my work. My work consists in finding the relation between the amount of fires and the weather, so, my response variable is the amount of fires in a fire season and the explanatory variables are the temperature, the amount of precipitation and the some others…. my problem is this; I keep getting the wrong sign in the

Hi all, Could somebody be so kind to explain to me what is the saturated model on which deviance and degrees of freedom are calculated when fitting a binomial glm? Everything makes sense if I fit the model using as response a vector of proportions or a two-column matrix. But when the response is a factor and counts are specified via the "weights" argument, I am kind of lost as far as

Hi all, I have been trying to solve nouveau issues on my iMac G5 for ages. As far as I can understand it, there is a problem with nouveau and page size mapping. I tried both 64K and 4K page size kernels and the the result is always distorted video. There is an old To-Do list, which says "fix the page size mapping problem on G5/64 bit for exposing fifo regs" on