search for: mcapply

Dear all, I have about 50 pages of R codes and ran it in both OS X and Windows. It takes at least haft a day to have the results. The running time is not very different in both Systems. I found that R does not use all cores of CPU by default. Can anybody help me to use all cores of CPU in my programming from the beginning or through programming in both OS X and Windows? Many thanks your

Hi, I have an R script which is time consuming because it has two nested loops in it of at least 5000 iterations each, I have tried to use the multicore package but id doesn't seem to improve the elapsed time of the script(a shorter script for example) and I can't use the mcapply because of technical reasons. I was wondering how can I make my script use more cores and memory because I am running it on a server and it is a shame that it uses only one core. Thanks! Moriah -- View this message in context: http://r.789695.n4.nabble.com/Using-multicores-in-R-tp4651808.ht...

Hi, I have an R script which is time consuming because it has two nested loops in it of at least 5000 iterations each, I have tried to use the multicore package but id doesn't seem to improve the elapsed time of the script(a shorter script for example) and I can't use the mcapply because of technical reasons. I was wondering how can I make my script use more cores and memory because I am running it on a server and it is a shame that it uses only one core. Thanks! Moriah -- View this message in context: http://r.789695.n4.nabble.com/Using-multicores-in-R-tp4651808.ht...

...t reached?) ________________________________ From: Gregg Powell <g.a.powell at protonmail.com> Sent: Tuesday, December 10, 2024 7:52 PM To: Deramus, Thomas Patrick <tderamus at mgb.org> Cc: r-help at r-project.org <r-help at r-project.org> Subject: Re: [R] Cores hang when calling mcapply Hello Thomas, Consider that the primary bottleneck may be tied to memory usage and the complexity of pivoting extremely large datasets into wide formats with tens of thousands of unique values per column. Extremely large expansions of columns inherently stress both memory and CPU, and splitting i...

...0.0000 ________________________________ From: Gregg Powell <g.a.powell at protonmail.com> Sent: Wednesday, December 11, 2024 11:41 AM To: Deramus, Thomas Patrick <tderamus at mgb.org> Cc: r-help at r-project.org <r-help at r-project.org> Subject: Re: [R] Cores hang when calling mcapply Thomas, I'm curious - what OS are you running this on, and how much memory does the computer have? Let me know if that code worked out as I hoped. regards, gregg On Wednesday, December 11th, 2024 at 6:51 AM, Deramus, Thomas Patrick <tderamus at mgb.org> wrote: About to try this implem...

...> > > > From: Gregg Powell <g.a.powell at protonmail.com> > Sent: Tuesday, December 10, 2024 7:52 PM > To: Deramus, Thomas Patrick <tderamus at mgb.org> > Cc: r-help at r-project.org <r-help at r-project.org> > Subject: Re: [R] Cores hang when calling mcapply > > Hello Thomas, > > Consider that the primary bottleneck may be tied to memory usage and the complexity of pivoting extremely large datasets into wide formats with tens of thousands of unique values per column. Extremely large expansions of columns inherently stress both memory an...

Hello Thomas, Consider that the primary bottleneck may be tied to memory usage and the complexity of pivoting extremely large datasets into wide formats with tens of thousands of unique values per column. Extremely large expansions of columns inherently stress both memory and CPU, and splitting into 110k separate data frames before pivoting and combining them again is likely causing resource

...; > > > From: Gregg Powell <g.a.powell at protonmail.com> > Sent: Wednesday, December 11, 2024 11:41 AM > To: Deramus, Thomas Patrick <tderamus at mgb.org> > Cc: r-help at r-project.org <r-help at r-project.org> > Subject: Re: [R] Cores hang when calling mcapply > > Thomas, > I'm curious - what OS are you running this on, and how much memory does the computer have?? > > Let me know if that code worked out as I hoped. > > regards, > gregg > > > On Wednesday, December 11th, 2024 at 6:51 AM, Deramus, Thomas Patri...

...DeRamus ________________________________ From: Gregg Powell <g.a.powell at protonmail.com> Sent: Wednesday, December 11, 2024 2:11 PM To: Deramus, Thomas Patrick <tderamus at mgb.org> Cc: r-help at r-project.org <r-help at r-project.org> Subject: Re: [R] Cores hang when calling mcapply How is the server configured to handle memory distribution for individual users. I see it has over 700GB of total system memory, but how much can be assigned it each individual user? AAgain - just curious, and wondering how much memory was assigned to your instance when you were running R. regar...

...t; > > > From:?Gregg Powell <g.a.powell at protonmail.com> > Sent:?Wednesday, December 11, 2024 2:11 PM > To:?Deramus, Thomas Patrick <tderamus at mgb.org> > Cc:?r-help at r-project.org <r-help at r-project.org> > Subject:?Re: [R] Cores hang when calling mcapply > > How is the server configured to handle memory distribution for individual users. I see it has over 700GB of total system memory, but how much can be assigned it each individual user? > > AAgain - just curious, and wondering how much memory was assigned to your instance when you...

No es un problema de tm ni de SnowfallC ni de mcapply (por el path utilizas linux, en windows mcapply según el manual no va bien) No defines bien los objetos que pasas. Pasas doc.corpus en lugar de corpus ( o asignas a corpus en lugar de a doc.corpus) . Depura los programas cuando salga un error de objeto, como te pone en el Error que pasas . Te...

...error al limpiar el codigo) y sigue el error. > No sé, he probado buscando en webs códigos similares y sigue el > error:( > > > El 17 de junio de 2014, 19:53, Ricardo Alberich <r.alberich en uib.es> > escribió: > > > No es un problema de tm ni de SnowfallC ni de mcapply (por el path > > utilizas linux, en windows mcapply según el manual no va bien) > > > > No defines bien los objetos que pasas. Pasas doc.corpus en lugar de > > corpus ( o asignas a corpus en lugar de a doc.corpus) . > > Depura los programas cuando salga un error de o...

Hi R users. Apologies for the lack of concrete examples because the dataset is large, and it being so I believe is the issue. I multiple, very large datasets for which I need to generate 0/1 absence/presence columns Some include over 200M rows, with two columns that need presence/absence columns based on the strings contained within them, as an example, one set has ~29k unique values and the

...a system with 16 cores). There is mclapply (parralel version of lapply) . If I make run my code run with lapply then I will be able to run it with mclapply also (they have same syntax). If I understand it correct the sequence for doing that is to understand the following: for..loop->lapply->mcapply Can you please help me understand if my for loop can be converted to lapply or not? Regards Alex

...ado buscando en webs códigos similares y sigue el > > > error:( > > > > > > > > > El 17 de junio de 2014, 19:53, Ricardo Alberich <r.alberich@uib.es> > > > escribió: > > > > > > > No es un problema de tm ni de SnowfallC ni de mcapply (por el path > > > > utilizas linux, en windows mcapply según el manual no va bien) > > > > > > > > No defines bien los objetos que pasas. Pasas doc.corpus en lugar > > de > > > > corpus ( o asignas a corpus en lugar de a doc.corpus) . > &g...

...d-replace these eight functions "seamlessly and transparently"? Benchmarks: I wonder what the typical speedup for these functions are in mainstream systems---say a $300 CPU vs. a $200 GPU. if it is a factor of 20, it is well worth it *for me*. if it is a factor of 5, I may as well use mcapply for most of *my* problems (which can be split nicely across a quad-core CPU). is there still an overhead cost for switching between CPU and GPU calculations? I think modern GPUs have unified memory space, so the data copy problem is hopefully long gone. /iaw ---- Ivo Welch (ivo.welch@gmail.com)...

Hi all, I am trying to implement a Monte-Carlo simulation for each cell in a spatial matrix (using mcd2 package) . I have figured out how to conduct the simulation using data from a single location (where I manually input distribution parameters into the R code), but am having trouble (a) adjusting the code to pull input variables from my various data sets and then (b) applying the entire