search for: deramus

Displaying 11 results from an estimated 11 matches for "deramus".

2024 Dec 12
1
Cores hang when calling mcapply
...re working with and the complexity of the initial cleaning. Anyway, happy the suggestion moved you closer to the results you were looking for. I don't often respond on r-help often, mostly just a lurker. All the best, gregg Sierra Vista, Arizona On Thursday, December 12th, 2024 at 8:54 AM, Deramus, Thomas Patrick <tderamus at mgb.org> wrote: > Hi Gregg. > > Just wanted to follow up on the solution you proposed. > > I had to make some adjustments to get exactly what I wanted, but it works, and takes about 15 minutes on our server configuration: > > ? ? temp &...
2024 Dec 12
1
Cores hang when calling mcapply
...a.table in the future * The initial approach was replacing all the KeyID variables with what was basically row numbers and that would have made merging back to the main key document an issue so I changed the rbind funciton to keep this from happening. Thank you for all your help on this! -Thomas DeRamus ________________________________ From: Gregg Powell <g.a.powell at protonmail.com> Sent: Wednesday, December 11, 2024 2:11 PM To: Deramus, Thomas Patrick <tderamus at mgb.org> Cc: r-help at r-project.org <r-help at r-project.org> Subject: Re: [R] Cores hang when calling mcapply...
2024 Dec 11
1
Cores hang when calling mcapply
...n for individual users. I see it has over 700GB of total system memory, but how much can be assigned it each individual user? AAgain - just curious, and wondering how much memory was assigned to your instance when you were running R. regards, Gregg On Wednesday, December 11th, 2024 at 9:49 AM, Deramus, Thomas Patrick <tderamus at mgb.org> wrote: > It's Redhat Enterprise Linux 9 > > Specifically: > OS Information: > NAME="Red Hat Enterprise Linux" > VERSION="9.3 (Plow)" > ID="rhel" > ID_LIKE="fedora" > VERSION_ID=&quo...
2023 Mar 27
1
Displaying Dichotomous Variables as fractions in gtsummary Tables
I think questions about gtsummary are better addressed to that project. They have a link "Getting Help" on their web page; I'd start there: https://www.danieldsjoberg.com/gtsummary/SUPPORT.html Duncan Murdoch On 27/03/2023 2:19 p.m., Deramus, Thomas Patrick wrote: > Hi R Experts. > > Apologies if this has been shared elsewhere, but I haven't been able to find a solid answer to this. > > I'm wanting to create a table in gtsummary that displays entries for "Yes" and "No" as fractions rather th...
2024 Dec 11
1
Cores hang when calling mcapply
...t: 20 Socket(s): 4 Stepping: 4 CPU(s) scaling MHz: 50% CPU max MHz: 3700.0000 CPU min MHz: 1000.0000 ________________________________ From: Gregg Powell <g.a.powell at protonmail.com> Sent: Wednesday, December 11, 2024 11:41 AM To: Deramus, Thomas Patrick <tderamus at mgb.org> Cc: r-help at r-project.org <r-help at r-project.org> Subject: Re: [R] Cores hang when calling mcapply Thomas, I'm curious - what OS are you running this on, and how much memory does the computer have? Let me know if that code worked out as I...
2024 Dec 11
1
Cores hang when calling mcapply
Thomas, I'm curious - what OS are you running this on, and how much memory does the computer have?? Let me know if that code worked out as I hoped. regards, gregg On Wednesday, December 11th, 2024 at 6:51 AM, Deramus, Thomas Patrick <tderamus at mgb.org> wrote: > About to try this implementation. > > As a follow-up, this is the exact error: > > Lost warning messages > Error: no more error handlers available (recursive errors?); invoking 'abort' restart > Execution halted...
2024 Dec 11
1
Cores hang when calling mcapply
...exhausted (limit reached?) Error: cons memory exhausted (limit reached?) Error: cons memory exhausted (limit reached?) Error: cons memory exhausted (limit reached?) ________________________________ From: Gregg Powell <g.a.powell at protonmail.com> Sent: Tuesday, December 10, 2024 7:52 PM To: Deramus, Thomas Patrick <tderamus at mgb.org> Cc: r-help at r-project.org <r-help at r-project.org> Subject: Re: [R] Cores hang when calling mcapply Hello Thomas, Consider that the primary bottleneck may be tied to memory usage and the complexity of pivoting extremely large datasets into wide...
2023 Mar 27
1
Displaying Dichotomous Variables as fractions in gtsummary Tables
Hi R Experts. Apologies if this has been shared elsewhere, but I haven't been able to find a solid answer to this. I'm wanting to create a table in gtsummary that displays entries for "Yes" and "No" as fractions rather than a relative to the total (e.g. {n} / {N} in the documentation). I realize I can split them into rows with something like: type = all_dichotomous()
2024 Apr 18
1
Tidyverse/dplyr solution for filling values of a tibble/dataframe from a column with a nested list.
Hi experts. I have a tibble? with a column containing a nested list (<list<list<double>>>? data type to be specific). Looks something like the following (but in R/Arrow? format): ID Nestedvals 001 [[1]](1,0.1)[[2]](2,0.2)[[3]](3,0.3)[[4]](4,0.4)[[5]](5,0.5) 002 [[1]](1,0.1)[[2]](2,0.2)[[3]](3,0.3)[[4]](4,0.4) 003 [[1]](1,0.1)[[2]](2,0.2)[[3]](3,0.3) 004 [[1]](1,0.1)[[2]](2,0.2)
2024 Dec 11
1
Cores hang when calling mcapply
Hello Thomas, Consider that the primary bottleneck may be tied to memory usage and the complexity of pivoting extremely large datasets into wide formats with tens of thousands of unique values per column. Extremely large expansions of columns inherently stress both memory and CPU, and splitting into 110k separate data frames before pivoting and combining them again is likely causing resource
2024 Dec 11
2
Cores hang when calling mcapply
Hi R users. Apologies for the lack of concrete examples because the dataset is large, and it being so I believe is the issue. I multiple, very large datasets for which I need to generate 0/1 absence/presence columns Some include over 200M rows, with two columns that need presence/absence columns based on the strings contained within them, as an example, one set has ~29k unique values and the