search for: ndjson

Jeroen: Thank you for pointing me to ndjson, which I had not heard of and is exactly my case. My experience: jsonlite::stream_in - segfaults ndjson::stream_in - my fault, I am running Ubuntu 14.04 and it is too old so it won't compile the package corpus::read_ndjson - works!!! Of course it does a different simplification than...

...ds base other attached packages: [1] readr_1.1.1 loaded via a namespace (and not attached): [1] compiler_3.4.1 R6_2.2.2 hms_0.3 tools_3.4.1 tibble_1.3.3 Rcpp_0.12.12 rlang_0.1.2 On 03-09-17 20:50, Jennifer Lyon wrote: > Jeroen: > > Thank you for pointing me to ndjson, which I had not heard of and is > exactly my case. > > My experience: > jsonlite::stream_in - segfaults > ndjson::stream_in - my fault, I am running Ubuntu 14.04 and it is too old > so it won't compile the package > corpus::read_ndjson - works!!! Of course it does...

- ndjdon : Wicked Fast ndjson Reader Reads in ndjson significantly faster than jsonlite::stream_in(), flattens each JSON record and returns a data.table. https://cran.r-project.org/web/packages/ndjson/index.html - htmltidy : Clean Up or Pretty Print Gnarly HTML and XHTML C-backed package that includes the HTML Tidy...

- ndjdon : Wicked Fast ndjson Reader Reads in ndjson significantly faster than jsonlite::stream_in(), flattens each JSON record and returns a data.table. https://cran.r-project.org/web/packages/ndjson/index.html - htmltidy : Clean Up or Pretty Print Gnarly HTML and XHTML C-backed package that includes the HTML Tidy...

Hi: I have a 2.1GB JSON file. Typically I use readLines() and jsonlite:fromJSON() to extract data from a JSON file. When I try and read in this file using readLines() R segfaults. I believe the two salient issues with this file are 1). Its size 2). It is a single line (no line breaks) I can reproduce this issue as follows #Generate a big file with no line breaks # In R >