similar to: readLines without skipNul=TRUE causes crash

On 15/07/2017 7:35 AM, Anthony Damico wrote: > hello, the last line of the code below causes a segfault for me on 3.4.1. > i think i should submit to https://bugs.r-project.org/ unless others have > advice? thanks Segfaults are usually worth reporting as bugs. Try to come up with a self-contained example, not using the lodown and archive packages. I imagine you can do this by

hi, thanks Dr. Murdoch i'd appreciate if anyone on r-help could help me narrow this down? i believe the segfault occurs because there's a single line with 4GB and also embedded nuls, but i am not sure how to artificially construct that? the lodown package can be removed from my example.. it is just for file download cacheing, so `lodown::cachaca` can be replaced with `download.file`

hi, i realized that the segfault happens on the text file in a new R session. so, creating the segfault-generating text file requires a contributed package, but prompting the actual segfault does not -- pretty sure that means this is a base R bug? submitted here: https://bugs.r-project.org/bugzilla3/show_bug.cgi?id=17311 hopefully i am not doing something remarkably stupid. the text file

I am not able to reproduce this on a Linux platform: #######################3 fn1 <- "/home/jdnewmil/Downloads/Microdados ENEM 2009/Dados Enem 2009/DADOS_ENEM_2009.txt" sessionInfo() ## R version 3.4.1 (2017-06-30) ## Platform: x86_64-pc-linux-gnu (64-bit) ## Running under: Ubuntu 14.04.5 LTS ## ## Matrix products: default ## BLAS: /usr/lib/libblas/libblas.so.3.0 ## LAPACK:

hi, thank you for attempting this. it looks like your unix machine unzipped the txt file without corruption -- if you copied over the same txt file to windows 7, i don't think that would reproduce the problem? i think it needs to be the corrupted text file where R.utils::countLines( txtfile ) gives 809367. i am able to reproduce on two distinct windows machines but no guarantee i'm

I am not able to reproduce your segfault on a Windows 7 platform either: ########################## fn1 <- "d:/DADOS_ENEM_2009.txt" sessionInfo() ## R version 3.4.1 (2017-06-30) ## Platform: x86_64-w64-mingw32/x64 (64-bit) ## Running under: Windows 7 x64 (build 7601) Service Pack 1 ## ## Matrix products: default ## ## locale: ## [1] LC_COLLATE=English_United States.1252 ## [2]

hi, yep, there are two problems -- but i think only the segfault is within the scope of a base R issue? i need to look closer at the corrupted decompression and figure out whether i should talk to the brazilian government agency that creates that .rar file or open an issue with the archive package maintainer. my goal in this thread is only to figure out how to replicate the goofy text file so

So you are saying there are two problems... one that produces a corrupt file from a valid compressed file, and one that segfaults when presented with that corrupt file? Can you please confirm the file name and run md5sum on it and share the result so we can tell when the file problem has been reproduced? -- Sent from my phone. Please excuse my brevity. On July 16, 2017 3:21:21 AM PDT, Anthony

I see the problem on Windows 10, R-3.4.0, R.exe. It is not compiled for debugging but gdb gives some information when I attach the debugger after the 'R..has stopped working' popup appears. I don't know how reliable it is: (gdb) info threads Id Target Id Frame * 4 Thread 11848.0x1500 0x00007ffe38dc8861 in ntdll!DbgBreakPoint () from

I am stuck. The archive package won't compile for me on Ubuntu, and the CRANextra repo seems to be down so I cannot install packages on Windows right now. Perhaps you can zip the corrupt text file and put it online somewhere? Don't use the archive package to pack it since there seem to be issues with that tool on your machine. I would discourage you from harassing the Brazilian

The original file had a lot of trailing null bytes so I tried making a similar file with: tf <- tempfile(); file <- file(tf, "wb") for(i in 1:(2^15-1))writeBin(rep(as.raw(32:127), len=2^16), file) for(i in 1:(2^15-1))writeBin(rep(as.raw(0L), len=2^16), file) close(file) log2(file.size(tf)) #[1] 31.99996 Reading this with readLines() caused R-3.4.0 to segfault in Rf_con_pushback

hi, thanks again for taking the time. since corrupted compression prompted the segfault for me in the first place, i've just posted the text file as-is. it's a 2.4GB file so to be avoided on a metered internet connection. i've updated the bugzilla report at https://bugs.r-project.org/bugzilla3/show_bug.cgi?id=17311 with more relevant info. these lines of code crash both windows R

Hello, I am getting error :- #<CSV::MalformedCSVError: Unclosed quoted field on line 1892.>. I have following code :- -------------------------------------------------- @parsed_file = CSV.open("#{RAILS_ROOT}/private/sales_report_files/#{@file_folder}/#{@sub_file_folder}/#{@file_name.filename}",''r'',:col_sep =>?\t) @parsed_file.each_with_index do |row, index|

thank you for taking the time to write this. i set it running last night and it's still going -- if it doesn't finish by tomorrow, i will try to find a site to host the problem file and add that link to the bug report so the archive package can be avoided at least. i'm sorry for the bother On Sat, Jul 15, 2017 at 4:14 PM, Duncan Murdoch <murdoch.duncan at gmail.com> wrote:

hi, the text file that prompts the segfault is 4gb but only 80,937 lines > file.info( "S:/temp/crash.txt") size isdir mode mtime ctime atime exe S:/temp/crash.txt 4078192743 FALSE 666 2017-07-15 17:24:35 2017-07-15 17:19:47 2017-07-15 17:19:47 no On Sun, Jul 16, 2017 at 6:34 AM, Duncan Murdoch <murdoch.duncan at

On 15/07/2017 11:33 AM, Anthony Damico wrote: > hi, i realized that the segfault happens on the text file in a new R > session. so, creating the segfault-generating text file requires a > contributed package, but prompting the actual segfault does not -- > pretty sure that means this is a base R bug? submitted here: > https://bugs.r-project.org/bugzilla3/show_bug.cgi?id=17311

On 16/07/2017 6:17 AM, Anthony Damico wrote: > thank you for taking the time to write this. i set it running last > night and it's still going -- if it doesn't finish by tomorrow, i will > try to find a site to host the problem file and add that link to the bug > report so the archive package can be avoided at least. i'm sorry for > the bother > How big is that

hi there, I have to create a new server.xml which should be build from at least 3 or 4 another xml files. How could to copy and paste with puppet methods ? On a command line under Unix I would do cat 1.xml > my_file.xml ; cat 2.xml >> my_file.xml; cat 3.xml >> my_file.xml. I have to say, I''m pretty new to puppet and simply have no clue how to tackle this task ;=(

I am trying to use sed to change a value in a pipe. ------------------- This is the two line script CHANGE="1234" cat my_file.txt | sed 's/CANCELID/$CHANGE/' > cancel.txt ------------------- and the my_file.txt has: <v1:notificationId>CANCELID</v1:notificationId> it gets changed to $CHANGE instead of the actual value 1234 . I tried putting a \ in front

Dear all! I wrote my R-code with an editor and loaded it with source("my_file.R"). Everything works fine as expected. When I try to start my code with: R --no-save < my_file.R I do get a synatx error half way through. The version is 1.9.0 on a Linux system. To start it with R --no-save < my_file.R works on some machines but on some it doesn't. Are there any rules