similar to: Malformed CSV Error

I am getting unacceptable performace problems by using the roo gem for reading a file by using XLSX or XLS library from this gem. Someone may suggest me an alternative about how to parse an .XLSX file? <code> parsed_file = Excel.new(filename,false, :ignore) if (file_format.upcase == "XLS") parsed_file = Excelx.new(filename,false, :ignore) if (file_format.upcase ==

Hi everyone, I am putting together an application in which each part of it was tested individually. Now that it is put together, I''m having problems... The one giving me problems is my "ImportController" which parses a CSV during post and puts it into my database. I have two separate CSV upload actions (one is for a bill called "bes" and the other from the provider

I''m deploying an app (using Capistrano) to a staging server prior to final deployment. The app runs fine in dev, but in staging it throws a syntax error. How can that be? The error is: /Library/Ruby/Site/1.8/rubygems/custom_require.rb:31:in `gem_original_require'': /Library/WebServer/staging.givetothem.co.uk/releases/20091023133654/app/controllers/bulkimport_controller.rb:32:

Hello all, I''m trying to import some csv data (that has latin characters) using faster csv but I keep getting a MalformedCSVError: "Unclosed quoted field on line 1." "/ruby/lib/ruby/gems/1.8/gems/fastercsv-1.2.3/lib/faster_csv.rb:1592:in `shift''" I''ve tested the same code outside of the Rails application an it works fine. Can anyone help me? Here is

hello, the last line of the code below causes a segfault for me on 3.4.1. i think i should submit to https://bugs.r-project.org/ unless others have advice? thanks install.packages( "devtools" ) devtools::install_github("ajdamico/lodown") devtools::install_github("jimhester/archive") file_folder <- file.path( tempdir() , "file_folder" ) tf <-

hi, thanks Dr. Murdoch i'd appreciate if anyone on r-help could help me narrow this down? i believe the segfault occurs because there's a single line with 4GB and also embedded nuls, but i am not sure how to artificially construct that? the lodown package can be removed from my example.. it is just for file download cacheing, so `lodown::cachaca` can be replaced with `download.file`

On 15/07/2017 7:35 AM, Anthony Damico wrote: > hello, the last line of the code below causes a segfault for me on 3.4.1. > i think i should submit to https://bugs.r-project.org/ unless others have > advice? thanks Segfaults are usually worth reporting as bugs. Try to come up with a self-contained example, not using the lodown and archive packages. I imagine you can do this by

hi, i realized that the segfault happens on the text file in a new R session. so, creating the segfault-generating text file requires a contributed package, but prompting the actual segfault does not -- pretty sure that means this is a base R bug? submitted here: https://bugs.r-project.org/bugzilla3/show_bug.cgi?id=17311 hopefully i am not doing something remarkably stupid. the text file

hi, thank you for attempting this. it looks like your unix machine unzipped the txt file without corruption -- if you copied over the same txt file to windows 7, i don't think that would reproduce the problem? i think it needs to be the corrupted text file where R.utils::countLines( txtfile ) gives 809367. i am able to reproduce on two distinct windows machines but no guarantee i'm

I am not able to reproduce this on a Linux platform: #######################3 fn1 <- "/home/jdnewmil/Downloads/Microdados ENEM 2009/Dados Enem 2009/DADOS_ENEM_2009.txt" sessionInfo() ## R version 3.4.1 (2017-06-30) ## Platform: x86_64-pc-linux-gnu (64-bit) ## Running under: Ubuntu 14.04.5 LTS ## ## Matrix products: default ## BLAS: /usr/lib/libblas/libblas.so.3.0 ## LAPACK:

I am not able to reproduce your segfault on a Windows 7 platform either: ########################## fn1 <- "d:/DADOS_ENEM_2009.txt" sessionInfo() ## R version 3.4.1 (2017-06-30) ## Platform: x86_64-w64-mingw32/x64 (64-bit) ## Running under: Windows 7 x64 (build 7601) Service Pack 1 ## ## Matrix products: default ## ## locale: ## [1] LC_COLLATE=English_United States.1252 ## [2]

hi, yep, there are two problems -- but i think only the segfault is within the scope of a base R issue? i need to look closer at the corrupted decompression and figure out whether i should talk to the brazilian government agency that creates that .rar file or open an issue with the archive package maintainer. my goal in this thread is only to figure out how to replicate the goofy text file so

So you are saying there are two problems... one that produces a corrupt file from a valid compressed file, and one that segfaults when presented with that corrupt file? Can you please confirm the file name and run md5sum on it and share the result so we can tell when the file problem has been reproduced? -- Sent from my phone. Please excuse my brevity. On July 16, 2017 3:21:21 AM PDT, Anthony

I see the problem on Windows 10, R-3.4.0, R.exe. It is not compiled for debugging but gdb gives some information when I attach the debugger after the 'R..has stopped working' popup appears. I don't know how reliable it is: (gdb) info threads Id Target Id Frame * 4 Thread 11848.0x1500 0x00007ffe38dc8861 in ntdll!DbgBreakPoint () from

I am stuck. The archive package won't compile for me on Ubuntu, and the CRANextra repo seems to be down so I cannot install packages on Windows right now. Perhaps you can zip the corrupt text file and put it online somewhere? Don't use the archive package to pack it since there seem to be issues with that tool on your machine. I would discourage you from harassing the Brazilian

The original file had a lot of trailing null bytes so I tried making a similar file with: tf <- tempfile(); file <- file(tf, "wb") for(i in 1:(2^15-1))writeBin(rep(as.raw(32:127), len=2^16), file) for(i in 1:(2^15-1))writeBin(rep(as.raw(0L), len=2^16), file) close(file) log2(file.size(tf)) #[1] 31.99996 Reading this with readLines() caused R-3.4.0 to segfault in Rf_con_pushback

hi, thanks again for taking the time. since corrupted compression prompted the segfault for me in the first place, i've just posted the text file as-is. it's a 2.4GB file so to be avoided on a metered internet connection. i've updated the bugzilla report at https://bugs.r-project.org/bugzilla3/show_bug.cgi?id=17311 with more relevant info. these lines of code crash both windows R

ROR newbie here... I''m trying to build a form to upload a CSV file, then parse and store the data. I have debugged this code up this point, but now when I browse to my csv file, and click Upload, I get this error: "Missing template uploads/process_file.html.erb in view path..." Here is my view (in /uploads/new.html.erb) <% form_tag ({:action =>

Hello Friends I want to generate tab-delimited text file of my every users information in once. i have a button called EXPORT on my page when i clicked on this button than i want to generate tab-delimited text file for every users information. can anybody give any snippet of code or any idea for this Thanks -- Posted via http://www.ruby-forum.com/.

I''m trying to grab a CSV file from a user and let them upload it directly to my database, but doing some minor checks on the data before saving. Which is the easier way to implement this? CSV or FasterCSV? I saw that perhaps there were some issues with FasterCSV and csv files created from Mac versions of Excel. Anyone have any experience with this and can recommend a newbie friendly