search for: archive_extract

...ot;) file_folder <- file.path( tempdir() , "file_folder" ) tf <- tempfile() # large download! cachaca saves on your local disk if already downloaded lodown::cachaca( ' http://download.inep.gov.br/microdados/microdados_enem2009.rar' , tf , mode = 'wb' ) archive::archive_extract( tf , dir = normalizePath( file_folder ) ) unzipped_files <- list.files( file_folder , recursive = TRUE , full.names = TRUE ) infile <- grep( "DADOS(.*)\\.txt$" , unzipped_files , value = TRUE ) # works R.utils::countLines( infile ) # works with warning my_file <- readLines(...

...t? the lodown package can be removed from my example.. it is just for file download cacheing, so `lodown::cachaca` can be replaced with `download.file` my current example requires a huge download, so sort of painful to repeat but i'm pretty confident that's not the issue. the archive::archive_extract() function unzips a (probably corrupt) .RAR file and creates a text file with 80,937 lines. this file is 4GB: > file.size(infile) [1] 4078192743 i am pretty sure that nearly all of that 4GB is contained on a single line in the file. here's what happens when i create a file conne...

...be removed from my example.. it is just for file > download cacheing, so `lodown::cachaca` can be replaced with > `download.file` my current example requires a huge download, so sort of > painful to repeat but i'm pretty confident that's not the issue. > > > the archive::archive_extract() function unzips a (probably corrupt) .RAR > file and creates a text file with 80,937 lines. this file is 4GB: > > > file.size(infile) > [1] 4078192743 <(407)%20819-2743> > > > i am pretty sure that nearly all of that 4GB is contained on a single line > in...

...r() , "file_folder" ) > > tf <- tempfile() > > # large download! cachaca saves on your local disk if already downloaded > lodown::cachaca( ' > http://download.inep.gov.br/microdados/microdados_enem2009.rar' , tf , mode > = 'wb' ) > > archive::archive_extract( tf , dir = normalizePath( file_folder ) ) > > unzipped_files <- list.files( file_folder , recursive = TRUE , full.names = > TRUE ) > > infile <- grep( "DADOS(.*)\\.txt$" , unzipped_files , value = TRUE ) > > # works > R.utils::countLines( infile ) > >...

...le.. it is just for file >> download cacheing, so `lodown::cachaca` can be replaced with >> `download.file` my current example requires a huge download, so sort of >> painful to repeat but i'm pretty confident that's not the issue. >> >> >> the archive::archive_extract() function unzips a (probably corrupt) .RAR >> file and creates a text file with 80,937 lines. this file is 4GB: >> >> > file.size(infile) >> [1] 4078192743 <(407)%20819-2743> >> >> >> i am pretty sure that nearly all of that 4GB is contain...

...oad cacheing, so `lodown::cachaca` can be replaced with >>>> `download.file` my current example requires a huge download, so sort of >>>> painful to repeat but i'm pretty confident that's not the issue. >>>> >>>> >>>> the archive::archive_extract() function unzips a (probably corrupt) .RAR >>>> file and creates a text file with 80,937 lines. this file is 4GB: >>>> >>>> > file.size(infile) >>>> [1] 4078192743 <(407)%20819-2743> >>>> >>>> >>>>...

...>>> download cacheing, so `lodown::cachaca` can be replaced with >>> `download.file` my current example requires a huge download, so sort of >>> painful to repeat but i'm pretty confident that's not the issue. >>> >>> >>> the archive::archive_extract() function unzips a (probably corrupt) .RAR >>> file and creates a text file with 80,937 lines. this file is 4GB: >>> >>> > file.size(infile) >>> [1] 4078192743 <(407)%20819-2743> >>> >>> >>> i am pretty sure that nea...

...::cachaca` can be replaced with >>>>> `download.file` my current example requires a huge download, so >sort of >>>>> painful to repeat but i'm pretty confident that's not the issue. >>>>> >>>>> >>>>> the archive::archive_extract() function unzips a (probably >corrupt) .RAR >>>>> file and creates a text file with 80,937 lines. this file is 4GB: >>>>> >>>>> > file.size(infile) >>>>> [1] 4078192743 <(407)%20819-2743> >>>>> >>&...

...h > >>>>> `download.file` my current example requires a huge download, so > >sort of > >>>>> painful to repeat but i'm pretty confident that's not the issue. > >>>>> > >>>>> > >>>>> the archive::archive_extract() function unzips a (probably > >corrupt) .RAR > >>>>> file and creates a text file with 80,937 lines. this file is 4GB: > >>>>> > >>>>> > file.size(infile) > >>>>> [1] 4078192743 <(407)%20819-2743> >...

...oad cacheing, so `lodown::cachaca` can be replaced with >>>> `download.file` my current example requires a huge download, so sort of >>>> painful to repeat but i'm pretty confident that's not the issue. >>>> >>>> >>>> the archive::archive_extract() function unzips a (probably corrupt) .RAR >>>> file and creates a text file with 80,937 lines. this file is 4GB: >>>> >>>> > file.size(infile) >>>> [1] 4078192743 <(407)%20819-2743> >>>> >>>> >>>>...

...`download.file` my current example requires a huge download, >so >> >sort of >> >>>>> painful to repeat but i'm pretty confident that's not the >issue. >> >>>>> >> >>>>> >> >>>>> the archive::archive_extract() function unzips a (probably >> >corrupt) .RAR >> >>>>> file and creates a text file with 80,937 lines. this file is >4GB: >> >>>>> >> >>>>> > file.size(infile) >> >>>>> [1] 4078192743 <(4...

...replaced with >>>>> `download.file` my current example requires a huge download, so sort >>>>> of >>>>> painful to repeat but i'm pretty confident that's not the issue. >>>>> >>>>> >>>>> the archive::archive_extract() function unzips a (probably corrupt) >>>>> .RAR >>>>> file and creates a text file with 80,937 lines. this file is 4GB: >>>>> >>>>> > file.size(infile) >>>>> [1] 4078192743 <(407)%20819-2743> >>>&...

...requires a huge download, > >so > >> >sort of > >> >>>>> painful to repeat but i'm pretty confident that's not the > >issue. > >> >>>>> > >> >>>>> > >> >>>>> the archive::archive_extract() function unzips a (probably > >> >corrupt) .RAR > >> >>>>> file and creates a text file with 80,937 lines. this file is > >4GB: > >> >>>>> > >> >>>>> > file.size(infile) > >> >>>>...