similar to: Technique for reading large sparse fwf data file

Dear List I have a fixed width file with variables of varying width. The help is pretty transparent for this feature, but I can't seem to figure out how I can make effective use of the package with my data. In my dataset, the first 80 columns are of width 1 followed by other variables with width larger than 1. I think the correct way to do this, by brute force, would be >

Hello! In my opinion read.fwf()'s behaviour of header is not really useful. Say I have the following data: col1 col2 col3 123 123 123 a b 1234 12 1234 65.4 4.5 Now if I want to read this data into R I can not use read.table due to missing fields. read.table(file="test.txt") Error in scan(file, what, nmax, sep, dec, quote, skip, nlines, na.strings,

I keep getting these fixed-width format (FWF) data files where variables for a single subject are spread across multiple lines and each line has a different format (apparently created with SAS or SPSS). To read them I stole some stuff from `read.fwf' in base R and threw together the function included below. Please feel free to test this function with your own data and let me know of any

Dear R-list members, I have a data file with thousands of lines (cases), where each line contains the values of several variables. I would like to separate these lines in small groups, with each group followed by a blank line, to ease the visual inspection of the data in some situations. I am writing the output files with function write.fwf in library gdata, for correct column alignment. Below

Is there a way to handle the widths of values being written to a file using wrtite.fwf() ? For example, I used read.fwf(file, width.vector) to read a file. After making the necessary data manipulation, I want to write the data to a new file in the same width.vector format. Is there a way to specify this? Thanks in Advance Aparna [[alternative HTML version deleted]]

Full_Name: Jeffrey Longmate Version: Version 1.4.0 Patched (2002-01-23) OS: Windows NT 4.0 Submission from: (NULL) (151.152.101.44) In read.fwf, ... args are passed to read.table, as stated in the documentation. However, passing comment.char in this manner is defeated by the call to scan that precedes the call to read.table. The problem is that scan has a default comment.char="#",

Full_Name: Jeffrey Longmate Version: Version 1.4.0 Patched (2002-01-23) OS: Windows NT 4.0 Submission from: (NULL) (151.152.101.44) In read.fwf, ... args are passed to read.table, as stated in the documentation. However, passing comment.char in this manner is defeated by the call to scan that precedes the call to read.table. The problem is that scan has a default comment.char="#",

Full_Name: Giovanni Bonafe' Version: 2.2.0 OS: Linux Submission from: (NULL) (195.62.164.225) If the file "example.dat" is like this: aaa bbb ccc 3.4 1.2 5.6 4.6 10 32 667 343 1.7 With the older 1.9.1, as expected: > data<-read.fwf(file = "example.dat",widths=c(3,4,4),header=TRUE) > data aaa bbb ccc 1 3.4 1.2 5.6 2 4.6 10.0 32.0 3 667.0 343.0

Full_Name: Shigeru Mase Version: R 1.9.1 and 2.0.0 OS: Debian Linux Submission from: (NULL) (219.35.150.115) I tried to read the following text file "test.txt" with 5 lines using read.fwf() function: # comment 1 1234567 # comment 2 1 234567 # comment 3 12345 67 # comment 4 # comment 5 In R 1.9.1, I got the following result (since I have R 2.0.0 installed now I cannot reproduce

Running R 1.6.1 Linux Slackware 8.1 233MHZ AMD-K6 96MB RAM Using read.fwf, I tried to open a fixed-width file that of about 4 MB residing in the working directory, using the command below: dat<-read.fwf("sc01aai.dat", widths=fields$length) where fields$lengths is a vector of column widths, 28 to be exact. The data are a mix of character, text, and factor variables. R started

Hi everyone, my apologies if I'm overlooking something obvious in the documentation. I'm relatively inexperienced with the (awesome) ff package. My goal is to use the read.table.ffdf() function to call the read.fwf() function and pass through the colClasses and comment.char arguments. The code below shows exactly what doesn't work for me. If the colClasses and comment.char

Here is an example of the data I'm reading in using read.fwf: 5342.0 5450.4 0.9200 0.4506 34.7030 27.8411 37.1306 46.0034 0.0000 5438.0 5549.6 0.9300 0.4477-34.7280 27.8616 37.1506 46.0234 0.0000 And the commands I'm using to read it in: widths <- c(7,7,8,8,8,8,8,8,8) filedata <- read.fwf(fileopen, widths,sep="",dec=".") The problem is with

# Your mailer is set to "none" (default on Windows), # hence we cannot send the bug report directly from R. # Please copy the bug report (after finishing it) to # your favorite email program and send it to # # r-bugs@r-project.org # ###################################################### Is this intended behavior for the read.fwf(na.strings="-999")? I anticipated that

Hello I am trying to use read.fwf, but receive an error: Warning: perl not found Error: "scan" can't open file I guess I need to obtain a perl for windows95 program. Where can I find a suitable port? R-Version: 0.64.1 OS : Win95 Thanks Sylvano sylvano at hotmail.com.au -------------------------------- Sylvano Lucchetti sylvano at gnomon.com.au http://www.gnomon.com.au/

Dear R-list This is just message to inform that the there is an issue with write.fwf in the gdata library (from version 2.5.0 on). It does not seem to accept further arguments to write.table like "eol" as the help file indicates as it stops when executing tmp <- lapply(x, format.info, ...). Great package though - I use it a lot except for this function :) See example below. >

i just used read.fwf (which calls perl) and i noticed something. i also have mat;lab installed on this machine, and matlab also installs a version of perl, but a different one. additionally, matlab puts its bin directory in the system path. so, if one does not canerully set the path, r will call the matlab verion of perl, and things won't work. if anybody is collection a list of pitfalls,

It seems to me that the bug dealt with in bug reports 8226 and 8236 is still not fixed. I obtained the revised version of read.fwf from the latest R-patched and tried try.it <- read.fwf("junk",w,header=TRUE,as.is=TRUE) This gave the error Error in read.table(file = FILE, header = header, sep = sep, as.is = as.is, : more columns than column names Inspection of file

Hello, I am having a problem with write.fwf in Windows. I wrote a code to ingest a number of text files with weather data in them, process them, and then output a text file with two parts: 1) a set of column names, 2) the processed data table. I wrote and tested the program on my Mac, and it worked fine. However, on the windows machine, where I intend the work to be done, when I run the

Hi, I'm trying to use read.fwf temp = read.fwf ("Raw data.txt", widths = c (11, 21, 10, rep (16, 6)) ,skip = 2, n = 2, stringsAsFactors = FALSE, strip.white = TRUE) but no matter what I do the strings are turned into factors. I believe it's the "n=2" parameter that causes the problem as it seems to work without this. Am I missing something? Thanks in advance,

I have a file in fwf. It is rather large, about 40,000 rows and 40 variables (columns). I only need about 10 variables form the data set for the analysis at hand. Unfortunately, these 10 variables are not contiguous in the file, for example, the first is position 1-8, the next position 25-27, then 40. Is there a way to read the selected varaibles that I need without reading in the entire data