similar to: R and HTTP get 'has file changed'

Dear list, I'm tackling an empiric research problem that requires me to address a whole bunch of conceptual and/or technical details at the same time which cuts time short for all the nitty-gritty details of the "components" involved. Having said this, I'm lacking the time at the moment to deeply dive into parallel computing and HTTP requests via RCurl and I hope you can help me

Folks, I want to scrape a series of web-page sources for strings like the following: "/en/Ships/A-8605507.html" "/en/Ships/Aalborg-8122830.html" which appear in an href inside an <a> tag inside a <div> tag inside a table. In fact all I want is the (exactly) 7-digit number before ".html". The good news is that as far as I can tell the the <a>

Dear R-help, I want to download the text from a web page, however what i end up with is the html code. Is there some option that i am missing in the RCurl package? Or is there another way to achieve this? This is the code i am using: > library(RCurl) > my.url <- 'https://stat.ethz.ch/mailman/listinfo/r-help' > html.file <- getURI(my.url, ssl.verifyhost = FALSE,

Martin, Well, thanks for jumping in! We need all the help we can get ;) I changed the execute bit as you suggested and recompiled, no luck, still the same error message. Below is the output you wanted me to look at, its a bit beyond me so I include both a brief grep summary and then the whole enchilada. I do note that my output is different from yours, but I'm not sure how to interpret. I

Martin, Well, thanks for jumping in! We need all the help we can get ;) I changed the execute bit as you suggested and recompiled, no luck, still the same error message. Below is the output you wanted me to look at, its a bit beyond me so I include both a brief grep summary and then the whole enchilada. I do note that my output is different from yours, but I'm not sure how to interpret. I

Hello, I am trying to access Microsoft Live Search Using SOAP through R. In R I am using the RCurl packages to make the calls. I have the following situation that looks crazy and cannot figure out how to solve it: #SOAP Request library(RCurl) h = basicTextGatherer() body='<?xml version="1.0" encoding="ISO-8859-15"?> <SOAP-ENV:Envelope

Dear all, I wrote a wrapper to a FORTRAN program using R. The main program uses a text file (~200 lines) as an input describing the simulation to be run. I typically generate the file once with the right parameters using a combination of file(), paste(), cat(). This is fine, and it works well, however I then need to update only a few values in the file many times (~200 times,

I've got 2 doubts: 1.I've been trying to write an application using Libvirt's Java API which should run on both Xen and KVM running machines and execute the Xen or KVM code based on the hypervisor used. I want the physical machine to know if it's running Xen or KVM and execute only that code. While using getURI(), I need to use it as conn.getURI() but then I can't use conn

I would like to turn off all the messages during library(aPackage) or require(aPackage) I tried different commands: invisible, capture.output, sink but none of them is working. For example, loading VGAM, gives a lot of unnecessary messages: > library(VGAM) Attaching package: 'VGAM' The following object(s) are masked from package:splines : bs The

I have recently upgraded to Ubuntu Gutsy and, for the first time, am using a 64-bit installation. After failing miserably to install R from source, not a problem for me in the past with a 32-bit install, I went the route of using the Debian Etch build. This went smoothly, but I am unable to update my numerous R and BioConductor packages, getting non-zero exit status errors on each package. Is

Hi, I am hoping someone can help me with a sampling question. I am using the following function to sample 10 unique observations: x <- sample(1:100, 10, replace=F) Given the first 10 observations, I need to sample another 5 unique observations from the remainder. I essentially want to do a Monte Carlo type analysis on the results. I would appreciate any feedback. Thanks -- View this

I have roughly 80 or so packages sources. These were obtained by taking a snapshot of certain CRAN packages a few months ago using install.packages( pkgs = pckNames, destdir = "/home/max", repos = "http://cran.r-project.org" dependencies = c("Depends", "Imports", "Suggests")) We need to install these versions of the

Is there a painless way to find the names of all packages on CRAN that "Depend" on a specified package? url: www.econ.uiuc.edu/~roger Roger Koenker email rkoenker at uiuc.edu Department of Economics vox: 217-333-4558 University of Illinois fax: 217-244-6678 Champaign, IL 61820

Hi, Recently I try to install Biobase component using the tutorials from cran.r-project.org/doc/Rnews/Rnews_2006-5.pdf I tried u <- "http://bioconductor.org/biocLite.R" > source(u) > biocLite("pkgDepTools", dependencies=TRUE) Running biocinstall version 2.0.8 with R version 2.5.1 Your version of R requires version 2.0 of Bioconductor. Warning in

Hi everyone, I'm trying to send an HTTP request using RCurl that only requests the response header, not the actual content. http://curl.haxx.se/docs/httpscripting.html says you can do this by using the following option: curl --head http://www.something.com/ However, I can't figure out how to do this when using 'getURL()', for example. Here's what I tried: FIRST TRY txt

Estimados Les consulto por lo siguiente, incluso creo que de esto se habló en una oportunidad en esta lista, por ese motivo cualquier sugerencia es bienvenida. Hay algo de información que me hace falta para un trabajo, pero esta no es de una única fuente, y desconozco si brindan los registros, pero lo que es accesible son los sitios web donde estas fuentes publican un formulario HTML simple,

I am using RCurl's curlPerform command to send an XML string to an HTTP server running on the localhost. The command is something like this: reader <- basicTextGatherer() curlPerform(url="http://127.0.0.1/", httpheader=c('Content-Type' = "text/xml; charset=utf-8"), postfields=toString.XMLNode(xmlRoot(xdoc)), writefunction=reader$update,

Hi All, I am running into what appears to be character size limit in a JSON string when trying retrieve data from either `curlPerform()` or `getURL()`. Here is non-reproducible code [1], but it should shed some light on the problem. # Note that .base.url is the basic url for the API, q is a query, user # is specified, etc. session = getCurlHandle() curl.opts <- list(userpwd

I am having trouble getting an install of RCurl to work properly on a Unix server. The steps I have taken are: 1. installed cUrl from source without difficulty 2. installed RCurl from source using the command ~/R_HOME/R-devel/bin/R CMD INSTALL -l ~/R_HOME/R-devel/library ~/RCurl_0.8-0.tar.gz I received no errors during this install 3. when I go back to R and require(RCurl), I get >

I am having trouble getting an install of RCurl to work properly on a Unix server. The steps I have taken are: 1. installed cUrl from source without difficulty 2. installed RCurl from source using the command ~/R_HOME/R-devel/bin/R CMD INSTALL -l ~/R_HOME/R-devel/library ~/RCurl_0.8-0.tar.gz I received no errors during this install 3. when I go back to R and require(RCurl), I get >