similar to: R and REST API's

Hello, Some code using RGoogleDocs, which had been working smoothly since the summer, just stopped working. I know that it worked on November 3rd, but it doesn't work today. I've confirmed that the login and password still work when I log in manually. I've confirmed that the URL gives the same error when I paste it into Firefox. I don't know enough about this web service to figure

Dear Rexperts, I am using R to query google. I am getting different results (in size) for manual queries and queries sent through "getForm" of RCurl. It seems that RCurl limits the size of the text retrieved (the maximum I could get is around 32 k bits). Any idea how to get around this ? Thanks in advance [[alternative HTML version deleted]]

Dear list members, I encountered this problem and the solution pointed out in a previous thread did not work for me. (e.g. install.packages("RCurl", repos = "http://www.omegahat.org/R") I work with Ubuntu Hardy, and installed R 2.6.2 via apt-get. I really need RCurl in order to use biomaRt ... any help would be greatly appreciated. Best wishes, Emmanuel

Folks, I want to scrape a series of web-page sources for strings like the following: "/en/Ships/A-8605507.html" "/en/Ships/Aalborg-8122830.html" which appear in an href inside an <a> tag inside a <div> tag inside a table. In fact all I want is the (exactly) 7-digit number before ".html". The good news is that as far as I can tell the the <a>

Hello, I am having trouble getting the curlPerform function to authenticate using the .netrc file. From the documentation I've read it certainly seems as though this function should be able to authenticate via the .netrc file. The example I am using here comes from the "R as a Web Client- the RCurl package" paper and demonstrates using the .netrc file to access the

Hi, Has anyone successfully used RCurl for posting data to a password-protected site? I have tired using option netrc=1 with both postForm and curlPerform (with postfields option) but can't authenticate. I would happily provide more details if some one has had some experience with this. Thanks very much. Valerie

so... i'm trying to integrate google analytics with R (statistics)-- i know it's possible, there's a lot of documentation and some walkthroughs on how to do it, but i can't for the LIFE of me get it to work or even know where to begin. for starters, the directions i'm following are from this website-- http://code.google.com/p/r-google-analytics/ i'm running an old

Hi Patrick, Greetings from !(sunny) Pittsburgh. What's the scoop on RCurl on windows (XP)? I've tried to install RCurl_0.92-0.zip and RCurl_0.9-3.zip, with both R 2.7.2 and R 2.8.0 from the RGUI (utils:::menuInstallLocal), and get the error "Windows binary packages in zipfiles are not supported". which (according to google's one and only hit) comes from a perl script.

Dear R-Help, >From reading the help file, it is my understanding the the download.file() function does not support HTTPS connections. So therefore, understandably, the follow produces an error: ### R Code > url <- "https://stat.ethz.ch/pipermail/r-help/2008-October/thread.html" > destfile <- "//PFO-SBS001/Redirected/tonyb/Desktop/R_web_test/tmp.txt" >

Hello, I am trying to solve a problem but with no success for the past 4 days. I use the RCurl package with R 2.8.1, and when I try to use the function FTPUpload, it uploads the file but does not stop. It repeats the content of the file without stopping and the destination file keeps getting bigger and bigger. Here is the line that I use :

Hello, I am trying to use XML package to download Facebook reviews in the following way: require(XML) mydata.vectors <- character(0) Qword <- URLencode('#IBM') QUERY <- paste('SELECT review_id, message, rating from review where message LIKE %',Qword,'%',sep='') Facebook_url = paste('https://api.facebook.com/method/fql.query?query=

I deal with a huge amount of Biology data stored in different databases. The databases belongig to Bioconductor organization can be accessed through Bioconductor packages. Unluckily some useful data is stored in databases like, for instance, miRDB, miRecords, etc ... which offer just an interactive HTML interface. See for instance http://mirdb.org/cgi-bin/search.cgi,

Hi, I am trying to access a website and read its content. The website is a restricted access website that I access through a proxy server (which therefore requires me to enable cookies). I have problems in allowing Rcurl to receive and send cookies. The following lines give me: library(RCurl) library(XML) url <- "http://www.theurl.com" content <- readHTMLTable(url) content

Hi! I've performed a Google Scholar Search using a query, let's say "Frank Harrell", and parsed the links to the EndNote references from the resulting HTML code. Now I'd like to download all the references automatically. For this, I have tried to use RCurl, but I can't seem to get it working: I always get error code "403 Forbidden" from the web server.

Hi List, I am trying to leverage my knowledge of R in trying to use it for tasks that may not make R the best choice for these tasks. I wish to automate a web scraping task, which requires a multi-step procedure: 1) log in to a website 2) Go to a particular page 3) From the drop down menu, click on a particular link 4) From the tabulated data presented, choose relevant information based on a

Hello, I'm trying to figure out how to use the RGoogleDocs package from OmegaHat, and am having a bit of trouble. I emailed Duncan Temple Lang directly, but didn't receive a response, so I thought I'd try here to see if anyone else can help. I'm using 32-bit R 2.10.1 (Mac OS X), I built RGoogleDocs 0.4-0 from source, and I'm using XML 3.1-0 and RCurl 1.2-0. If I use

Dear List, When I try to install tweetR on Ubuntu, I get the error message below. It is a problem with the dependency RCurl. This package is not available for Windows on CRAN, but I would assume that I should have no problem with linux. Any help is much appreciated. R version: 2.12.1 Platform: x86_64-pc-linux-gnu (64-bit) * installing *source* package ‘RCurl’ ... checking for curl-config... no

Dear colleagues, Could I get some assistance using postForm() to scrape the business names and addresses at this website: http://www.brantford.ca/business/LocalBusinessCommunity/Pages/BusinessDirectorySearch.aspx I've read through (http://www.omegahat.org/RCurl/RCurlJSS.pdf) and scoured the web for tutorials, but I can't crack it. I'm aware that this is probably a pretty basic

Hello all, Is it possible to create web service in R? Any links or book i can refer! My second question is i'm trying to call a web service using RCurl package. The pdf from google doesnt have entire code in it.[ R as web client - RCurl package]. It's not written how to send parameter for a function or i'm missing something. I want to pass parameter to a function of a

I could use some advice regarding xyplot. I've got 2 time series. Both cover approximately the same period of time (ie, 1940 to 2009). But one series has annual data and the other has monthly data. One refers to university enrollment; the other to unemployment rates. Both are currently in the same data frame. I'd like to use the monthly times series as a light grayscale background for a