similar to: RCurl cookiejar

Hello. I know that it's usually possible to write cookies to a cookie file by removing the curl handle and doing a gc() call. I can do this with getURL(), but I just can't obtain the same results with postForm(). If I use: curlHandle <- getCurlHandle(cookiefile=FILE, cookiejar=FILE) and then do: getURL(http://example.com/script.cgi, curl=curlHandle) rm(curlHandle) gc() it's

Hi, I am trying to access a website and read its content. The website is a restricted access website that I access through a proxy server (which therefore requires me to enable cookies). I have problems in allowing Rcurl to receive and send cookies. The following lines give me: library(RCurl) library(XML) url <- "http://www.theurl.com" content <- readHTMLTable(url) content

Hi! I've performed a Google Scholar Search using a query, let's say "Frank Harrell", and parsed the links to the EndNote references from the resulting HTML code. Now I'd like to download all the references automatically. For this, I have tried to use RCurl, but I can't seem to get it working: I always get error code "403 Forbidden" from the web server.

Hi, I am starting coding in r and one of the things that i want to do is to scrape some data from the web. The problem that I am having is that I cannot get passed the disclaimer page (which produces a session cookie). I have been able to collect some ideas and combine them in the code below but I dont get passed the disclaimer page. I am trying to agree the disclaimer with the postForm and write

Dear R-help, I want to download the text from a web page, however what i end up with is the html code. Is there some option that i am missing in the RCurl package? Or is there another way to achieve this? This is the code i am using: > library(RCurl) > my.url <- 'https://stat.ethz.ch/mailman/listinfo/r-help' > html.file <- getURI(my.url, ssl.verifyhost = FALSE,

Dear R-help, There seems to be a web page I am unable to download using RCurl. I don't understand why it won't download: > library(RCurl) > my.url <- "http://www.nytimes.com/2009/01/07/technology/business-computing/07program.html?_r=2" > getURL(my.url) [1] "" Other web pages are ok to download but this is the first time I have been unable to download a

     Hi everybody, I got a problem with the ftpUpload function from the RCurl package. My goal is to Upload a lot of files from a local directory to a web server. 1st try : for (i in 1:length(file)){       ftpUpload(what=files[i],to=files[i]) } At i=11 I get : (my server has only 10 available open connections available) : Erreur dans curlPerform(url = to, upload = TRUE, readfunction =

Hi everyone, I have to fetch about 300 to 500 zipped archives from a remote ftp server. Each of the archive is about 1Mb. I know I can get it done by using download.file() in R, but I am curious that is there a faster way to do this using RCurl. For example, are there some parameters that I can set so that the connection does not need to be rebuilt....etc. A even simpler question is, how can I

Hello, I am having trouble getting the curlPerform function to authenticate using the .netrc file. From the documentation I've read it certainly seems as though this function should be able to authenticate via the .netrc file. The example I am using here comes from the "R as a Web Client- the RCurl package" paper and demonstrates using the .netrc file to access the

Martin, Well, thanks for jumping in! We need all the help we can get ;) I changed the execute bit as you suggested and recompiled, no luck, still the same error message. Below is the output you wanted me to look at, its a bit beyond me so I include both a brief grep summary and then the whole enchilada. I do note that my output is different from yours, but I'm not sure how to interpret. I

Martin, Well, thanks for jumping in! We need all the help we can get ;) I changed the execute bit as you suggested and recompiled, no luck, still the same error message. Below is the output you wanted me to look at, its a bit beyond me so I include both a brief grep summary and then the whole enchilada. I do note that my output is different from yours, but I'm not sure how to interpret. I

Encountered an error in scripting, which can be reproduced using Rscript as follows: $ Rscript -e "library(httr); handle('http://cran.r-project.org')" Error in getCurlHandle(cookiefile = cookie_path, .defaults = list()) : could not find function "getClass" Calls: handle -> getCurlHandle or by starting R without the methods package attached: $

Since upgrading to 7.0 Stable, I've noticed an occasional problem with konqueror. I've been recompiling my ports for the past few weeks and have noticed that some sites are complaining about cookies not being enabled. Further investigation has revealed that if I start konqueror from the terminal prompt, I can get an error message: khtml (dom) Can't communicate with the cookiejar!

Hi, I've set up a very simple R repository. Just a single source library. Everything works fine. I can install the package on my client using: install.packages(repos='http://www.myServer.se/myRepo/', pkgs='myLib', dep=TRUE) However, I want to protect the repo, so I use a .htaccess, placed directly under 'myRepo' on the server. I use 'Authentication Basic' and

I am very new to R and have been struggling trying to read a basic ".csv" file from a password protected site with the following code: myURL ="http://www.frontierweather.com/degreedays/L15N15PowerRegionAverages_10weeks.txt" test2=read.table(url(myURL),header=TRUE,sep=",") A 'data.frame' is returned into the workspace, however it is not the data contained in

Hi, I have problems downloading complete folders via ftp with R. Single files work fine. I tried Rcurl, but it does not work. This is my code: url = "ftp://disc2.nascom.nasa.gov/data/TRMM/Gridded/Derived_Products/3B42_V6/Daily/2009/" filenames = getURL(url, ftp.use.epsv = FALSE, ftplistonly = TRUE, crlf = TRUE) filenames = paste(url, strsplit(filenames, "\r*\n")[[1]], sep =

Dear Dr. bernhard cc. r-help Thank you very much for deverlopping rneos package. I read the document of rneos. however, due to my inability, i could not figure-out how to connect with neos server from R environment. let me explain the steps, i took. my laptop is using wireless of my laboratory. to connect the internet, i need proxy address and specific port (that i have mentioned in protocols in

Confirmed that gcc-gfortran is installed Package gcc-gfortran-4.4.7-16.el6.x86_64 already installed and latest version What could I check next? I do not have the following installed and will get that done and tested again. libcurl-devel libidn-devel Thanks, Larry -----Original Message----- From: Tom Callaway [mailto:tcallawa at redhat.com] Sent: Wednesday, January 27, 2016

I am having trouble getting an install of RCurl to work properly on a Unix server. The steps I have taken are: 1. installed cUrl from source without difficulty 2. installed RCurl from source using the command ~/R_HOME/R-devel/bin/R CMD INSTALL -l ~/R_HOME/R-devel/library ~/RCurl_0.8-0.tar.gz I received no errors during this install 3. when I go back to R and require(RCurl), I get >

I am having trouble getting an install of RCurl to work properly on a Unix server. The steps I have taken are: 1. installed cUrl from source without difficulty 2. installed RCurl from source using the command ~/R_HOME/R-devel/bin/R CMD INSTALL -l ~/R_HOME/R-devel/library ~/RCurl_0.8-0.tar.gz I received no errors during this install 3. when I go back to R and require(RCurl), I get >