search for: curlperform

Displaying 20 results from an estimated 27 matches for "curlperform".

2008 Aug 27
1
RCurl: using netrc with curlPerform
Hello, I am having trouble getting the curlPerform function to authenticate using the .netrc file. From the documentation I've read it certainly seems as though this function should be able to authenticate via the .netrc file. The example I am using here comes from the "R as a Web Client- the RCurl package" paper and demonstrates...
2012 Oct 30
2
RCurl - curlPerform - Time out?!?
Hi, I am working with the RCurl package and I am using the curlPerform function for an soap-query. The problem is that the code is usually working well, but sometimes the connection gets lost. So I wrote a while-loop to repeat the query if anything might happened so that the same query runs again, but if the query-faults it takes a very long time for the repetiti...
2009 Oct 15
1
Removing Embedded Null characters from text/html
...lt;- "http://en.wikipedia.org/wiki/Brazil_national_football_team" webpage <- getURL(theurl) # BUT DOES NOT WORK HERE DUE TO EMBEDDED NULL CHARACTERS theurl <- "http://screen.yahoo.com/b?pr=1/&s=nm&db=stocks&vw=0&b=21" webpage <- getURL(theurl) Error in curlPerform(curl = curl, .opts = opts, .encoding = .encoding) : Failed writing body (1371 != 1461) In addition: Warning messages: 1: In curlPerform(curl = curl, .opts = opts, .encoding = .encoding) : truncating string with embedded nul: 'ttp://finance. ## I DELETED SOME HERE FOR BREVITY## al>\n...
2015 Feb 05
3
Rcurl crash in R-devel
...-psud.fr/conservation/embryogrowth/DESCRIPTION" > ftpUpload(what=filepath, to=urlx) *** caught segfault *** address 0x0, cause 'memory not mapped' Traceback: 1: .Call("R_curl_easy_perform", curl, .opts, isProtected, .encoding, PACKAGE = "RCurl") 2: curlPerform(url = to, upload = TRUE, readfunction = uploadFunctionHandler(file, asText), ..., curl = curl) 3: ftpUpload(what = filepath, to = urlx) Possible actions: 1: abort (with core dump, if enabled) 2: normal R exit 3: exit R without saving workspace 4: exit R saving workspace Selection: Hope it...
2007 Nov 12
1
Microsoft SOAP - Help!!
...nt">0</Offset> <Count xsi:type="xsd:int">10</Count> <ResultFields xsi:type="xsd:string">Title</ResultFields> </SourceRequest></Requests></Request></ns3849:Search></SOAP-ENV:Body> </SOAP-ENV:Envelope>' curlPerform(url="http://soap.search.msn.com/webservices.asmx?wsdl", httpheader=c(Accept="text/xml", Accept="multipart/*", 'Content-Type' = "text/xml; charset=utf-8"), postfields=body, writefunction = h$...
2009 Jun 02
1
Problem downloading webpages using batchfiles and RCurl from command line in Vista Basic - couldn't connect to host
...successfully set the PATH. I open up 'Command Prompt' in Vista and type (after the C:\...> stuff): ### START ### C:\Users\Karen>Rscript -e "library(RCurl); getURL('http:// www.google.com')" Loading required package: methods Loading required package: bitops Error in curlPerform(curl = curl, .opts = opts, .encoding = .encoding) : couldn't connect to host Calls: getURL -> curlPerform -> .Call Execution halted ### END ### I think this means that R could not connect to the internet. However, if i run the same code in Rgui (i.e. opening R normally, not command lin...
2012 May 14
3
Scraping a web page.
...ways on it's own line so some kind of line-by-line grep should suffice once I figure out the following: What is the best package/command to use to get the source of a web page. I tried using something like: if(url.exists("http://www.omegahat.org/RCurl")) { h = basicTextGatherer() curlPerform(url = "http://www.omegahat.org/RCurl", writefunction = h$update) # Now read the text that was cumulated during the query response. h$value() } which works except that I get one long streamed html doc without the line breaks. Thanks in advance for your help, KW [[alternative HTM...
2013 Jul 23
2
downloading web content
...llo, I am trying to use R to download a bunch of .csv files such as: http://biocache.ala.org.au/ws/occurrences/download?q=Banksia+ericifolia I have tried the following and neither work: a<- getURL(" http://biocache.ala.org.au/ws/occurrences/download?q=Banksia+ericifolia") Error in curlPerform(curl = curl, .opts = opts, .encoding = .encoding) : embedded nul in string: and a<-httpPOST(" http://biocache.ala.org.au/ws/occurrences/download?q=Banksia+ericifolia") Error: Internal Server Error Any help would be appreciated. Daisy -- Daisy Englert Duursma Department of Biolo...
2015 Feb 06
0
Rcurl crash in R-devel
...... ** package ?RCurl? correctement d?compress? et sommes MD5 v?rifi?es ########## I remove the long list of information for the compilation > library(RCurl) Le chargement a n?cessit? le package : bitops > # > f = CFILE("Pointe_Noire_Sud.kmz.zip", mode="wb") > curlPerform(url = "http://protomac.org/resources/Pointe_Noire_Sud.kmz.zip", writedata = f at ref) *** caught segfault *** address 0x0, cause 'memory not mapped' Traceback: 1: .Call("R_curl_easy_perform", curl, .opts, isProtected, .encoding, PACKAGE = "RCurl")...
2009 Oct 14
2
puzzle using gsub (and encodings maybe)
Hello, Below is some output that shows my issue. I have a variable x that I read from a file (more on this below) > x [1] "NEW YORK NEW ENGLAND" > gsub(" -", "-", x) # this does not work! [1] "NEW YORK NEW ENGLAND" > Encoding(x) # is x in a special encoding? no [1] "unknown" > y = "NEW YORK -NEW
2008 Aug 28
1
RCurl: authentication when posting forms
Hi, Has anyone successfully used RCurl for posting data to a password-protected site? I have tired using option netrc=1 with both postForm and curlPerform (with postfields option) but can't authenticate. I would happily provide more details if some one has had some experience with this. Thanks very much. Valerie
2011 Nov 03
1
RGoogleTrends error in "getGTrends"
Hi all, I've just installed RGoogleTrends Version:0.2-1 (after compiling it for windows). And when running the most basic command I get the following error: > ans = getGTrends("coupon") Error in curlPerform(url = url, curl = curl, .opts = .opts) : embedded nul in string: '<ff><fe>Y' In addition: Warning message: RS-DBI driver warning: (closing pending result sets before closing this connection) Am I missing something, or is this due to some change in Rgoogletrends website? p.s...
2013 Apr 24
0
string size limits in RCurl
Hi All, I am running into what appears to be character size limit in a JSON string when trying retrieve data from either `curlPerform()` or `getURL()`. Here is non-reproducible code [1], but it should shed some light on the problem. # Note that .base.url is the basic url for the API, q is a query, user # is specified, etc. session = getCurlHandle() curl.opts <- list(userpwd = paste(user, ":", key,...
2010 Apr 16
0
RCurl slow when sending data over 1kb
I am using RCurl's curlPerform command to send an XML string to an HTTP server running on the localhost. The command is something like this: reader <- basicTextGatherer() curlPerform(url="http://127.0.0.1/", httpheader=c('Content-Type' = "text/xml; charset=utf-8"), postfields=toString.XMLNode(...
2010 Sep 16
2
FTP Download
...ames, destfile="") I don't know how to tell R to use the same names for the destfiles als the filenames. If i use: con = getCurlHandle( ftp.use.epsv = FALSE) contents = sapply(filenames[1:5], getURL, curl = con) names(contents) = filenames[1:length(contents)] I get an "error in curlPerform". I know, it's easy to download ftp folders with appropriate programs, but i want to manage to get it work in R.... greets Martin -- View this message in context: http://r.789695.n4.nabble.com/FTP-Download-tp2542359p2542359.html Sent from the R help mailing list archive at Nabble.com.
2010 Nov 22
1
RCurl : All connection are used ?
...h the ftpUpload function from the RCurl package. My goal is to Upload a lot of files from a local directory to a web server. 1st try : for (i in 1:length(file)){       ftpUpload(what=files[i],to=files[i]) } At i=11 I get : (my server has only 10 available open connections available) : Erreur dans curlPerform(url = to, upload = TRUE, readfunction = uploadFunctionHandler(what,  :   Got a 421 ftp-server response when 220 was expected 2 nd Try : ftpConnection=getCurlHandle(userpwd=ftp$userpwd,maxconnects=1,fresh.connect=0) for (i in 1:length(file)){       ftpUpload(what=files[i],to=files[i],curl=ftpConne...
2010 Jul 21
1
Command that is conditional upon file retrieval: is it possible?
...quot;.csv", sep = "") data1 = getURL(url1) write(data1, file = paste("inMyFolder", num1, ".csv", sep = "")) Sometimes this process works perfectly, and sometimes I get an error message like this attached to "data1 = getURL(url1)": Error in curlPerform(curl = curl, .opts = opts, .encoding = .encoding) : RETR response: 550 That's because that particular file isn't on the FTP server yet. Now... let's just imagine that there's another way for me to access the file elsewhere, and I can drag it into the working directory with the...
2011 Apr 29
1
RCurl and postForm()
Hi everybody, I think that I am missing something fundamental in how strings are passed from a postForm() call in R to the curl or libcurl functions underneath. For example, I can do the following using curl from the command line: $ curl -d "Archbishop Huxley" "http://www.datasciencetoolkit.org/text2people"
2008 Oct 01
1
changing 'https' to 'http' when using download.file(), any side effects or just use RCurl?
...Breyal Ps. This is my first posting, so please be kind! :-) PPs. Sorry this post was so long. PPPs. For anyone interested, this is what happens when using RCurl: ### R Code > library(RCurl) > txt = getURL(" https://stat.ethz.ch/pipermail/r-help/2008-October/thread.html") Error in curlPerform(curl = curl, .opts = opts, .encoding = .encoding) : SSL certificate problem, verify that the CA cert is OK. Details: error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify failed OS: Windows Vista Ultimate R version: 2.7.2 (2008-08-25) [[alternative HTML version deleted]]
2010 Nov 23
0
Catching a RCurl error?
Hi all, I'm running a complex script which accesses the internet, and sometimes it stops with the error: Error in curlPerform(url = url, headerfunction = header$update, curl = curl, > : Failure when receiving data from the peer Is there a way to make the script "wait" longer, or not crash when this error happens? (I'm wondering if this should be done in the level of tryCatch, or by playing with som...