similar to: RHTMLForms / Scrape data from website that needs a parameter in-putted

Hi, I am having trouble submitting a form using the RCurl package. My code runs without errors but doesn't return the table I am after. I have a feeling it is because there are 2 submit buttons on the page and I'm not hitting the right one. I have tried everything I can think of to submit the form correctly but with no luck. My current code is as follows. library(RCurl) library(XML)

Hello, I am looking to scrape this Webpage: http://toast.gasunie.de/gud/search.aspx?soid=GUD&lang=de The page uses the method "POST", it contains various HTML Forms, mostly lists and a couple of radio buttons. After submit, I should get forwarded to a new page. Which selections are being made in the forms does not really matter, I get quite far, pls see the code: library(RCurl)

Hi R Users, I want to get the data from the url given from 10/09/2012 to 15/10/2012. I don't know how to pass the parameters . ....................................................................................................................................... library(RHTMLForms) > > ff = getHTMLFormDescription("

Can anyone tell me from where to download the package "RHTMLForms" ? CRAN seems not holding this anymore. I am using Windows Vista OS. Thanks -- View this message in context: http://n4.nabble.com/RHTMLForms-Package-tp997672p997672.html Sent from the R help mailing list archive at Nabble.com.

Hi RUsers, Suppose I want to see the data on the website url <- "http://www.nseindia.com/content/indices/ind_histvalues.htm" for the index "S&P CNX NIFTY" for dates "FromDate"="01-11-2010","ToDate"="02-11-2010" then read the html table from the page using readHTMLtable() I am using this code webpage <-

Hi RUsers, Suppose I want to see the data on the website url <- "http://www.nseindia.com/content/indices/ind_histvalues.htm" for the index "S&P CNX NIFTY" for dates "FromDate"="01-11-2010","ToDate"="02-11-2010" then read the html table from the page using readHTMLtable() I am using this code webpage <-

The Problem ----------- After using a join in my find the id attributes set in my Entity objects are wrong! It is setting the Entity id to the value from Postcode id! The Code -------- entities = Entity.find(:all, :conditions => [...omited...], :joins => "as e inner join postcodes as pc on substring_index(e.postcode,'' '', 1) =

Dear colleagues, Could I get some assistance using postForm() to scrape the business names and addresses at this website: http://www.brantford.ca/business/LocalBusinessCommunity/Pages/BusinessDirectorySearch.aspx I've read through (http://www.omegahat.org/RCurl/RCurlJSS.pdf) and scoured the web for tutorials, but I can't crack it. I'm aware that this is probably a pretty basic

Hi, I am starting coding in r and one of the things that i want to do is to scrape some data from the web. The problem that I am having is that I cannot get passed the disclaimer page (which produces a session cookie). I have been able to collect some ideas and combine them in the code below but I dont get passed the disclaimer page. I am trying to agree the disclaimer with the postForm and write

I have a set of data that consists of a number of biological measurements. The columns are Time that runs from 01/01/2005 to 01/5/2007, Group which has 23 levels and postcode which is nested within group. This is a balanced panel but the number of postcodes differs within groups, from 15 to 400. The rest of this data consists of a number of columns of quantitative measures, largely counts.

On a relatively new Nagios 2.x / CentOS 4.x server (only like a week old), I am experiencing gd(-devel/-progs) problems and am wondering if I should just scrape and rebuild. Here is my situation: I installed LAMP+Nagios+NagiosQL and was going to install PerfParse so that I could have trending info integrated with Nagios. The configure script would run ok, but would crap out on make &&

Dear R Users, I am pleased to announce that Goodreader 0.1.1 is now available on CRAN. Goodreader offers a toolkit for scraping and analyzing book data from Goodreads. Users can search for books, scrape detailed information and reviews, perform sentiment analysis on reviews, and conduct topic modeling. Here?s a quick overview of how to use Goodreader: # Search for books AI_df <-

Dear R Users, I am pleased to announce that Goodreader 0.1.1 is now available on CRAN. Goodreader offers a toolkit for scraping and analyzing book data from Goodreads. Users can search for books, scrape detailed information and reviews, perform sentiment analysis on reviews, and conduct topic modeling. Here?s a quick overview of how to use Goodreader: # Search for books AI_df <-

hi all, I'm working on scrapping some website data to build a database. Under most cases, I can use package XML to get the dataset. However, some of the website doesn't give a explicit address of the downloaded tables. To be more specific, for example, I'm interested in the website http://ets.aeso.ca/ The data we are scraping is the "Pool Weekly Summary" under the

Hi, I''m doing one module in my site, there I need to import user blog into my site. I can use RSS feeds to read the blog information but using RSS feeds I''m not getting entire information. So, I need to scrape the user blog page. How to scrape a pages without knowing its html structure of a page? Please anyone can help me for this issue. Thanks in advance. -- You received this

http://www.skyrocketonlinemarketing.com/2010/06/20/scrape-ppc-spend-data-from-adwords-with-ruby-mechanize/ Jonathan Clarke ? Campaign Manager U365 Cell Number: +1-246-256-0770 Skype IM Chat: jonathan.clarke This message is intended only for the addressee and contains privileged and confidential information. If you have received this message in error please notify me immediately and delete the

Hey all! Just to preface, I am fairly new to RoR, and brand new to using hpricot. I am using the following code to scrape this xpath: "/html/body/div/div[5]/div/div[2]/div[2]/div[2]" from this url: "http://www.greatnonprofits.org/" Here is my code to do so (taken from igvita.com''s related blogpost): ************* require ''rubygems'' require

Hi, my name is Grant Taylor. I am a subscriber to the LARTC mail list lartc@mailman.ds9a.nl. The LARTC mail lists has been plagued with viral email coming from changing IPs in your one of your subnets. Based on the fact that the WhoIs information below says that the subnet in question is a dial up pool this would explain the changing IPs. In less than 6 days the list has received 14 viral

I am web scraping a page at http://catalog.ihsn.org/index.php/catalog#_r=&collection=&country=&dtype=&from=1890&page=1&ps=100&sid=&sk=&sort_by=nation&sort_order=&to=2017&topic=&view=s&vk= From this url, I have built up a dataframe through the following code: dflist <- map(.x = 1:417, .f = function(x) { Sys.sleep(5) url <-

Used a great howto @ http://iamrice.org/articles/2005/12/09/using-google-maps-in-the-uk-with-rails for using google maps on uk sites. Just having one issue I can''t seem to work out how to draw the postcode from my table I keep getting hit by method errors. The controller is require ''postcode_2_latlong'' postcode = Postcode.new("TN22 2LG") # I want this to