similar to: Hpricot & mechanize fail to parse page after redirect1q

hello. This code is abort with Mechanize 0.6.4 . ---------------------------- # sample.rb require "rubygems" require "mechanize" agent = WWW::Mechanize.new agent.user_agent_alias=''Windows Mozilla'' # top page of wikipedia for japanese agent.get("http://ja.wikipedia.org/wiki/%E3%83%A1%E3%82%A4%E3%83%B3%E3%83%9A%E3%83%BC%E3%82%B8")

I just started using Mechanize, and started using Ruby about thirty seconds before that, but one of the sites I''m scraping does a redirect on form submission to a badly-formed relative URL: index.cfm?action=bing&bang=boom=1|a=|b=|c= (etc.) Interestingly, Mechanize 0.6.2 handled this OK, but in 0.6.3 this causes a URI::InvalidURIError exception from URI.parse() in to_absolute_uri

Word just came in from TorrentFreak that ThePirateBay.org have been working on a streaming video website for countless months that takes advantage of the free media formats OGG, Theora and Vorbis. While filesharing in itself is a controversial subject, this will place HTML5's <VIDEO> and <AUDIO> tag--and more importantly the OGG Theora+Vorbis multimedia format--in the

Mechanize is great! It''s better than anything I was expecting to be out there, and the syntax is really nice. I had a bit of a problem though -- following URLs with commas. The code in to_absolute_uri works great for spaces, but some pages I was working on had URLs with unescaped commas that URI rejected when I tried to click() on them. So I changed the first statement in

The problem: users trying to debug Mechanize apps with Komodo are finding the debugger times out once it''s loaded a web page. They don''t run into this in the ruby-debug debugger, or running in normal mode. The reason: Komodo''s debugger is graphical, which means that whenever it hits a breakpoint it automatically shows the contents of each local variable. It has a

hi, a potential mechanize user here. i''ve looked at the API but it''s not clear what capacity there is to arbitrarily set the headers - does mechanize allow for this? mechanize is clearly great for web browsing, but i also need to construct get and post requests from scratch. i''ve looked at net:http, libcurl, openuri, but mechanize seems simpler and more functional than

Hi everyone, I am going crazy over here! :) I just want to be able to use --clean with my mongrel_rails cluster::start command. I''ve upgraded to mongrel_cluster 1.0.1.1 and mongrel_rails 1.0.1. my config file is in /etc/mongrel_rails/config.yml and contains: --- log_file: log/mongrel.log port: 8000 pid_file: /var/run/mongrel_cluster/mongrel.pid servers: 2 address: 127.0.0.1 environment:

I''m helping with a gem that is going to published under the contentfree project on rubyforge (http://rubyforge.org/projects/contentfree/). The gem is called "blackbook" and basically it will go and fetch your contacts from the major webmail providers. So far Gmail, Yahoo!, and MSN have been completed. We are trying to finish up with fetching contacts from AOL Webmail. However

How about getting the name and value from this element object: irb(main):079:0> elements[1] => {emptyelem <input name="SNMPTrustedHost" type="hidden" value="1.2.3.4">} irb(main):080:0> elements[1].class => Hpricot::Elem If I can do that, then I''m home free. I''ve been looking at the Hpricot docs, but I''m not

I knew as soon as I hit the enter key, the intelligence would feed my brain. The answer to this is: elements[1]["value"] Easy Peasy....and why not? (there is a pun there if you can see it) Thanks for listening. Mike B. ----- Forwarded message from barjunk at attglobal.net ----- Date: Wed, 14 Mar 2007 17:49:57 -0800 From: barsalou <barjunk at attglobal.net> Reply-To:

Has anyone had this issue above with hpricot? I cannot seem to find a solution that works. -- You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org To unsubscribe from this group, send email to

Hi: Anyone had any luck with parsing Amazon Open Search XML using Hpricot?.. I am having touble with the following types (tags with : and /) of Open Search XML tags..i.e. <opensearch:totalresults>81</opensearch:totalresults> and <link />http://cnn.com <br /> abc, xyz etc.. I am getting the following error link: parse.rb:8: undefined method `innerHTML'' for

I have use hpricot to translate users'' input html. I want to remove bogusetag as follows: >>doc = Hpricot "<p> test world</b></p>", :xhtml_strict => true =>#<Hpricot::Doc {elem <p> " test world" {bogusetag </b>} </p>}> >>doc.to_s =>"<p> test world</b></p>" what I expected is

Hi, Sorry if this is not the right forum for this question. If a node is bad I''m trying to comment it out. If it''s really bad I''m trynig to delete it. The way I''m trying to do is is as follows. def this_is_a_problem doc = Hpricot( html ) doc.traverse_element do |node| if some_bad_node_test unless really_bad? node.swap( "<!-- comment

People, I enhanced http://hpricot.com and deployed it to heroku. I use hpricot.com to build and test various hpricot expressions and then run them against a variety of websites. Hpricot.com shows you the resulting html. Also hpricot.com will render the resulting html. For some development activities, hpricot.com is useful. If you have any questions, e-me. Thanks, --Dan Bikle -- You

I am trying to install some application using gem, but I keep on getting the error. I tried with ''gem clean'' and ''gem update''. The latter gives the following error (the same error is replicable when I try any ruby applications): # gem update --debug Exception `Errno::ENOENT'' at /usr/lib/ruby/site_ruby/1.8/rubygems/config_file.rb:51 - No such file or

assert_tag smells bad. Hpricot smells nice (apricotty!). Testing your views with Hpricot: http://www.lukeredpath.co.uk/index.php/2006/07/07/testing-your-rails- views-with-hpricot/ Big thanks to _why for a great little library! Feedback is appreciated. rSpec integration coming soon (hopefully!). Cheers, Luke Redpath contact@lukeredpath.co.uk -------------- next part -------------- An HTML

It looks to me that hpricot is a dependency to building rspec: euclid% rake pre_commit (in /Users/smtlaissezfaire/ruby/projects/rspec/hpricot) rake aborted! Could not find RubyGem hpricot (>= 0.0.0) /Users/smtlaissezfaire/ruby/projects/rspec/hpricot/rakefile:9 (See full trace by running task with --trace) Let me know if I''m wrong. Otherwise, I''ll submit a patch in the docs.

Hey all! Just to preface, I am fairly new to RoR, and brand new to using hpricot. I am using the following code to scrape this xpath: "/html/body/div/div[5]/div/div[2]/div[2]/div[2]" from this url: "http://www.greatnonprofits.org/" Here is my code to do so (taken from igvita.com''s related blogpost): ************* require ''rubygems'' require

This is in windows .. So from irb, I can load hpricot ok. (ruby 1.8.7) C:\Users\Laurence\rails-play\plug-test>irb irb(main):001:0> require ''hpricot'' LoadError: no such file to load -- hpricot from (irb):1:in `require'' from (irb):1 irb(main):002:0> require ''rubygems'' => true irb(main):003:0> require