similar to: utf-8 error

Hello, is there a way to make Mechanize try again whenever it receives a timeout error? Thank you Diego

Hi all, I''ve been using mechanize for a while and it rocks. Docs are pretty clear and so far I''ve been able to do it on my own. However, I''m stuck in a weird situation in a script to download my contact list from hotmail. I''ve used Firebug to check all urls, and tested it by hand while logged in via browser. Even in the script everything works well until the

Greetings, I''m using Mechanize to scrap dozens of pages and have noticed the size of my ruby process keeps growing. I set Mechanize.max_history to 0 with no effect on the memory use. I wrote a little test to show the objects left on the heap after mechanizing a single page and then doing a garbage collection. Sample list appended below. I can supply the test code if it helps.

Hi, I am trying to save a Mechanize object in database (using a Rails Model). But the save operation throws a TypeError Considering that "agent" is an instance of a Rails Model and "user" is defined as a "text" type in the Model. irb(main):039:0> agent.user = WWW::Mechanize.new #<WWW::Mechanize:0xb71295f0 @follow_meta_refresh=false, @key=nil,

hey guys, i cant seem to mechanize.get('' http://www.sephora.com/browse/product.jhtml?id=P230234''), it errors out as: /usr/local/lib/ruby/gems/1.9.1/gems/mechanize-0.9.2/lib/www/mechanize/chain/response_header_handler.rb:32:in `handle'': invalid byte sequence in UTF-8 (ArgumentError) from

hi all, in the course of my hacking i wanted to marshal mechanized objects (whether the agent, page, or other). this may be a rather particular use-case, but i figured i would report. marshalling does not work on certain objects, in particular IO objects, and since mechanized uses Net::HTTP it makes use of IO objects. so it turns out that it you just do a = WWW::Mechanize.new page = a.get

Hi all, I am so excited to use mechanize! It has opened a whole new world of projects for me :) I am trying to login into the Gmail.com server, as described in http://schf.uc.org/articles/2007/02/14/scraping-gmail-with-mechanize-and-hpricot but am running into a few issues... irb(main):010:0> page = agent.submit form EOFError: end of file reached from

I''m curious to see if anyone else has been experiencing errors such as the following at unpredictable times (usually after changing something on a page and then re-loading it in development mode): ArgumentError (negative argument): /vendor/rails/actionpack/lib/action_controller/ code_generation.rb:13:in `*'' NoMethodError (undefined method `shift'' for

Try to use firebug to assist you finding these changes. I never used AT&T website, but you may need to login and find the download url using firebug as I did: http://zenmachine.wordpress.com/2007/11/11/scraping-with-firebug-and-wwwmechanize/ regards, gm On Tue, Mar 10, 2009 at 4:12 PM, <mechanize-users-request at rubyforge.org>wrote: > Send Mechanize-users mailing list submissions

I''m running from the trunk, and hitting road blocks no matter which way I attempt to search across multiple indexes. I tried a MultiSearcher, but I can''t pass a string for the search query ms.search "iraq" TypeError: wrong argument type String (expected Data) So I tried creating a QueryParser to pass, but I can''t get the fields from the reader

I''m 99% certain that this is what''s being discussed in https://github.com/tenderlove/mechanize/issues/168 But I''m not sure what the remedy is. My production app is running on Heroku, so I need a fix that I can push there. Can someone post instructions that this neophyte can follow? (I gather I''m supposed to fork and add the current master version from

I just tried running tc_mmap.rb and noticed that something rather curious seems to happen. The call to Mmap.new in setup seems to cause the test suite to just exit without ever actually running the tests. I reduced the test suite to just this bit of code. This works, although the final test (TypeError) does not pass - no exception in thrown. This is 1.8.1 on Win2k. Any ideas? Dan PS - I

Hello, I''m trying to find a solution to convert everything returned by mechanize to utf-8, no matter if the original page is utf-8 or iso and I really don''t know where to start from... agent = WWW::Mechanize.new { |a| a.log = Logger.new(File::join(RAILS_ROOT, "log/mechanize.log")) } one_page = agent.get("www.google.fr") My first problem is that one_page

Hi all, Here''s what I''ve come up with so far for a pure Ruby Dir.glob for MS Windows. It almost works. The problem right now is the [] notation, which I''m not translating properly into a regex. I haven''t started on the ''**'' notation yet either, but I figure that''s more of a control flow issue. Feel free to disagree with me and/or

I can run this code just fine in irb, but when I run it in rails script/console, I get an error: >> res = agent.submit(search_form, search_form.buttons.first) ArgumentError: one hash required from /home/jwoods/NetBeansProjects/activista/vendor/rails/ actionmailer/lib/../../actionpack/lib/../../activesupport/lib/ active_support/core_ext/string/interpolation.rb:85:in `%''

Hi guys, I have a simple controller def gmap @intentsearches = Intentsearch.all logger.info @intentsearches respond_to do |format| format.html {render :gmap} format.xml {render :xml => @intentsearches } format.json { render :json => @intentsearches } end end and want a json response, but i do get the following error Completed 500 Internal

Hello everyone, WebFaction have just released a screencast of their control panel. The first thing you see in the screencast is how to setup your Rails site in a few clicks. Then the demo shows how you can setup a WordPress, Django and TurboGears application in a few clicks, and then "mount" these applications on various domain(s)/URL(s). The "mounting" process provides a

I''m working through an idea for a db-backed cache for Mechanize#get(). The idea is to use a Mechanize::Agent#post_connect_hook to cached any fetch data, and create a subclass of Mechanize::Agent#get() that checks the cache before calling super. I want to store the un-parsed (raw) page in the db, and call Mechanize#parse when there''s a cache hit, something along these lines:

Hello everyone, I''m scraping a lot of sites for a project, and occasionally the scraped content will have "malformed UTF-8" characters. When the scraped content is processed (basically a database record is created), these characters often don''t appear as they''re supposed to. Normally, the following code works great: str.unpack("U*").collect {|s| (s

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 What does --itemize-changes say about that file? Try using the stat command on the various copies of it to see what is different about them. On 01/09/2015 09:42 PM, Clint Olsen wrote: > Hi: > > I've been using rsync for a couple years now. Unfortunately, I've > made some changes on both ends, so it's unclear what could be