Displaying 20 results from an estimated 1000 matches similar to: "(no subject)"
2007 Jun 26
1
(no subject)
Hello,
I am on a page that lists 78 items and can only show 25 per page, so there are links for each page of results and a "Next >" link. I''d like to get Mechanize to follow the Next link but the link looks like this:
<a class=''searchlinks'' href=''javascript:lnkclick(2);''>Next ></a>
If I try to "click" the link,
2006 Sep 18
2
BUG: Possible issue with escaped hrefs
I noticed an interesting problem today when scripting against a web
app. The application contained a link in it that used %20 instead of
spaces. After running mechanize through the Charles debugging proxy
I found that mechanize was converting %20 to %2520 (double escaping
the %20).
This appears to happen under both 0.5.4 and 0.6.0.
Here''s a simple set of files that demonstrate
2006 Sep 11
0
mechanize lists
On Mon, Sep 11, 2006 at 09:04:49AM -0400, Mat Schaffer wrote:
> I noticed that my message is the first post to mechanize-
> users at rubyforge.org. Should I post to devel? That looks empty too,
> but I thought I''d check if you were only watching the devel list and
> not the users list.
Hey Mat, this is definitely a bug in mechanize. If you add this to your
script, it
2007 Jul 15
3
rejected form not handled
Hello,
I have a login form on /login.php which POSTs to /dorf1.php when access is
granted and to /login.php when it is denied.
require ''rubygems''
require ''mechanize''
agent = WWW:Mechanize.new()
login = agent.get("http://server/login.php")
form = login.forms.action("dorf1.php")
form.fields[2].value = "wronguser" # login
2007 Jan 27
7
Getting elements from a web page
I am new to Mechanize and was wondering if there was a built-in method
to get the elements that are on the page that are not part of a form.
A couple of examples would be my banking site lists my entries and I
want them to go into an array so that I can handle them.
Or another site I use, does some categorization for me and I would like
to manipulate it and present it differently to a user.
2007 Jul 23
4
Design ideas
I''m trying to use mechanize against a site that has four fields in the
form. However, those four fields have to be filled in order.
So putting something in field one, populates the second field drop down.
So I''m thinking that I''ll probably have to call the page multiple times?
What sort of things should I be doing to figure out how to interact
with this page.
2009 Feb 13
1
error with make
Hi,
I am trying to compile the R-dev version on a unix Suse machine
and got errors.
Would someone be able to help me determine what to do to fix
these errors:
make[1]: Entering directory `/lustre/people/schaffer/R-devel/m4'
make[1]: Nothing to be done for `R'.
make[1]: Leaving directory `/lustre/people/schaffer/R-devel/m4'
make[1]: Entering directory
2009 Jun 25
2
Bad Form?
Hi,
This is my first post, I wanted to ask a quick question about "Bad Form" --
rather, am I doing something with Mechanise I shouldn''t be doing?
Here''s the long and short of it - I am using Mechanize with Cucumber and
RSpec to test a *ahem* Perl XML web service.. talk about technology soup,
but I have it working quite well.
I have an example project on GitHub that
2008 Mar 11
8
Mechanize#get vs Mechanize#fetch_page
So I found myself wanting to call Mechanize#get with a hash for
arguments like this:
WWW::Mechanize.new(''http://api.flickr.com/services/rest/'', {:method =>
''flickr.auth.getFrob''... })
Granted, it looks like this isn''t supported but it led me to what
looks like a bug. Namely that get calls fetch_page(abs_uri, request,
cur_page, &block)
2009 Mar 11
0
problem scrapping ATnT site (Matt White)
Try to use firebug to assist you finding these changes. I never used AT&T
website, but you may need to login and find the download url using firebug
as I did:
http://zenmachine.wordpress.com/2007/11/11/scraping-with-firebug-and-wwwmechanize/
regards,
gm
On Tue, Mar 10, 2009 at 4:12 PM, <mechanize-users-request at rubyforge.org>wrote:
> Send Mechanize-users mailing list submissions
2006 Sep 26
7
Interesting mechanize difficulty
I found an interesting page today that I was trying to script
against. The server returns a 404 with content and the page just
works normally in firefox despite the 404. Mechanize raises an
exception on it though.
I''m working on a test case now.
2008 Mar 15
4
[PATCH] Get requests with non-html referers
Hey, Aaron. Looks like that get with hash params patch you checked in
had some side effects. Specifically, you''re testing if a referer is a
Page (mechanize.rb:171), but the referer could also be a
WWW::Mechanize::File. Like if the last page loaded was xml. Here''s a
patch that addresses the issue.
Thanks again,
Mat
-------------- next part --------------
A non-text
2008 Mar 10
2
Mechanize for multi-part form post
Hi,
I''m interested in using Mechanize as a way around manual multipart
form creation. But the API is really centered around the idea of a
form built from a page. I''d love to see a syntax like:
response = agent.post(''http://www.mydomain.com/upload'',
:image => File.new(file),
:title => "My image",
:description => "an image
2007 Jul 02
6
Basic auth bug in 0.6.9
I haven''t spent the time to get a proper test case for this yet, but
there appears to be a bug in the basic_auth code for mechanize
0.6.9. I''ve attached a CSV (from Charles) that illustrates the problem.
Basically when running with basic_auth, there''s a failed request
that''s followed up by a successful request. That last POST is a
agent.submit(form)
2001 Sep 10
1
Multiresponse parameter estimation
I am looking for a way to do multiresponse parameter estimation for a
problem that is quite similar in form to the alpha-pinene example in Bates
and Watts (1988), p. 147, where the model is a set of ODEs. I am
specifically interested in obtaining the parameter covariance matrix, as
well. Which package(s) in R would I use to do such a thing?
Mark Schaffer
Dept. of Chemical Engineering
2007 Jul 24
3
Jruby + Rhino = Javascript support?
Hey Aaron, I''m just thinking out loud here, but have you considered
the possibility of using the Rhino [1] library to implement
javascript support in mechanize? It''d create a jruby dependency for
that feature, but still. Just thought I''d bring it up while I was
thinking about it.
-Mat
[1] http://www.mozilla.org/rhino/
2007 Jul 27
3
Is mechanize thread safe?
Hello all,
I was just wondering if anybody knew whether mechanize is supposed to
be thread-safe or not? I didn''t really find any information about it
anywhere. I''ve been getting a strange error in protocol.rb when I run
a script that uses mechanize in a multi threaded fashion, but not with
a single thread.
I''m trying to write a spider that does multiple gets in
2008 Jun 27
2
converting numbers to characters
Hi,
I need to convert numbers to characters in order
to index an array when I encountered the number
100000 which turned into "1e+05".
Does anyone know how to get around this problem?
Lana Schaffer
Biostatistics/Informatics
The Scripps Research Institute
DNA Array Core Facility
La Jolla, CA 92037
(858) 784-2263
(858) 784-2994
schaffer at scripps.edu
2008 Jul 03
1
subset function within a function
Hi,
I am using this subset statement and it works
outside a function.
LIS[[i]]<- lapply(LI, subset, select=cov[[i]])
However, wrapped inside a function this statement
produces the same values for every LIS[[1]] which
is only the first subset of LI.
Does anyone know why is not working correctly inside
a function?
ff = factor(covariate)
nLev <- nlevels(ff)
cov <-
2009 May 05
3
Only partially reading a page!
I am trying to get a page which includes a form, but the form is
missing from the WWW::Mechanize::Page object. I retrieve it via:
page = web_agent.submit(a_different_form)
For debugging this problem, I then immediately write the resulting
page to two different logs:
File.open(''big.html'',''wb'') { |f| f.write(page.body) }