Displaying 1 result from an estimated 1 matches for "1_page_3".
Did you mean:
_page_3
2005 Jun 06
1
Rails spider/site copy with internal web requests
Hi all,
On a related topic to Web spidering, I would like to solve a problem
of internally spidering and saving a Rails application from within
rails.
The goal is to spider and save each resource in a site to a
filesystem friendly structure
/many/things/1?page=3 -> many_things_1_page_3.html
or /many/things/1?page=3 -> many/things/1_page_3.html
If a redirect is created from an action, hash and follow the
redirected resource, serializing it if it hasn''t been seen before.
Assuming that all links are generated and indexable through an API
such as "url_for&qu...