Hey all, I want to scrap some content from a website to rails application and wants to authenticate the url of the website which I want to scarp so please help me out.... Thank You!!! -- You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org For more options, visit this group at groups.google.com/group/rubyonrails-talk?hl=en.
I use Mechanize as user agent and Nokogiri as html/xml parser. mechanize.rubyforge.org nokogiri.org Mechanize supports both http- and application- layer auth, so that could be what You are looking for. -- You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org For more options, visit this group at groups.google.com/group/rubyonrails-talk?hl=en.
I don''t have a lot of experience but did some scraping recently. I used the nokogiri gem. found it to be pretty self explanatory and much easier to implement than i had anticipated. google it and i''m sure you can figure it out... Max On Dec 14, 10:07 pm, MUMU <sant...-UOy5v6Pi2oC1RDyGVJV6aQ@public.gmane.org> wrote:> Hey all, > I want to scrap some content from a website to rails application and > wants to authenticate the url of the website which I want to scarp so > please help me out.... > > Thank You!!!-- You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe@googlegroups.com. For more options, visit this group at groups.google.com/group/rubyonrails-talk?hl=en.
Thanks Dear for the information. On Fri, Dec 16, 2011 at 4:06 AM, Max <aamax-aS9lmoZGLiVWk0Htik3J/w@public.gmane.org> wrote:> I don''t have a lot of experience but did some scraping recently. I > used the nokogiri gem. found it to be pretty self explanatory and > much easier to implement than i had anticipated. google it and i''m > sure you can figure it out... > > Max > > On Dec 14, 10:07 pm, MUMU <sant...-UOy5v6Pi2oC1RDyGVJV6aQ@public.gmane.org> wrote: > > Hey all, > > I want to scrap some content from a website to rails application and > > wants to authenticate the url of the website which I want to scarp so > > please help me out.... > > > > Thank You!!! > > -- > You received this message because you are subscribed to the Google Groups > "Ruby on Rails: Talk" group. > To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org > To unsubscribe from this group, send email to > rubyonrails-talk+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org > For more options, visit this group at > groups.google.com/group/rubyonrails-talk?hl=en. > >-- You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org For more options, visit this group at groups.google.com/group/rubyonrails-talk?hl=en.
> Hey all, >Hi,> I want to scrap some content from a website to rails application and > wants to authenticate the url of the website which I want to scarp so > please help me out.... > > Mechanize, Nokogiri , Hpricot.Some examples in ruby done by me sathia27.wordpress.com/2011/09/04/version1-easy-dictionary sathia27.wordpress.com/2011/12/05/english-to-tamil-translator-script sathia27.wordpress.com/2011/09/06/tbus-version-1-search-bus-routes-from-terminal sathia27.wordpress.com/2011/05/30/update-foss-job-script -- ------------------------------------------------------------------------------------------ Regards sathia Here I share my experiments with open source. sathia27.wordpress.com <sathia27.wordpress.com>lquery.com<sathia27.wordpress.com> -- You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org For more options, visit this group at groups.google.com/group/rubyonrails-talk?hl=en.