Ruby on Rails Wednesday, January 4, 2012

Well wget has a mirror mode that will clone a website

wget --mirror http://www.example.com

or you could look at nutch (http://wiki.apache.org/nutch/) which is a
web crawler for building searches.

--
You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group.
To post to this group, send email to rubyonrails-talk@googlegroups.com.
To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/rubyonrails-talk?hl=en.

No comments:

Post a Comment