Anemone doesn't follow frame URLs
Reported by Noah Gibbs | December 26th, 2009 @ 05:28 PM
I'm writing a simple spider to save bits of "http://api.rubyonrails.org". The top level page is a frameset, and links to a (nonexistent) HTML-only bit. It'd be nice if I could tell anemone to spider the frameset automatically, rather than having to do it manually.
Comments and changes to this ticket
-
chris (at chriskite) January 22nd, 2010 @ 08:12 PM
- State changed from new to open
- Assigned user set to chris (at chriskite)
Please Sign in or create a free account to add a new ticket.
With your very own profile, you can contribute to projects, track your activity, watch tickets, receive and update tickets through your email and much more.
Create your profile
Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป
Anemone is a Ruby library that makes it quick and painless to write programs that spider a website. It provides a simple DSL for performing actions on every page of a site, skipping certain URLs, and calculating the shortest path to a given page on a site.