Anemone: 0.5.0
chris (at chriskite)'s assigned tickets 3 tickets open
- #22 option to stop crawling no tags new
- #15 Canonicalize URLs no tags open
- #13 [patch] HTTP authentication authentication http open
Create your profile
Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป
Anemone is a Ruby library that makes it quick and painless to write programs that spider a website. It provides a simple DSL for performing actions on every page of a site, skipping certain URLs, and calculating the shortest path to a given page on a site.