Lighthouse has a new layout. Prefer the old one? Return to the old layout, and switch back any time from the link at the top of each page.

limit-depth crawling

#9

I suggest to add new function to anemone.

Problem
Anemone 0.1.2 follow link in same domain. In some of the cases of root URL, Anemone crawl too many pages, and take long time.

Suggestion
Add function to Anemone to limit following link by the depth count.

I attatch concept implementation and rspec.
Please consider my suggestion.

Reported by hayato · September 6th, 2009 @ 12:31 AM

State: resolved
Milestone: none
Assigned to: chris (at chriskite) chris (at chriskite)

Activity

  1. chris (at chriskite)
    chris (at chriskite)
    • State changed from new to open
    • Assigned user set to chris (at chriskite)

    September 6th, 2009 @ 07:35 PM

  2. hayato
    hayato

    This ticket looks fixed at anemone 0.2.0.

    thanks!

    September 16th, 2009 @ 09:52 AM

  3. chris (at chriskite)
    chris (at chriskite)
    • State changed from open to resolved

    October 24th, 2009 @ 01:06 PM

Please Sign in or create a free account to add a new ticket.

With your very own profile, you can contribute to projects, track your activity, watch tickets, receive and update tickets through your email and much more.