Lighthouse has a new layout. Prefer the old one? Return to the old layout, and switch back any time from the link at the top of each page.

There was a problem

You must be a member of this account.

Crawl not staying on domain

#20

While running a crawl, I am sometimes getting page results from other domains. The following code:

require 'rubygems'
require 'anemone'
require 'pp'

Anemone.crawl("http://www.ou.edu/") do |a|
  a.on_every_page do |x|
   pp x.url
  end
end

checks multiple other domains and subdomains.

Reported by Luke Hartman · February 4th, 2010 @ 04:39 PM

State: resolved
Milestone: none
Assigned to: chris (at chriskite) chris (at chriskite)

Activity

  1. chris (at chriskite)
    chris (at chriskite)
    • State changed from new to open

    February 4th, 2010 @ 10:40 PM

  2. chris (at chriskite)
    chris (at chriskite)
    • State changed from open to resolved

    Resolved in 0.3.2

    February 4th, 2010 @ 11:23 PM

Please Sign in or create a free account to add a new ticket.

With your very own profile, you can contribute to projects, track your activity, watch tickets, receive and update tickets through your email and much more.