Lighthouse has a new layout. Prefer the old one? Return to the old layout, and switch back any time from the link at the top of each page.

michael.harrington

michael.harrington

Not a member

michael.harrington's latest activity

Friday, July 30 2010
33 Timeouts bubble up through rescue blocks and kill tentacles was created in Anemone
  • michael.harrington
    michael.harrington created the ticket at 12:39 PM

    The thread body of the tentacle looks like this:

        def run
      loop do
        link, referer, depth = @link_queue.deq

        break if link == :END

     ...
Thursday, July 29 2010
26 Illegal instruction was updated in Anemone
  • michael.harrington
    • Milestone order changed from 0 to 0
    by michael.harrington at 10:06 AM

    I'm having this same issue.
30 No response code or referer after running for hours was updated in Anemone
  • michael.harrington
    michael.harrington commented at 10:05 AM

    I changed my crawl to use 2 threads and discard page bodies, which appears to avoid this issue.
Monday, July 26 2010
30 No response code or referer after running for hours was created in Anemone
  • michael.harrington
    michael.harrington created the ticket at 1:09 PM

    OS X Snow Leopard
    Ruby 1.8.7 (System Ruby)

    require 'rubygems'
require 'bundler'
Bundler.setup
require 'anemone'

files = {}

Anemone.crawl 'http://local.acton....