#7 new
hayato

customizable page/link queue

Reported by hayato | August 18th, 2009 @ 05:49 PM

I suggest allowing customize queue.

Current implementation page/link queue is instance of Queue object.
But exist following use case.

  • use Message Queuing software (i.e. ActiveMQ/stomp)
  • customize order by deq method. (i.e. to alter crawling priority.)

I image attached implemantation.

Comments and changes to this ticket

Please Sign in or create a free account to add a new ticket.

With your very own profile, you can contribute to projects, track your activity, watch tickets, receive and update tickets through your email and much more.

Create new ticket

Create your profile

Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป

Anemone is a Ruby library that makes it quick and painless to write programs that spider a website. It provides a simple DSL for performing actions on every page of a site, skipping certain URLs, and calculating the shortest path to a given page on a site.

Shared Ticket Bins

People watching this ticket

Attachments

Pages