#7 new
hayato

customizable page/link queue

Reported by hayato | August 18th, 2009 @ 05:49 PM

I suggest allowing customize queue.

Current implementation page/link queue is instance of Queue object.
But exist following use case.

  • use Message Queuing software (i.e. ActiveMQ/stomp)
  • customize order by deq method. (i.e. to alter crawling priority.)

I image attached implemantation.

Comments and changes to this ticket

Please Sign in or create a free account to add a new ticket.

With your very own profile, you can contribute to projects, track your activity, watch tickets, receive and update tickets through your email and much more.

New-ticket Create new ticket

Create your profile

Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป

Anemone is a Ruby library that makes it quick and painless to write programs that spider a website. It provides a simple DSL for performing actions on every page of a site, skipping certain URLs, and calculating the shortest path to a given page on a site.

Shared Ticket Bins

People watching this ticket

Attachments

Pages