New to Ruby: Need basic Toturial on How to use anemone to crawl a site?
Reported by Sidra | August 18th, 2011 @ 11:25 PM
Hi,
I am new to Ruby (learning Stage) and am using Anemone for crawling
a site.
1) I have use command " gem install anemone" to install anemone on
mac and receive the following response:
Fetching: nokogiri-1.5.0.gem (100%)
Building native extensions. This could take a while...
Fetching: robots-0.10.1.gem (100%)
Fetching: anemone-0.6.1.gem (100%)
Successfully installed nokogiri-1.5.0
Successfully installed robots-0.10.1
Successfully installed anemone-0.6.1
3 gems installed
Installing ri documentation for nokogiri-1.5.0...
Installing ri documentation for robots-0.10.1...
Installing ri documentation for anemone-0.6.1...
Installing RDoc documentation for nokogiri-1.5.0...
Installing RDoc documentation for robots-0.10.1...
Installing RDoc documentation for anemone-0.6.1...
2) By using "anemone url-list google.com" i have got the following
response:
macata:~ a$ anemone url-list google.com
/Users/a/.rvm/rubies/ruby-1.9.2-p290/lib/ruby/site_ruby/1.9.1/rubygems/custom_require.rb:36:in
`require': no such file to load -- openssl (LoadError)
from /Users/a/.rvm/rubies/ruby-1.9.2-p290/lib/ruby/site_ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
from /Users/a/.rvm/rubies/ruby-1.9.2-p290/lib/ruby/1.9.1/net/https.rb:92:in `<top (required)>'
from /Users/a/.rvm/rubies/ruby-1.9.2-p290/lib/ruby/site_ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
from /Users/a/.rvm/rubies/ruby-1.9.2-p290/lib/ruby/site_ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
from /Users/a/.rvm/gems/ruby-1.9.2-p290/gems/anemone-0.6.1/lib/anemone/http.rb:1:in `<top (required)>'
from /Users/a/.rvm/rubies/ruby-1.9.2-p290/lib/ruby/site_ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
from /Users/a/.rvm/rubies/ruby-1.9.2-p290/lib/ruby/site_ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
from /Users/a/.rvm/gems/ruby-1.9.2-p290/gems/anemone-0.6.1/lib/anemone/tentacle.rb:1:in `<top (required)>'
from /Users/a/.rvm/rubies/ruby-1.9.2-p290/lib/ruby/site_ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
from /Users/a/.rvm/rubies/ruby-1.9.2-p290/lib/ruby/site_ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
from /Users/a/.rvm/gems/ruby-1.9.2-p290/gems/anemone-0.6.1/lib/anemone/core.rb:3:in `<top (required)>'
from /Users/a/.rvm/rubies/ruby-1.9.2-p290/lib/ruby/site_ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
from /Users/a/.rvm/rubies/ruby-1.9.2-p290/lib/ruby/site_ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
from /Users/a/.rvm/gems/ruby-1.9.2-p290/gems/anemone-0.6.1/lib/anemone.rb:2:in `<top (required)>'
from /Users/a/.rvm/rubies/ruby-1.9.2-p290/lib/ruby/site_ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
from /Users/a/.rvm/rubies/ruby-1.9.2-p290/lib/ruby/site_ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
from /Users/a/.rvm/gems/ruby-1.9.2-p290/gems/anemone-0.6.1/lib/anemone/cli/url_list.rb:1:in `<top (required)>'
from /Users/a/.rvm/gems/ruby-1.9.2-p290/gems/anemone-0.6.1/lib/anemone/cli.rb:9:in `load'
from /Users/a/.rvm/gems/ruby-1.9.2-p290/gems/anemone-0.6.1/lib/anemone/cli.rb:9:in `run'
from /Users/a/.rvm/gems/ruby-1.9.2-p290/gems/anemone-0.6.1/bin/anemone:4:in `<top (required)>'
from /Users/a/.rvm/gems/ruby-1.9.2-p290/bin/anemone:19:in `load'
from /Users/a/.rvm/gems/ruby-1.9.2-p290/bin/anemone:19:in `<main>'
Can anyone help me in debugging whats missing while using ruby and anemone?
Comments and changes to this ticket
-
Alex Johnson November 18th, 2011 @ 02:50 AM
The error is due to ruby being installed without openssl support. To resolve this problem, you will have to remove ruby and install it again. In case you are using RVM, this is very simple.
rvm pkg install openssl rvm remove 1.9.2 rvm install 1.9.2 --with-openssl-dir=$HOME/.rvm/usr
(ps. the location is as per my linux directory structure. Adjust it according to your Mac .rvm location)
-
Alex Johnson November 18th, 2011 @ 02:52 AM
correction -- @@@ rvm pkg install openssl
rvm remove 1.9.2 rvm install 1.9.2 --with-openssl-dir=$HOME/.rvm/usr -
Alex Johnson November 18th, 2011 @ 02:54 AM
learning new markups is harrowing
rvm pkg install openssl rvm remove 1.9.2 rvm install 1.9.2 --with-openssl-dir=$HOME/.rvm/usr
Please Sign in or create a free account to add a new ticket.
With your very own profile, you can contribute to projects, track your activity, watch tickets, receive and update tickets through your email and much more.
Create new ticket
Create your profile
Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป
Anemone is a Ruby library that makes it quick and painless to write programs that spider a website. It provides a simple DSL for performing actions on every page of a site, skipping certain URLs, and calculating the shortest path to a given page on a site.
Sidra