An Australian themed keyword web crawler for your mates.
Our mate Mitch is a Chief Executive Mate. He wanted a web crawler to generate a list of keywords from potential customer websites. So we gave it a burl. Meet Krawlah.
git clone https://github.com/OzGuild/krawlah
cd krawlah
bundle install
- Ruby (>= 2)
- bundler
- colorize
- nokogiri
- actionview
- thor
- open_uri_redirections
./krawlah krawl example.com [--depth=N] # Default: 3
OzGuild Pty. Ltd. wrote this file. As long as you retain this notice you can do whatever you want with this stuff. If we meet some day, and you think this stuff is worth it, you can buy us a beer in return. OzGuild Admin