Web Crawling in Python - Example

A simple, efficient and multi-threads web crawling in Python

So far, this application only crawling of given domain.

Bug: When the domain has ".co.za" then this application will not work.

Note: This is based on thenewboston tutorial