Better output and autoupdate

New feature:

• Dependencies are now auto managed and downloaded as required

Improvements:

• Nyan logo is now colored and looks a bit better
• General output has been reworked for better readability

Crimeflare optimization/fixes + other

Crimeflare related changes

• Removed hosts from Crimeflare DB which are not hosted behind Cloudflare anymore
• Moved the DB to it's folder and added filtering scripts there
• Update.py no longer download the latest Crimeflare DB since it's never update
• The DB is loaded into memory on first use to prevent re-read for each target
• Fixed a bug where only the first IP in the DB would be scanned

Other

• Small code changes for other CDN/WAF upcoming support
• Other small code fixes, readability changes, etc

Matching engines improvements + other

Major update

Completely rewritten the matching engine.

• use http status code and reason to discard invalid match
• use HTML as a fall back to missing <title> tag
• support similar matches ratio (permit match with small differences)
• better code for future improvement
• the html tag parser is now a reusable component

Bugfixes

• app crash on some target match
• subdomain ignore --sub argument
• some output is not flushed immediately

Improvments

• code readability
• removed --scan panel (see #19)

v1.2 - dnsdumpster + bugfixes

New feature

• --scan dnsdumpster fetch subdomains and ips from the http://dnsdumpster.com and scan them.

Improvments/bugfixes

• Prevent crashes when scanning IPv6 addresses for a match
• Randomize User-Agent to prevent "smart WAF" blocking

Version 1.1 - Major bugfixes and improvements

Bugfixes

• Matching engine now follows redirect on detected IPs
• Matching engine supports invalid SSL certificates
• Hitting CTRL+C now properly stop execution
• Output register correctly when piping in terminal

Improvements

• Added some shiny stuff
• Better execution output
• Skip scanning MX records hosted outside of the scanned host
• Scan result output is now be easily parsable