Home

DeepFinder Search Engine — Documentation

Overview

DeepFinder is a Python-based search utility for finding both common and rare websites — including deep web resources — across multiple search engines.
It supports:

• Domain exclusions
• Persistent filtering
• Rare query mode
• Automatic result opening in Brave Browser

---

Key Features

• Multi-engine search — Runs queries on Brave, DuckDuckGo, Yandex, Startpage, and Qwant.
• Domain exclusions — Use -domain to filter out unwanted sites. Example: -youtube.
• Persistent exclusions — Saved in search_exclusions.json.
• Rare site search — !rare <query> to reveal uncommon or hidden links.
• Auto-open results — Opens non-excluded results in Brave Browser tabs.

---

Configuration

Main settings:

• SAVE_FILE — Path to JSON storing excluded domains.
• BRAVE_PATH — Path to Brave Browser executable.
• USER_AGENTS — Rotating agents to bypass restrictions.
• SEARCH_ENGINES — Search engine names and URL templates.

---

Usage

🔍 Standard Search

Search normally across all engines.
Example: 'technology trends'

🚫 Excluding Domains

Prefix with - to exclude domains.
Example: 'tutorials -youtube -reddit'

🌐 Rare Site Search

Enable deep/rare mode with !rare.
Example: '!rare Github resources'

---

How It Works

1. Query Processing

   • Normal queries sent to all engines
   • Exclusions matched (exact, subdomain, fuzzy)
   • Duplicate results removed

2. Rare Mode

   • Uses patterns like .onion, “hidden wiki” queries
   • Targets unconventional or hidden domains

3. Output

   • Console logs results, filters, exclusions
   • Brave opens allowed links in tabs

---

Best Practices

• Keep the exclusion list clean for better results.
• Use rare mode sparingly to avoid detection or slowdowns.
• Vary queries to avoid IP blocks from engines.