Tools
SpiderSuite
spidersuite/SpiderSuite
SpiderSuite is a cross-platform web security crawler with a graphical interface, designed for security professionals doing reconnaissance and information gathering.
Topics
Related projects
EasySpider44.8kA free, open-source visual web scraper that lets anyone design and run data-collection tasks by clicking page elements, with optional command-line execution for embedding into other systems.
proxy_pool23.8kA self-hosted proxy IP pool for web crawlers. It periodically collects and validates free proxies and exposes them through a small HTTP API and CLI so scraping code can fetch working proxies.
katana17.8kKatana is a fast web crawling and spidering framework with standard and headless modes, JavaScript parsing, scope control, and structured output for security reconnaissance.
reconftw8.4kAn automated reconnaissance tool for security researchers that chains subdomain enumeration, vulnerability scanning, OSINT, port scanning, and fuzzing into one workflow.
TorBot5.2kTorBot is an OSINT crawler for the dark web. It crawls .onion sites, checks link liveness, builds link-relationship trees and exports JSON, with an optional desktop app and evidence-first AI analysis.
cariddi3.8kA reconnaissance CLI that crawls a list of domains and scans for endpoints, secrets, API keys, tokens and interesting file extensions, aimed at bug-bounty and red-team work.