Agent tools
crawl4ai
unclecode/crawl4ai
Offers an open-source, large-language-model-friendly web crawler and scraper that extracts clean, structured data for retrieval-augmented generation and autonomous agent pipelines.
Related projects
firecrawl183.6kWeb data API designed for AI agents and developers to search, scrape, crawl, and extract structured data from websites at scale, returning clean Markdown and JSON ready for retrieval and downstream processing.
browser-use116kOpen-source library enabling AI agents to operate web browsers like humans, providing automated browsing and task execution for web automation workflows.
claude-mem94.5kPersistent memory system for coding agents that captures session activity, compresses it with AI, and injects relevant context into future sessions across Claude Code, Codex, Gemini, and others.
ragflow91.2kOpen-source Retrieval-Augmented Generation engine combining document parsing, retrieval, and agent capabilities to provide a context layer for enterprise LLM applications.