📌Overview

Purpose: DevDocs aims to significantly reduce the time spent on understanding and utilizing technical documentation, streamlining the development process for software engineers and teams.

Overview: DevDocs is a powerful documentation retrieval framework designed to facilitate quick access to and understanding of technology documentation. By automating the extraction and organization of content, it enables developers to focus on implementation rather than research, transforming weeks of effort into mere hours of productive work.

Key Features:

Intelligent Crawling: Employs smart depth control for link discovery and categorization, allowing selective extraction of relevant information and automatic mapping of website structures.
Performance & Speed: Offers parallel processing capabilities, smart caching, and lazy loading support, thus optimizing the crawling experience while ensuring respectful adherence to server load limitations.
Content Processing: Delivers clean extraction of content in multiple formats (MD, JSON), organizes it logically, and integrates seamlessly with MCP servers for AI processing.
Enterprise Features: Includes robust error recovery, full operational logging, API access for tool integration, and team management capabilities for effective collaboration.

DevDocs by CyberAGI 🚀

Turn Weeks of Documentation Research into Hours of Productive Development

🎯 Perfect For

🏢 Enterprise Software Developers

Implement ANY technology faster by letting DevDocs handle documentation understanding.

🕸️ Web Scrapers

Pull entire contents of websites with intelligent crawling for documentation.

👥 Development Teams

Leverage internal documentation and transform your team's knowledge base into an actionable resource.

🚀 Indie Hackers

Ship products fast with ANY technology without getting stuck in documentation.

✨ Features

🧠 Intelligent Crawling

Smart Depth Control: Choose crawl depth from 1-5 levels
Automatic Link Discovery: Finds and categorizes related content
Selective Crawling: Pick exactly what to extract

⚡ Performance & Speed

Parallel Processing: Crawl multiple pages simultaneously
Smart Caching: Prevents duplicate content

🎯 Content Processing

Clean Extraction: Get content without fluff
Multiple Formats: Export to MD or JSON

🛡️ Enterprise Features

API Access: Integrate with your tools
Team Management: Support for multiple roles

🤔 Why DevDocs?

Documentation is plentiful, but outdated for LLMs. DevDocs reduces weeks of research to hours by organizing and extracting useful content efficiently.

💰 Pricing Comparison

Feature	DevDocs	Firecrawl
Free Tier	Unlimited pages	None
Starting Price	Free Forever	$16/month
Crawl Speed	1000/min	20/min
Team Seats	Unlimited	1-5 seats
Export Formats	MD, JSON	Limited formats
Support	Priority via Discord	Standard only
Self-hosted (free use)	✅	❌

🚀 Getting Started

DevDocs is easy to use with Docker.

Prerequisites

Docker installed
Git for cloning the repository

Quick Start with Docker

For Mac/Linux users:

git clone https://github.com/cyberagiinc/DevDocs.git
cd DevDocs
./docker-start.sh

For Windows users:

git clone https://github.com/cyberagiinc/DevDocs.git
cd DevDocs
docker-start.bat

Accessing DevDocs

Frontend UI: http://localhost:3001
Backend API: http://localhost:24125

Logs and Monitoring

View logs from specific containers for debugging:

docker logs devdocs-frontend
docker logs devdocs-backend

📜 Scripts and Their Purpose

DevDocs includes utility scripts for development, testing, and maintenance.

Startup Scripts

docker-start.sh / docker-start.bat: Start all services using Docker.

Utility Scripts

view_result.sh: Display crawl results.

🌍 Built for Developers, by Developers

DevDocs saves time, improves understanding, enables innovation, and supports teams.

🤝 Join Our Community

🏆 Success Stories

"DevDocs turned our 3-week implementation timeline into 2 days." - Senior Engineer at Fortune 100 Company

"Launched my SaaS in half the time using DevDocs." - Successful Indie Hacker