Show HN: Offline RAG System Using Docker and Llama 3 (No Cloud APIs) https://ift.tt/SWAj76G

Show HN: Offline RAG System Using Docker and Llama 3 (No Cloud APIs) I'm sharing a fully offline RAG (Retrieval-Augmented Generation) stack I built to solve a crucial problem in industrial environments: data privacy and recurring API costs. We deal with sensitive proprietary datasheets and schematics daily, making cloud-based LLMs like ChatGPT non-compliant. The Solution: A containerized architecture that ensures data never leaves the local network. The Stack: LLM: Llama 3 (via Ollama) Vector DB: ChromaDB Deployment: Docker Compose (One-click setup) Benefit: Zero API costs, no security risks, fast local performance. The code and architecture are available here: https://ift.tt/woH6i8Z... Happy to answer questions about the GPU passthrough setup or document ingestion pipeline. https://ift.tt/mJFpW4i November 26, 2025 at 04:32AM