Open-Source RAG Powered AI Chat AgentChat With Ollama
A modern, RAG-powered AI chat application that integrates with Ollama for local AI inference. Chat with various Ollama models while leveraging your own documents for context-aware, intelligent responses.
🤖 AI Chat Interface
Multiple Model Support: Chat with any Ollama model installed on your server
Session Management: Organize conversations into separate chat sessions
Markdown Rendering: Beautifully formatted responses with code blocks and structured content
Real-time Processing: Visual feedback during AI processing
📄 Document Management & RAG
Document Upload: Support for PDF, DOCX, TXT, Markdown, PPT, PPTX, XLSX, and CSV files
Automatic Processing: Documents are automatically chunked and embedded for RAG
Document-Specific Chats: Create focused chat sessions linked to specific documents
@ Mentions: Reference specific documents in any chat using @documentId
Status Tracking: Real-time status updates (pending, processing, processed, error)
RAG Workflow
- The Retrieval-Augmented Generation system provides intelligent document context:
- Document Upload: Upload your document (PDF, DOCX, etc.)
- Text Extraction: Content is extracted from the file
- Chunking: Text is split into overlapping chunks (1000 chars with 200 char overlap)
- Embedding: Each chunk is converted to vector embeddings using nomic-embed-text
- Storage: Embeddings are stored in SQLite database
- Query Processing: When you ask a question, relevant chunks are retrieved and used as context
Enterprise Solution
💡 Looking for Multi-Provider Support?
Check out NexusAI Chat – Our premium enterprise solution with support for Ollama, DeepSeek, OpenAI, Anthropic, and much more!
Free vs Premium
Chat with Ollama (Free Edition)
✅ Ollama integration (local AI)
✅ RAG with document support
✅ Session management
✅ Open source (MIT License)
✅ Community support
NexusAI Chat (Premium)
✅ All free features, plus:
✅ Multi-provider support (DeepSeek, OpenAI, Anthropic, and more)
✅ Team collaboration
✅ Advanced analytics
✅ Enterprise features
✅ Priority support
Technologies Used
Backend: PHP 8.1+, SQLite
Frontend: Vanilla JavaScript, Axios, Bootstrap 5
AI: Ollama (local AI inference)
Embeddings: nomic-embed-text model
Styling: Custom CSS with CSS Variables, Glassmorphism
Download & Get Started
- Free Download: Available on GitHub under MIT License
- Documentation: Comprehensive guides and troubleshooting
- Community Support: Active GitHub discussions and issue tracking
Contact UsProfessional web development, AI integrations, and premium solutions for your business needs.
Have a project in mind ?
Feel free to Approach us for your next bespoke development
Call
Our Location
Beirut,
Lebanon
