Chat With Ollama

Chat With Ollama

Chat With Ollama

Open-Source RAG Powered AI Chat AgentChat With Ollama

A modern, RAG-powered AI chat application that integrates with Ollama for local AI inference. Chat with various Ollama models while leveraging your own documents for context-aware, intelligent responses.

🆓 Free & Open Source

Perfect for individuals and developers who want privacy-first AI chat with local models.

🤖 AI Chat Interface
  • Multiple Model Support: Chat with any Ollama model installed on your server

  • Session Management: Organize conversations into separate chat sessions

  • Markdown Rendering: Beautifully formatted responses with code blocks and structured content

  • Real-time Processing: Visual feedback during AI processing

📄 Document Management & RAG
  • Document Upload: Support for PDF, DOCX, TXT, Markdown, PPT, PPTX, XLSX, and CSV files

  • Automatic Processing: Documents are automatically chunked and embedded for RAG

  • Document-Specific Chats: Create focused chat sessions linked to specific documents

  • @ Mentions: Reference specific documents in any chat using @documentId

  • Status Tracking: Real-time status updates (pending, processing, processed, error)

🔍 Smart Search & Filtering
  • Full-Text Search: Fast search across document names, types, and content

  • Advanced Filtering: Filter by status, file type, and more

  • Indexed Search: Optimized search performance with built-in indexing

⚙️ Settings & Customization
  • Model Management: Sync and manage Ollama models from settings

  • Timezone Support: Select from all IANA timezones

  • RAG Toggle: Enable/disable RAG on a per-message basis

  • Default Settings: Save preferences for model, RAG, and date/time formats

🎨 Modern UI/UX
  • Dark Theme: Beautiful dark mode interface with glassmorphism effects

  • Responsive Design: Works seamlessly on desktop and mobile devices

  • Moder Dash-Inspired: Modern UI patterns with circular action buttons and glass cards

Technical Requirements
  • PHP: 8.1 or higher

  • Ollama: Installed and running locally or remotely

  • Extensions: PDO with SQLite, cURL, ZIP, GD/ImageMagick (optional)

  • Composer: For dependency management

  • Web Server: Apache/Nginx with mod_rewrite

RAG Workflow
  1. The Retrieval-Augmented Generation system provides intelligent document context:
  2. Document Upload: Upload your document (PDF, DOCX, etc.)
  3. Text Extraction: Content is extracted from the file
  4. Chunking: Text is split into overlapping chunks (1000 chars with 200 char overlap)
  5. Embedding: Each chunk is converted to vector embeddings using nomic-embed-text
  6. Storage: Embeddings are stored in SQLite database
  7. Query Processing: When you ask a question, relevant chunks are retrieved and used as context
Enterprise Solution

💡 Looking for Multi-Provider Support?
Check out NexusAI Chat – Our premium enterprise solution with support for Ollama, DeepSeek, OpenAI, Anthropic, and much more!

Free vs Premium

Chat with Ollama (Free Edition)

  • ✅ Ollama integration (local AI)

  • ✅ RAG with document support

  • ✅ Session management

  • ✅ Open source (MIT License)

  • ✅ Community support

NexusAI Chat (Premium)

  • ✅ All free features, plus:

  • ✅ Multi-provider support (DeepSeek, OpenAI, Anthropic, and more)

  • ✅ Team collaboration

  • ✅ Advanced analytics

  • ✅ Enterprise features

  • ✅ Priority support

Technologies Used

  • Backend: PHP 8.1+, SQLite

  • Frontend: Vanilla JavaScript, Axios, Bootstrap 5

  • AI: Ollama (local AI inference)

  • Embeddings: nomic-embed-text model

  • Styling: Custom CSS with CSS Variables, Glassmorphism

Download & Get Started

  • Free Download: Available on GitHub under MIT License
  • Documentation: Comprehensive guides and troubleshooting
  • Community Support: Active GitHub discussions and issue tracking

Contact UsProfessional web development, AI integrations, and premium solutions for your business needs.

Have a project in mind ?
Feel free to Approach us for your next bespoke development

Call
Our Location
Email

Beirut,
Lebanon

Follow us

Get in Touch

Define your goals and we’ll show how our tools can elevate your business.
Please enable JavaScript in your browser to complete this form.
Solution(s) Interested In