Skip to main content

AI

The AI stack provides local model hosting, chat interfaces, transcription, and text-to-speech — all self-hosted.

ServicePurpose
LibreChatChat UI — multi-provider, RAG, file uploads
OllamaLocal LLM hosting
WhisperSpeech-to-text transcription
vllmLLM inference with full tool-calling support
ChatterboxText-to-speech