Self-Hosted AI Infrastructure
Pioneered and operationalized a self-hosted AI infrastructure using a dedicated local AI server (Coolify, Docker, OrangePi 5 Max). Successfully runs multiple local LLMs (Llama 3.2, DeepSeek-R1, Qwen3, etc.), embeddings, reranking, and STT/TTS services for complete data privacy and operational control.
- Docker
- Coolify
- LocalAI
- Self-Hosting
- AI Infrastructure
- Open LLMs
- Open WebUI
A self-hosted AI infrastructure using a dedicated local AI server powered by Coolify, Docker, and OrangePi 5 Max. Successfully runs multiple local LLMs (Llama 3.2, DeepSeek-R1, Qwen3, etc.), embeddings, reranking, and STT/TTS services for complete data privacy and operational control.