← Back to Projects
NestJS
React
PostgreSQL
Prisma
Docker
TypeScript
LLM Gateway
Tool
NestJSReactPostgreSQLPrismaDockerTypeScriptAbout
A self-hosted API gateway that routes requests to multiple LLM providers (Groq, Gemini, Mistral, OpenAI) with automatic fallback. Features a built-in admin dashboard for managing providers, health checks, chat playground with conversation history, and API documentation.
Architecture
NestJS backend with provider abstraction layer. OpenAI-compatible adapters for Groq, Mistral, and OpenAI, plus a dedicated Gemini adapter. Fallback router tries providers by priority. PostgreSQL stores provider configs, conversations, and health checks via Prisma ORM. React dashboard built with Vite and Tailwind CSS. Single Docker image serves both API and frontend.