bdeb1337
bb71b49fde
Streams replies over SSE from any OpenAI-compatible server (oMLX, llama.cpp, Ollama, ...). Single binary that can install itself as an OS service; docker compose bundles llama.cpp + Gemma 4 E2B.
7 lines
39 B
Plaintext
7 lines
39 B
Plaintext
bin/
|
|
.env
|
|
*.local
|
|
dist/
|
|
dev/
|
|
.DS_Store
|