localai

LocalAI

Licence: MIT | Language: Go | Source: https://github.com/mudler/LocalAI

Role in the stack

Drop-in OpenAI replacement for local models

Why it's here

Speaks the OpenAI API and can serve LLMs, image and audio models from one process - useful when you want one endpoint for everything.

Using it

See the project README in the fetched source:

./fetch-sources.sh ./sources
tar xzf ./sources/LocalAI.tar.gz -C ./sources

Running it

Started by docker compose up -d on port 8081.