LocalAI
It is a drop-in replacement REST API that’s compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families that are compatible with the ggml format. Does not require GPU.
0
Tools
0
Decisions
0
Followers
Tech Stack
No tools found in this company's stack yet.
Engineering Blog
Stack Decisions
No stack decisions shared yet.