Skip to main content

llama.cpp or LM Studio

Both are great projects, one will serve a personal local ai computing , one will serve multiple purposes.

Yes, LM Studio is built on top of llama.cpp with an UI.

LM Studio: https://lmstudio.ai/

llama.cpp: https://github.com/ggerganov/llama.cpp/blob/master/docs/build.md

i personally pick llama and gguf models on hugging faces like: https://huggingface.co/TheBloke?search_models=GGUF

I use lm studio for personal usages and convenient. However, if i ever want to build something bigger, i may need something fast and lightweight like llama.cpp

see example of LM Studio:

image.png

the lm studio support api also:

image.png

LM Studio + VScode Extension

VsCode Extention called CLINE, it support api gateway to LM Studio API and many others.

image.png


Chrome Extension Project named sidellama also is built with LM Studio or ollama connection.

image.png

Next, see example of llama.cpp terminal

image.png

of course llama cli is without UI , If anyone who are serious on building for commercial purpose. llama.cpp is for faster response !