Skip to main content

llama.cpp or LM Studio

Both are great projects, one will serve a personal local ai computing , one will serve multiple purposes.

Yes, LM Studio is built on top of llama.cpp with an UI.

LM Studio: https://lmstudio.ai/

llama.cpp: https://github.com/ggerganov/llama.cpp/blob/master/docs/build.md

i personally pick llama and gguf models on hugging faces like: https://huggingface.co/TheBloke?search_models=GGUF

I use lm studio for personal usages and convenient. However, if i ever want to build something bigger, i may need something fast and lightweight like llama.cpp

see example of LM Studio:

image.png

the lm studio support api also:

image.png

see example of llama.cpp terminal

image.png

of course without UI , we're gonna do from crash and it has pros and cons too. Faster response !