llama.cpp or LM Studio
Both are great projects, one will serve a personal local ai computing , one will serve multiple purposes.
Yes, LM Studio is built on top of llama.cpp with an UI.
LM Studio: https://lmstudio.ai/
llama.cpp: https://github.com/ggerganov/llama.cpp/blob/master/docs/build.md
i personally pick llama and gguf models on hugging faces like: https://huggingface.co/TheBloke?search_models=GGUF
I use lm studio for personal usages and convenient. However, if i ever want to build something bigger, i may need something fast and lightweight like llama.cpp
see example of LM Studio:
the lm studio support api also:
LM Studio + VScode Extension
VsCode Extention called CLINE, it support api gateway to LM Studio API and many others.
Chrome Extension Project named sidellama also is built with LM Studio or ollama connection.
Next, see example of llama.cpp terminal
of course llama cli is without UI , If anyone who are serious on building for commercial purpose. llama.cpp is for faster response !
No Comments