Llama Mac App Adds Request Builder for Llama.cpp REST API
Georgi Gerganov shared the update for the Llama macOS application.
TLDR
Software engineer Georgi Gerganov announced that the Llama app for Mac now comes with a simple request builder for llama.cpp's REST API. The feature generates code snippets for the API. Gerganov created llama.cpp and the ggml tensor library for efficient local LLM inference while at Hugging Face. The post on X includes a video showing the request builder in action.
Combined views
16.4K
1 Source, first seen 29d ago