Llama Mac App Adds Request Builder for Llama.cpp REST API
Georgi Gerganov shared the update for the Llama macOS application.
Software engineer Georgi Gerganov announced that the Llama app for Mac now comes with a simple request builder for llama.cpp's REST API. The feature generates code snippets for the API. Gerganov created llama.cpp and the ggml tensor library for efficient local LLM inference while at Hugging Face. The post on X includes a video showing the request builder in action.
Combined views
3.7K
1 post, first seen 2h ago
Llama Mac App Adds Request Builder for Llama.cpp REST API
Georgi Gerganov shared the update for the Llama macOS application.
Software engineer Georgi Gerganov announced that the Llama app for Mac now comes with a simple request builder for llama.cpp's REST API. The feature generates code snippets for the API. Gerganov created llama.cpp and the ggml tensor library for efficient local LLM inference while at Hugging Face. The post on X includes a video showing the request builder in action.
Reactions
1 postGG 
Georgi Gerganov@ggerganovThe Llama app for Mac now comes with a simple request builder for llama.cpp's REST API
- likes: 47
- replies: 5
- bookmarks: 8
- reposts: 2