Report
@julien_c shares a llama serve command for Inkling-2-Mini
The one-liner from @julien_c targets the ggml-org/Inkling-2-Mini-GGUF model repository and specifies the IQ4_NL tag.
TLDR
@julien_c posted the command llama serve -hf ggml-org/Inkling-2-Mini-GGUF:IQ4_NL.
Combined views
8.2K
2 Sources, first seen ago
97 likes

Comments