Mix-Quant Delivers 3x Faster Prefilling for Agentic LLMs

Mix-Quant Quantized Prefilling, Precise Decoding for Agentic LLMs