TechRed Hat AI 3.5 adds priority-aware GPU scheduling and tenant isolation
The New Stack reports that the update targets GPU queues that can stall AI pilots and adds pre-deployment safety evaluations through EvalHub.
TLDR
The New Stack reports that Red Hat AI 3.5 brings priority-aware GPU scheduling and tenant isolation to shared infrastructure, aiming to address GPU queues that can stall AI pilots. The update also adds safety evaluations through EvalHub before deployment.
Combined views
852
1 Source, first seen 1d ago
Red Hat AI 3.5 adds priority-aware GPU scheduling and tenant isolation
The New Stack reports that the update targets GPU queues that can stall AI pilots and adds pre-deployment safety evaluations through EvalHub.
TLDR
The New Stack reports that Red Hat AI 3.5 brings priority-aware GPU scheduling and tenant isolation to shared infrastructure, aiming to address GPU queues that can stall AI pilots. The update also adds safety evaluations through EvalHub before deployment.