Kernels

Status

attention

Paged attention kernels from vLLM and mistral.rs.

Performance

Downloads last month
717
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support