This is the repository card of {repo_id} that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated.

How to use

# make sure `kernels` is installed: `pip install -U kernels`
from kernels import get_kernel

kernel_module = get_kernel("REPO_ID") # <- change the ID if needed
silu_and_mul = kernel_module.silu_and_mul

silu_and_mul(...)

Available functions

  • silu_and_mul
  • mul_and_silu
  • gelu_and_mul
  • gelu_tanh_and_mul
  • fatrelu_and_mul
  • gelu_fast
  • gelu_new
  • gelu_quick
  • gelu_tanh
  • silu
  • gelu
  • layers

Supported backends

  • cuda

Benchmarks

[TODO: provide benchmarks if available]

Code source

[TODO: provide original code source and other relevant citations if available]

Notes

[TODO: provide additional notes about this kernel if needed]

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support