Models
Hugging Face repo IDs on the chat endpoint, with context length, quantization, and price per million tokens.
| Model | Context | Quant | Input | Output | Cache | tok/s |
|---|---|---|---|---|---|---|
| 262128 | FP8 | $0.10 | $1.60 | $0.050 | 48 | |
| 1048576 | NVFP4 | $0.10$0.075 | $0.40$0.25 | $0.025$0.015 | 92 | |
100%
Uptime, last 7 days