⚡ Local Inference Recipes

Ternary Bonsai 2 27B · llama.cpp (PrismML fork) · RTX 5090 32GB

English | 简体中文 | 日本語 · ← All recipes

Source level: 📣 Claimed · Date: 2026-09-16 · Numbers come from the source. This repo did not measure them again.

Hardware

Model

Engine

Launch command

llama-cli ... -ngl 99 -fa on -c 32768 (requires the PrismML llama.cpp fork; stock llama.cpp does not work)

Excerpt from the source (includes ... or placeholders). See the source for full arguments.

Key parameters

Expected speed

Caveats

Source & attribution

Source file: recipes/hf-prism-ml-ternary-bonsai-2-27b-gguf-1.md