Has extra KV cache on SSD, and lots more options to tweak. There's experimental ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

pornel 35 days ago | parent | context | favorite | on: Fable 5 pushed Gemma 4 to 255 tok/s on WebGPU

Has extra KV cache on SSD, and lots more options to tweak. There's experimental TurboQuant and multi token prediction support.

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact