Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
ac29
3 months ago
|
parent
|
context
|
favorite
| on:
A 10 year old Xeon is all you need
None of those settings set the speculative decoder to accept 100% of drafted token. I assume you are looking at --draft-p-min 0.0, if so, you are misunderstanding what it does.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: