Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You're arguing for a very specific range of weights but many slightly smaller and slightly larger models have been released including QAT and MoE versions.

An old nVidia brand card with 8GB is more than enough to see those models running at usable speeds and accuracy.



I wasn't arguing for or against anything, just trying to help answer the person's question.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: