Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
ul5255
20 days ago
|
parent
|
context
|
favorite
| on:
Mesh LLM: distributed AI computing on iroh
I’m staring at this comment for a while now: With 3ms latency combined per token, wouldn’t that mean (1 / latency) = 333 token/s for the theoretical upper bound? I’m not trying to nitpick, just curious if I misunderstand something.
stymaar
20 days ago
[–]
Indeed, I completely screwed my math up. Looks like 10am is too early in the morning for a Sunday.
33 tps max token generation speed would be for 10ms of network latency in the above example.
Consider applying for YC's Fall 2026 batch!
Applications
are open till July 27.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: