Tiny-tpu: A minimal tensor processing unit (TPU), inspired by Google's TPU github.com 190 points by admp 13 hours ago
faangguyindia 3 hours ago Those who are expert at this, how many TPUs i need to run lets sayGemini flash 2.5 and pro 2.5 models for 1 user?
ForOldHack 3 hours ago Can I get a PCIe card with multiple units and An easy interface? Say 4 TPUs and 8 ram slots? $5,000???
mdaniel 13 hours ago Ah, and a psuedo dupe of https://news.ycombinator.com/item?id=44944592 but I'll be straight that I think the current point spread is accurate because I much prefer the repo link to some random .com domain
Relevant: https://news.ycombinator.com/item?id=44111452
Those who are expert at this, how many TPUs i need to run lets say
Gemini flash 2.5 and pro 2.5 models for 1 user?
Can I get a PCIe card with multiple units and An easy interface? Say 4 TPUs and 8 ram slots? $5,000???
Ah, and a psuedo dupe of https://news.ycombinator.com/item?id=44944592 but I'll be straight that I think the current point spread is accurate because I much prefer the repo link to some random .com domain