I’m surprised we haven’t seen TPU cards (think Coral AI but at a larger scale) being made and sold for this purpose, especially if they’re faster and more energy efficient at AI-oriented tasks than GPUs.
Well there is the asus AI Accelerator card but that’s just 8 coral TPUs. I think the real reason why we don’t see large TPUs is because nvidia cards has had tensor cores built into the architect since Volta and with a GPU you don’t have to worry about system memory speed since you have 80Gb of HBM.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]
No game suggestions, friend requests, surveys, or begging.
No Let’s Plays, streams, highlight reels/montages, random videos or shorts.
No off-topic posts/comments, within reason.
Use the original source, no clickbait titles, no duplicates.
(Submissions should be from the original source if possible, unless from paywalled or non-english sources.
If the title is clickbait or lacks context you may lightly edit the title.)
I’m surprised we haven’t seen TPU cards (think Coral AI but at a larger scale) being made and sold for this purpose, especially if they’re faster and more energy efficient at AI-oriented tasks than GPUs.
Well there is the asus AI Accelerator card but that’s just 8 coral TPUs. I think the real reason why we don’t see large TPUs is because nvidia cards has had tensor cores built into the architect since Volta and with a GPU you don’t have to worry about system memory speed since you have 80Gb of HBM.