Radio Free HPC Podcast

Forty+ different AI chips

Share!

Share this Podcast

MyCast

MyCast

MyCast Subscription

Radio Free HPC Podcast

Rich Brueckner

Description: News and commentary on high performance computing

Most Recent Post

Forty+ different AI chips

Play Download media
What are we going to do with 40+ different AI chips?This week, the team looks at AI chips again, this time motivated by an article in EE Times about once such chip, Graphcore, and touts it as "the most complex processor" ever at some 20 billion transistors. The VC-backed company out of Bristol, UK is also valued on paper at $1.7b, gaining it the coveted "unicorn" status, apparently the "only western semi-conductor unicorn".

This being one of 40+ such AI chips (and that may be conservative), the odds of success are tough and the task formidable. But even if only 2 or 3 of such chips become successful, that's already a significant disruption to the market.

The Graphcore chip is 16nm, 1.6GHz, and comes in a PCIe card at 300W. You can stack 8 of these in a 4U chassis, so 2.4 kW just for those.

After a mini-rant about respected publications succumbing to clickbaits, the team talks about how cooling will be an issue and calls again for more clarity in performance metrics since the chip is rated at 125 TFlops but we don't know at what precision. Shahin reminds the team of his suggestion to clarify things by including precision in the metric, like DFlops for double precision, and then S for single, H for half, and Q for quarter precision.

Henry talks about how hard it is to build and test complex software like this despite Shahin's view that the modern software stack is too high so the chip need only be concerned with a couple of layers, codes are new and open to getting recompiled, it's increasingly open source, cloud providers and large customers have the wherewithal to do the job, and traditional HPC customers have the willingness to do the work if performance enhancements are there.

No "Catch of the Week" this time since Henry had a hard stop. We're used to it!

Listen in to hear the full conversation.

Download the MP3 * Subscribe on iTunes * RSS Feed

Sign up for our insideHPC Newsletter

Last 5 Posts

Amdahl's Law and GPUs, Asian Student Cluster Competition

Play Download media
Results of the Asian Student Cluster CompetitionIn this episode, Dan has just come back from China and reviews the results of the Asian Student Cluster Competition and HPC workshop.For the first time, a non-mainland-Chinese team wins the top spot. Taiwan takes the gold in part by their stellar perfo...

In-Memory, Caching, Persistence

Play Download media
Asian Student Cluster CompetitionThe ever-popular "calendar segment" is back (yes, that is us being sarcastic) as Dan describes his upcoming trip to Dalian, China for the Asian Student Cluster competition. 20 teams are expected to compete, mostly from mainland China, but also from Europe, South Amer...

Black Hole Seen, with Data to Match

Play Download media
Here's this week's synopsis. Black Holes VisualizedThe news of the cool visualization of an actual black hole leads to interesting issues in HPC land. Shahin is at pains to give credit where it is due while considering it as an achievement in data visualization not unlike many others before it. Yes,...

Enterprises going HPC, Chips go Open Source, China goes for the top spot

Play Download media
We continue to want to make these introductions pretty brief here but not this time, apparently! Here's this week's synopsis. Nvidia GTC 2019 announcementsWe discussed the recent GTC conference. Dan has been attending since well before it became the big and important conference that it is today. We...

Multicore Scaling Slow Down, and Fooling AI

Play Download media
The team has an animated discussion about multicore scaling, how easy it seems to be to mislead AI systems, and some good sized catches of the week. A common thread is "data" as is often the case these days. We continue with making these introductions pretty brief here. This time, we include not onl...

Guest Book

Subscribe & Follow