xAI Expanding to Over 1 Million GPUs

xAI, is expanding the Colossus supercomputer in Memphis, Tennessee from 100,000 to over 1 million GPUs. This expansion, which has already started, involves a substantial financial commitment, potentially in the tens of billions, and includes collaborations with Nvidia, Dell, and Supermicro for GPU supply and server assembly. xAI’s strategy is to lead in the AI …

Read more

Nvidia Blackwell B200 Chip is 4X Faster than the H100 – 1 Exaflop in a Rack

The NVIDIA Blackwell platform was announced today. It will run real-time generative AI on trillion-parameter large language models at up to 25x less cost and energy consumption than the H100. The Blackwell GPU architecture has six transformative technologies for accelerated computing, which will help unlock breakthroughs in data processing, engineering simulation, electronic design automation, computer-aided …

Read more