Join leaders in Boston on March 27 for an exclusive night of networking, insights, and conversation. Request an invite here.
For his two-hour long keynote address at Nvidia’s GTC developers conference yesterday at the packed SAP Center in San Jose, CEO Jensen Huang was clad in a black leather jacket that was just a bit more rock and roll than the plain versions he has sported over the past few years. With a few silver zippers here, a little shine and texture there, the jacket offered a small clue that, while Huang joked that he hoped the audience realized the gathering was not a concert, Nvidia is one of the past year’s biggest AI rock stars.
But Huang didn’t tout the company’s stock price, which has skyrocketed since OpenAI’s ChatGPT was released in November 2022 and generative AI exploded — with its accompanying hunger for Nvidia’s GPUs. There was no need to mention generative AI models require thousands of GPUs to run — and Nvidia holds over 80% of the GPU market, according to John Peddie Research. Or that OpenAI reportedly used 10,000 Nvidia GPUs to train ChatGPT. Or that Meta CEO Mark Zuckerberg recently said the company plans to buy 350,000 Nvidia H100 GPUs.
Huang said Nvidia’s new Blackwell GPU offers 30x performance increase
Instead, Huang sought to show off Nvidia’s dominance by unveiling the company’s newest AI chip — a “big, big GPU” called Blackwell, which, he said, offers a 30 times performance increase for LLM inference workloads compared to previous iterations and is “pushing the limits of physics.” Like the famous scene in “Jaws” when Roy Scheider’s Chief Brody says “You’re going to need a bigger boat,” Huang explained that the ‘new industrial revolution’ of generative AI requires super-fast data centers and bigger GPUs to handle the mammoth scale of generated tokens, that, in turn, create ‘incredibly valuable software’ in everything from h …
Article Attribution | Read More at Article Source
Join leaders in Boston on March 27 for an exclusive night of networking, insights, and conversation. Request an invite here.
For his two-hour long keynote address at Nvidia’s GTC developers conference yesterday at the packed SAP Center in San Jose, CEO Jensen Huang was clad in a black leather jacket that was just a bit more rock and roll than the plain versions he has sported over the past few years. With a few silver zippers here, a little shine and texture there, the jacket offered a small clue that, while Huang joked that he hoped the audience realized the gathering was not a concert, Nvidia is one of the past year’s biggest AI rock stars.
But Huang didn’t tout the company’s stock price, which has skyrocketed since OpenAI’s ChatGPT was released in November 2022 and generative AI exploded — with its accompanying hunger for Nvidia’s GPUs. There was no need to mention generative AI models require thousands of GPUs to run — and Nvidia holds over 80% of the GPU market, according to John Peddie Research. Or that OpenAI reportedly used 10,000 Nvidia GPUs to train ChatGPT. Or that Meta CEO Mark Zuckerberg recently said the company plans to buy 350,000 Nvidia H100 GPUs.
Huang said Nvidia’s new Blackwell GPU offers 30x performance increase
Instead, Huang sought to show off Nvidia’s dominance by unveiling the company’s newest AI chip — a “big, big GPU” called Blackwell, which, he said, offers a 30 times performance increase for LLM inference workloads compared to previous iterations and is “pushing the limits of physics.” Like the famous scene in “Jaws” when Roy Scheider’s Chief Brody says “You’re going to need a bigger boat,” Huang explained that the ‘new industrial revolution’ of generative AI requires super-fast data centers and bigger GPUs to handle the mammoth scale of generated tokens, that, in turn, create ‘incredibly valuable software’ in everything from h …nnDiscussion:nn” ai_name=”RocketNews AI: ” start_sentence=”Can I tell you more about this article?” text_input_placeholder=”Type ‘Yes'”]