Lightning AI launches next-gen AI compiler ‘Thunder’ to accelerate model training

by | Mar 28, 2024 | Technology

Join us in Atlanta on April 10th and explore the landscape of security workforce. We will explore the vision, benefits, and use cases of AI for security teams. Request an invite here.

Open-source AI development platform Lightning AI, in partnership with Nvidia, announced today the release of Thunder, a source-to-source compiler for the open-source machine learning (ML) framework PyTorch. The company claims that this new offering is designed to speed up the training of AI models by using multiple GPUs to improve efficiency. 

According to Lightning AI, the compiler Thunder achieves up to a 40% speed-up for training large language models (LLMs) when compared to unoptimized code in real-world scenarios. As for pricing, the company said that Thunder is open source under an Apache 2.0 license and freely available.

Lightning AI made its presence known at Nvidia GTC, where the company has since unveiled Thunder, which could be the answer to the challenge of using GPUs to their fullest potential, rather than increasing the number of GPUs that are used. Since 2022, Lightning AI has set out to create next-generation deep learning for PyTorch that’s compatible with Nvidia’s suite of other products that include torch.compile, nvFuser, Apex, CUDA Deep Neural Network Library (cuDNN) as well as OpenAI’s Triton. 

Formerly known as Grid AI, Lightning AI – the creators of the open-source Python library PyTorch Lightning – aim to expedite workloads through its optimizations, potentially, to perform alongside other open-source communities that include Open AI, Meta AI, and Nvidia.

VB Event
The AI Impact Tour – Atlanta

Continuing our tour, we’re headed to Atlanta for the AI Impact Tour stop on April 10th. This exclusive, invite-only event, in partnership with Microsoft, will feature discussions on how generative AI is transforming the security workforce. Space is limited, so request an invite tod …

Article Attribution | Read More at Article Source

[mwai_chat context=”Let’s have a discussion about this article:nn
Join us in Atlanta on April 10th and explore the landscape of security workforce. We will explore the vision, benefits, and use cases of AI for security teams. Request an invite here.

Open-source AI development platform Lightning AI, in partnership with Nvidia, announced today the release of Thunder, a source-to-source compiler for the open-source machine learning (ML) framework PyTorch. The company claims that this new offering is designed to speed up the training of AI models by using multiple GPUs to improve efficiency. 

According to Lightning AI, the compiler Thunder achieves up to a 40% speed-up for training large language models (LLMs) when compared to unoptimized code in real-world scenarios. As for pricing, the company said that Thunder is open source under an Apache 2.0 license and freely available.

Lightning AI made its presence known at Nvidia GTC, where the company has since unveiled Thunder, which could be the answer to the challenge of using GPUs to their fullest potential, rather than increasing the number of GPUs that are used. Since 2022, Lightning AI has set out to create next-generation deep learning for PyTorch that’s compatible with Nvidia’s suite of other products that include torch.compile, nvFuser, Apex, CUDA Deep Neural Network Library (cuDNN) as well as OpenAI’s Triton. 

Formerly known as Grid AI, Lightning AI – the creators of the open-source Python library PyTorch Lightning – aim to expedite workloads through its optimizations, potentially, to perform alongside other open-source communities that include Open AI, Meta AI, and Nvidia.

VB Event
The AI Impact Tour – Atlanta

Continuing our tour, we’re headed to Atlanta for the AI Impact Tour stop on April 10th. This exclusive, invite-only event, in partnership with Microsoft, will feature discussions on how generative AI is transforming the security workforce. Space is limited, so request an invite tod …nnDiscussion:nn” ai_name=”RocketNews AI: ” start_sentence=”Can I tell you more about this article?” text_input_placeholder=”Type ‘Yes'”]

Share This