Join leaders in Boston on March 27 for an exclusive night of networking, insights, and conversation. Request an invite here.
Stability AI is growing its generative AI model portfolio today with the release of Stable Video 3D (SV3D).
As the name implies, the new model is a gen AI video tool for rendering 3D video. Stability AI has been developing video capabilities with its Stable Video technology that enables users to generate short video from an image or text prompt. SV3D builds upon Stability AI’s previous Stable Video Diffusion model, adapting it for the task of novel view synthesis and 3D generation.
With SV3D, Stability AI is adding new depth to its video generation model with the ability to create and transform multi-view 3D meshes from a single input image.
SV3D is now available for commercial use with a Stability AI Professional Membership ($20 per month for creators and developers with less than $1 million in annual revenue). For non-commercial purposes, users can download the model weights from Hugging Face.
VB Event
The AI Impact Tour – Atlanta
Continuing our tour, we’re headed to Atlanta for the AI Impact Tour stop on April 10th. This exclusive, invite-only event, in partnership with Microsoft, will feature discussions on how generative AI is transforming the security workforce. Space is limited, so request an invite today.
Request an invite
Here’s an example video I generated quickly. As you’ll see, despite some slight distortions, the forms of all the objects in the video remain markedly coherent and solid even as the camera rotates around them.
Game creation, e-commerce cited as target use cases
“By adapting our Stable Video Diffusion image-to-video diffusion model with the addition of camera path conditioning, Stable Video 3D is able to generate multi-view videos of an object,” the company wrote in a blog post detailing the new model.
“Stable Video 3D is a valuable tool for generating 3D assets, especially within the gaming sector,” Varun Jampani, lead researcher at Stability AI told VentureBeat. “Additionally, it enables the production of 360-degree orbital videos, which are useful in e-commerce, providing a more immersive and interactive shopping experience.”
From Stable Zero123 to SV3D
Stability AI is perhaps best known for its Stable Diffusion text-to-image gen AI models which include SDXL and the Stable Diffusion 3.0, the latter still in early research preview. Stable Diffusion 1.5 is an open source image generation model that forms the basis of many other AI image generation and video products, including Runway and Leonardo AI.
Back in December 2023, the Stable Zero123 model was released, offering new capabilities for building …
Article Attribution | Read More at Article Source
Join leaders in Boston on March 27 for an exclusive night of networking, insights, and conversation. Request an invite here.
Stability AI is growing its generative AI model portfolio today with the release of Stable Video 3D (SV3D).
As the name implies, the new model is a gen AI video tool for rendering 3D video. Stability AI has been developing video capabilities with its Stable Video technology that enables users to generate short video from an image or text prompt. SV3D builds upon Stability AI’s previous Stable Video Diffusion model, adapting it for the task of novel view synthesis and 3D generation.
With SV3D, Stability AI is adding new depth to its video generation model with the ability to create and transform multi-view 3D meshes from a single input image.
SV3D is now available for commercial use with a Stability AI Professional Membership ($20 per month for creators and developers with less than $1 million in annual revenue). For non-commercial purposes, users can download the model weights from Hugging Face.
VB Event
The AI Impact Tour – Atlanta
Continuing our tour, we’re headed to Atlanta for the AI Impact Tour stop on April 10th. This exclusive, invite-only event, in partnership with Microsoft, will feature discussions on how generative AI is transforming the security workforce. Space is limited, so request an invite today.
Request an invite
Here’s an example video I generated quickly. As you’ll see, despite some slight distortions, the forms of all the objects in the video remain markedly coherent and solid even as the camera rotates around them.
Game creation, e-commerce cited as target use cases
“By adapting our Stable Video Diffusion image-to-video diffusion model with the addition of camera path conditioning, Stable Video 3D is able to generate multi-view videos of an object,” the company wrote in a blog post detailing the new model.
“Stable Video 3D is a valuable tool for generating 3D assets, especially within the gaming sector,” Varun Jampani, lead researcher at Stability AI told VentureBeat. “Additionally, it enables the production of 360-degree orbital videos, which are useful in e-commerce, providing a more immersive and interactive shopping experience.”
From Stable Zero123 to SV3D
Stability AI is perhaps best known for its Stable Diffusion text-to-image gen AI models which include SDXL and the Stable Diffusion 3.0, the latter still in early research preview. Stable Diffusion 1.5 is an open source image generation model that forms the basis of many other AI image generation and video products, including Runway and Leonardo AI.
Back in December 2023, the Stable Zero123 model was released, offering new capabilities for building …nnDiscussion:nn” ai_name=”RocketNews AI: ” start_sentence=”Can I tell you more about this article?” text_input_placeholder=”Type ‘Yes'”]