Register now for your free virtual pass to the Low-Code/No-Code Summit this November 9. Hear from executives from Service Now, Credit Karma, Stitch Fix, Appian, and more. Learn more.
Foundation models are at the vanguard of innovation in artificial intelligence (AI) today, providing new opportunities that were simply not possible even a few years ago. At Oracle CloudWorld 2022, Adept AI Labs, discussed a new foundation model the startup recently developed for enabling actions on computer systems.
With a foundation model, there is a core model — the ‘foundation’ that is trained on a massive scale and then becomes the basis for additional expansion and applications. Among the best known foundation models are OpenAI’s GPT-3 and DALL-E as well as Stability AI’s stable diffusion. Those models have enabled development of language and image applications, and now Adept shared details about its new foundation model called ACT-1.
“We started Adept in January with a team from Google, DeepMind and OpenAI and we’ve all been struck by this paradigm shift we’ve seen in the industry,” said Kelsey Szot cofounder and product lead for Adept.
The foundation model paradigm shift
Prior to the emergence of the foundation model, the primary method for building out machine learning (ML) involved training organizations and then fine-tuning models for each different use case.
Join today’s leading executives at the Low-Code/No-Code Summit virtually on November 9. Register for your free pass today.
Szot explained that with the help of transformers, which is a type of neural network, it’s possible for an organization to train a vast amount of unlabeled data that are not specific to …