Join leaders in Boston on March 27 for an exclusive night of networking, insights, and conversation. Request an invite here.
For businesses seeking to deploy AI models in their operations — either for employees or customers to use — one of the most critical questions isn’t even what model or what to use it for, but when their chosen model is safe to deploy.
How much testing on the backend is necessary? What kinds of tests should be run? After all, most companies would presumably like to avoid the kind of embarrassing (yet humorous) mishaps we’ve seen with some car dealerships using ChatGPT for customer support, only to find users tricking them into agreeing to sell cars for $1.
Knowing just how to test models, and especially fine-tuned versions of AI models, could be the difference between a successful deployment and one that falls flat on its face and costs the company its reputation, and financially. Kolena, a three-year-old startup based in San Francisco co-founded by a former Amazon senior engineering manager, today announced the wide release of its AI Quality Platform, a web application designed to “enable rapid, accurate testing and validation of AI systems.”
This includes monitoring “data quality, model testing and A/B testing, as well as monitoring for data drift and model degradation over time.” It also offers debugging.
VB Event
The AI Impact Tour – Boston
We’re excited for the next stop on the AI Impact Tour in Boston on March 27th. This exclusive, invite-only event, in partnership with Microsoft, will feature discussions on best practices for data integrity in 2024 and beyond. Space is limited, so request an invite today.
Request an invite
…
Article Attribution | Read More at Article Source
Join leaders in Boston on March 27 for an exclusive night of networking, insights, and conversation. Request an invite here.
For businesses seeking to deploy AI models in their operations — either for employees or customers to use — one of the most critical questions isn’t even what model or what to use it for, but when their chosen model is safe to deploy.
How much testing on the backend is necessary? What kinds of tests should be run? After all, most companies would presumably like to avoid the kind of embarrassing (yet humorous) mishaps we’ve seen with some car dealerships using ChatGPT for customer support, only to find users tricking them into agreeing to sell cars for $1.
Knowing just how to test models, and especially fine-tuned versions of AI models, could be the difference between a successful deployment and one that falls flat on its face and costs the company its reputation, and financially. Kolena, a three-year-old startup based in San Francisco co-founded by a former Amazon senior engineering manager, today announced the wide release of its AI Quality Platform, a web application designed to “enable rapid, accurate testing and validation of AI systems.”
This includes monitoring “data quality, model testing and A/B testing, as well as monitoring for data drift and model degradation over time.” It also offers debugging.
VB Event
The AI Impact Tour – Boston
We’re excited for the next stop on the AI Impact Tour in Boston on March 27th. This exclusive, invite-only event, in partnership with Microsoft, will feature discussions on best practices for data integrity in 2024 and beyond. Space is limited, so request an invite today.
Request an invite
…nnDiscussion:nn” ai_name=”RocketNews AI: ” start_sentence=”Can I tell you more about this article?” text_input_placeholder=”Type ‘Yes'”]