Join us in returning to NYC on June 5th to collaborate with executive leaders in exploring comprehensive methods for auditing AI models regarding bias, performance, and ethical compliance across diverse organizations. Find out how you can attend here.
New technology means new opportunities… but also new threats. And when the technology is as complex and unfamiliar as generative AI, it can be hard to understand which is which.
Take the discussion around hallucination. In the early days of the AI rush, many people were convinced that hallucination was always an unwanted and potentially harmful behavior, something that needed to be stamped out completely. Then, the conversation changed to encompass the idea that hallucination can be valuable.
Isa Fulford of OpenAI expresses this well. “We probably don’t want models that never hallucinate, because you can think of it as the model being creative,” she points out. “We just want models that hallucinate in the right context. In some contexts, it is ok to hallucinate (for example, if you’re asking for help with creative writing or new creative ways to address a problem), while in other cases it isn’t.”
This viewpoint is now the dominant one on hallucination. And, now there is a new concept that is rising to prominence and creating plenty of fear: “Prompt injection.” This is generally defined as when users deliberately misuse or exploit an AI solution to create an unwanted outcome. And unlike most of the conversation about possible bad outcomes from AI, which tend to center on possible negative outcomes to users, this concerns risks to AI providers.
VB Event
The AI Impact Tour: The AI Audit
Join us as we return to NYC on June 5th to engage with top executive leaders, delving into strategies for auditing AI models to ensure fairness, optimal performance …
Article Attribution | Read More at Article Source
Join us in returning to NYC on June 5th to collaborate with executive leaders in exploring comprehensive methods for auditing AI models regarding bias, performance, and ethical compliance across diverse organizations. Find out how you can attend here.
New technology means new opportunities… but also new threats. And when the technology is as complex and unfamiliar as generative AI, it can be hard to understand which is which.
Take the discussion around hallucination. In the early days of the AI rush, many people were convinced that hallucination was always an unwanted and potentially harmful behavior, something that needed to be stamped out completely. Then, the conversation changed to encompass the idea that hallucination can be valuable.
Isa Fulford of OpenAI expresses this well. “We probably don’t want models that never hallucinate, because you can think of it as the model being creative,” she points out. “We just want models that hallucinate in the right context. In some contexts, it is ok to hallucinate (for example, if you’re asking for help with creative writing or new creative ways to address a problem), while in other cases it isn’t.”
This viewpoint is now the dominant one on hallucination. And, now there is a new concept that is rising to prominence and creating plenty of fear: “Prompt injection.” This is generally defined as when users deliberately misuse or exploit an AI solution to create an unwanted outcome. And unlike most of the conversation about possible bad outcomes from AI, which tend to center on possible negative outcomes to users, this concerns risks to AI providers.
VB Event
The AI Impact Tour: The AI Audit
Join us as we return to NYC on June 5th to engage with top executive leaders, delving into strategies for auditing AI models to ensure fairness, optimal performance …nnDiscussion:nn” ai_name=”RocketNews AI: ” start_sentence=”Can I tell you more about this article?” text_input_placeholder=”Type ‘Yes'”]