‘Want to give more control…’ Sam Altman responds to ChatGPT DAN jailbreak

In a conversation with computer scientist and podcaster Lex Friedman, Altman said, “We want users to have a lot of control and get the model to behave the way they want within some very broad bounds.”

Also Read: These jobs are most at risk due to ChatGPT, as per OpenAI study

Explaining the reason for users to jailbreak ChatGPT, Altman said, “I think the whole reason for jailbreaking is right now, we haven’t yet figured out how to like give that to people. And the more we solve that problem, I think the less need there will be for jailbreaking.” 

The OpenAI CEO also shared his experience with jailbreaking the first-generation iPhone at a very early stage in his life. He said, “ You know, when I was a kid basically I got twice on jailbreaking an iPhone, the first iPhone I think and I thought it was so cool.”

The new comments from the OpenAI boss come at a time when users have been experimenting with ChatGPT in a bid to ‘jailbreak’ it. Users have been giving ChatGPT prompts about behaving like a ‘DAN’  or Do Anything Now chatbot. Once in its DAN avatar, ChatGPT is able to speak about things that the chatbot usually doesn’t respond to claiming it’s just a language model. 

Also Read: GPT-4 takes the world by storm – List of companies that integrated the chatbot

Recently, ChatGPT unveiled its newest and most powerful yet language model GPT-4 which has the ability to take inputs in text as well as image format. The company claims GPT-4 comes in the top 10 percent of candidates appearing for competitive exams in the US. 

On March 23, OpenAI unveiled plugins for ChatGPT which will allow users to access the internet, shop using the chatbot and much more.

OpenAI’s technology has single-handedly helped kick off a tech race between Microsoft and Google. Both companies are trying to gain an edge in the conversational chatbot space.