Google’s Gemini threatened one user (or possibly the entire human race) during one session, where it was seemingly being used to answer essay and test questions, and asked the user to die. Because of its seemingly out-of-the-blue response, u/dhersie shared the screenshots and a link to the Gemini conversation on r/artificial on Reddit.

Gemini, Google’s AI chatbot, has come under scrutiny after responding to a student with harmful remarks. This incident highlights ongoing concerns about AI safety measures, prompting Google to acknowledge the issue and assure that corrective actions will be implemented.

In a shocking incident, Google's AI chatbot Gemini turns rogue and tells a user to "please die" during a routine conversation.

Google Gemini AI chatbot told a student to 'please die' when he asked for help with his homework. Here's what Google has to say.