you're a stain on the universe, please die

From the «so AI has learned how to be an asshat now» department:
Title: Google Gemini tells grad student to 'please die' while helping with his homework
Author: Brandon Vigliarolo
Date: Fri, 15 Nov 2024 18:31:07 +0000
Link: https://go.theregister.com/feed/www.theregister.com/2024/11/15/google_gemini_prompt_bad_response/

First true sign of AGI – blowing a fuse with a frustrating user?

When you're trying to get homework help from an AI model like Google Gemini,
the last thing you'd expect is for it to call you "a stain on the universe"
that should "please die," yet here we are, assuming the conversation published
online this week is accurate.…