Yes! Remember Microsoft's chatbot Tay from 2016 that went super racist and forced MS to pull the plug?
https://money.cnn.com/2016/03/24/technology/tay-racist-micro...
Edit: A high-comment HN thread about the pulling:
https://news.ycombinator.com/item?id=11362187