1. Fail to activate
2. Fail to respond (just keep listening forever)
3. Activate on the wrong device (talking to Siri on Phone, HomePod 2 rooms over responds)
4. Fail to access data they should have ("Who is speaking?" or "I'm having trouble...")
Thinking over it, I think voice assistants have the most bugs of any technology I use daily.