The trickiest questions were relational questions (e.g. What's heavier, a pineapple or a Siamese cat?). Would appreciate any feedback on our approach (and happy to answer questions!).
We're also using a more sophisticated approach than most bots I've read about, and we continuously train out model on new data. Even so, we would only expect to win 7 out of 100 games.
Our goal was not to hurt the HQ community, but rather to challenge ourselves into solving a difficult data science problem.
Joking aside, I'd say HQ Trivia are getting savvier with the questions. A final question the other day was along the lines of "Which two female artists collectively have the same number of Grammys as Beyoncé?" with the answer being "Adele + Madonna", I believe.
Those are generally rare questions though because difficult questions for bots are also difficult questions for humans. HQ can't have too many of those questions without degrading the player experience.
Because of that, I don't think we will ever get beyond 10/11 questions right per game. That still leads to a decent chance at winning at least one game per week though.
You are right about the experience issue, though. It feels almost like they're trying to make it so you can't win with questions worded in that way, since even someone who actually knew the numbers of Grammys all the artists listed had would struggle to add them together in time.