I actually had no idea anyone had trouble with those countries until I visited Vienna and the tourist shops had a bunch of ironic t-shirts with Kangaroos and boomerangs on them and stuff.
Maybe it was because I was in "speaking German" mode, so Austria is "Österriech" vs Australia is "Australien".