The reason why private-public key mechanism works is that it is really hard to get private key from public key. With quantum computers it is trivial task. In theory you could steal other people's bitcoins.

In reality I wouldn't be so enthusiastic about quantum computing exploding because of bitcoin. Private-public key encryption is used now everywhere and having quantum computer would give you benefit in lot of situations.