What can you do with 51%? You can (theoretically) revert a transaction that has been confirmed, by mining blocks attached to a prior point in the blockchain and getting a longer chain than the rest of the network.
What can't you do? You can't spend someone's coins when you never had their private key to begin with. Making a transaction is an act of "signing" and public-private key cryptography is not dependent on the block chain style technique for sending messages, only for making sure that they got through and maintaining them as a ledger.
You can probably single out arbitrary transactions and make sure that those are the ones that are reversed -- your transactions, so the evidence would point back to you, and whomever accepted your bitcoins as payment for something, would potentially know it was you who wronged them.
You could also decline to single out a transaction, just reversing all transactions after a given block and starting a "new life" for all the people who spent their coins after that. When you refused to re-sign the transactions that you made, you would then out yourself.
All of this is fairly academic since the person in charge of 51% of the hash power (GHash.io owner/operator) is a known actor, the hordes have not trusted him/them anonymously, and it turns out that miners have the least incentive to perform this kind of attack, since you lose an amount of revenue equal to the contents of the number of (your) solved blocks that you reversed. They would be more likely in my opinion to accept hashes and proof of work, but then renege and refuse payment to their miners, since this is really a less sophisticated attack and either way you should lose all of your credibility as a pool operator when you are discovered.