If you were restoring a classic Lamborghini, you wouldn't keep the bull logo?
Most things are ugly though. The stuff people restore (like classic motorcycles) often have pretty great aesthetics and that's part of why they want to restore the object.
I guess it would depend if I have it as an investment or to drive it myself. I would certainly keep the original logos in storage for future sale anyway.