For me, I'll always choose a device with standard, user-replaceable batteries over a built-in battery.
1) If the device battery is dead, I can swap it out in seconds and be up and running immediately.
2) Built-in batteries fail, and replacing them ranges from difficult to near-impossible and often involves damaging the device's casing to get the built-in battery out.
When I'm spending $100 on a computer mouse, I'd really like it to last longer than the life of the battery and not have to destroy the casing to get to the battery to replace it.