Well, no one wants a 32-bit web browser, and IrfanView 32-bit cannot handle large files well, I can't remember if the JRE has a 64-bit mode in the free edition but probably not.

In general you will also lose stability and/or performance with complex or intensive applications. For many suites like GIMP, Blender and LibreOffice this is a deal-breaker for me.