Your browser is a monster of a machine, even when loading a text-only HTML page. The browser UI itself is a web application, after all.
You cannot do anything lightweight with a browser supporting, and itself being written in, web technologies.
Fragmentation is intentional. Although, nothing stops a web browser from also gaining gemini/gopher support. Just won't be "minimal".