I use void-linux and the only thing that i am building from source(aside from language specific pkgs) are emacs-git and st(terminal emulator).
At that time, most packages were old version on nixpkgs and some weren't available. I will look into it again, when i have the mood to switch distros.