Depending on the complexity I imagine fonts would also be smaller than corresponding bitmaps although I never actually checked.
http://caniuse.com/#feat=svg-img
You do miss out on the recoloring and any other font styling options though.
#yourSVG { fill: red; stroke: blue; }
http://www.pixelambacht.nl/2014/multicolor-icons/