There’s a configurable cap on max file size to auto-add, IIRC. It defaults to something “reasonable”.
If you do somehow add a terabyte of small files by accident, it’s still just git under the hood so you can make sure nothing active points at them and GC them.