Digital Ocean recommends running GitLab on their $10/month instance, so while I haven't tried it, the $5 one is probably still up to the task: https://www.digitalocean.com/features/one-click-apps/gitlab/

(Full disclosure: I'm a developer at GitLab B.V.)