"The hardest thing for a casual user to learn would be "sudo apt-get install" and then guessing what the package name is that they might want to download, like vlcplayer or java"

Everything you said in this sentence is a deal breaker for a casual user, and a terrible user experience in general.