I had a pretty comprehensive vim config that I used for both neovim and vim, and had held off on migrating to lua, because of the effort involved, and because all the other neovim starter packs are huge and very opinionated.
kickstart.nvim is a perfect starting point IMHO. It's just enough to have everything included but without all of the bells and whistles allowing one to replace whatever component they want.
One thing I didn't know is that neovim in pure lua seems to be a lot faster than the vimscript plugins. I assume that it's related to neovim compiling those lua modules to bytecode. Before I migrated to lua, I kept going back to vim.