At the time it was "on GitHub" -- regardless of the presence of a LICENSE file -- was your intention that it be considered and/or treated as "open source"?
I don't use Caddy and never have so I'm mostly a disinterested third-party so it doesn't matter to me either way. I'm more curious if you honestly never intended it to be open source or if you're simply using the fact (now, later, when it's convenient) that a LICENSE file was never explicitly included as an "out".