You're correct that there does seem to be a layer lower than that—one that can materialize as either a native or a second language—but it's not inaccurate to talk about which language we "think" in because many of us actually do constantly materialize thoughts as language without any intention of speaking them.