Note that your interpretation cuts two ways. If the framers were not referring to some pre existing legal concept, and instead just meant literal speech, then a lot of the decisions expanding that concept are invalid too. Publishing a book, for example, has been interpreted as part of the "freedom of speech." But that's a legal fiction--publishing is an action, not speech. So is protesting, or uploading things to the Internet.