Forwarding the users query directly to the document store seems ridiculous to me. The whole point is for the LLM to interpret the context and issue multiple targeted queries based upon the interpretation(s) arrived at.
The LLM is the semantic part. FTS is the keyword part. This is the hybrid you're looking for.