But context is only additive. You can give it the book content, but I don't think there's anything you can do to prevent it from bringing in unrelated info, unless you have a separate non-AI layer (e.g. connected to the RAG) that gives the user the particular snippets from the book, but even then you can't control what the AI bring to its interpretation of these snippets.

One thing that I think could be nice is if you could have it always keep the book in view, and just scroll to the appropriate place it is referring to, and then somehow highlight the specific snippet it is currently referring to, so that I could visually verify that it's giving me "grounded" information. Does your system do something like that?