Sure, I've added no new functionality, but my patterns are clean, signatures become more symmetrical, I take time to think about some odd choices and really figure out what needs to happen.
Leaves me feeling refreshed and with a huge feeling of accomplishment at the end of the day.
Really quite irrational.
How are things on the enterprise side?
Large existing codebases, detailed requirements, lots of interconnected features and dependencies.
Any success stories?
I am thinking about anything from safeguarding against illegal queries depending on role, to ensuring role inappropriate content is not present in the context at inference time.
For example, a customer interacting with a tool would only have access to certain information vs a customer support agent or other employee. Documents which otherwise have access restrictions are now represented as chunked vectors and stored elsewhere which may not reflect the original document's access or role based permissions. RAG pipelines may have far greater access to data sources than the user is authorized to query.
Is this done with safeguarding system prompts, filtering the context at the time of the request?
