Depends on the size of the model/weights. If it's 1TB or more, being able to exfiltrate it from wherever it is to a local machine will be hard to do unnoticed, if the company security team has even a iota of knowledge and experience.