It wasn't even just for MS applications. You could embed the Agents in your own application via ActiveX. There were some samples from MS of how to embed it in websites via VBScript. There was also an Agent Editor so you could create your own agents.

There were also downloadable agents from MS. I think there were around a dozen or so different ones before they pulled the plug.