It appears almost instantly when you mouse over where it used to be. I've been living on it for the past few weeks and haven't changed my muscle memory at all.
The icon in the window title bar is often referred to as the proxy icon. I thought this was Apple's official name for it, but I can't find any evidence to support that in Apple's documentation.
