Thanks for explaining!
Delay in the feedback path counts against phase margin, requiring you to reduce the loop bandwidth to maintain stability.