While I'd hope a friend would call me out if they felt things were going downhill in our friendship, I wouldn't say I'd expect it. But I would definitely expect the friendship to go downhill for me too, even if from my side it just looked like an innocuous "drifting apart".