Strangely, no 'English' people have ruled England since the latter Norman invasion.
Scotland and Wales often try to pretend they weren't part of the Empire and its horrors - in reality their were nobles/toffs/rich nobs from all across GB (at least) doing their part. Barely any of our ancestors were involved in any way other than servitude.
(My family are from both sides of the Anglo-Irish conflicts.)