> If I must accept this definition of 'privilege', then we can simply call all outcomes in our life to be a direct result of the amount of 'privilege' we have.

You can accept this definition without reducing your entire life to a preordained path. There’s middle ground where you can accept that some portion of your life was your choice, but the rest of it was due to circumstances you were raised in or had no choice in. Nobody is suggesting you didn’t work hard to get where you are, but it’d also be crazy to pretend that the white child born to rich engineers has the same path as a poor person of color who had to help work at a young age to support their single mother and siblings.