Directly comparing 2000 to 2020 makes little sense given the consistent downward trend and magnitude of difference between 2001-2005 and 2015-2019.
Given the downward trend in adjusted deaths per million over time, a more reasonable approach is to average the last 5 years and compare it to 2020. Doing so, you will find that 2020 has ~750 more deaths per million in Sweden than prior periods. (Keep in mind this approach likely understates the affect of COVID on mortality rate due to the aforementioned trend).