The potential for abuse here is enormous. If you think shadow banning is problematic from a free speech perspective. Imagine being silently shadow banned from your local grocery store. Imagine not being able to donate to a particular cause/political party. Imagine not being able to give a friend in need financial support because their social score is too low.
People have no actual freedom without economic freedom, and this system will create a sword of Damocles that will hang over each and every person.