But that doesn't mean anyone's manager has access to some secret dashboard to get any of this data or is able to view it on demand. Short of a serious legal case it just won't be relevant.
Noone's manager has access to individual answers and neither does anyone in their org chart.By default, week-over-week, that connections information is private.
What actually (probably) happened is your team's scores were shitty and somewhere up in your org chart noticed and started giving your manager shit to improve them. Then they went in and decided to use their best guesses about who voted for what to start harassing people to figure out how to improve things.
They absolutely epitomized Goodhart's law and they got the result they wanted - you stopped giving a shit and voted for whatever got them off your back.
That sucks but thats not how it is on most teams. Every team I've been on used this data bi-weekly or monthly to have an honest review of what we're doing well and where we need to improve. Nobody gets picked on. If there is a clear outlier where one person was unhappy we don't try to find out why but I (as a senior leader) try to be vocally self-critical and try to come up with multiple guesses and/or reasons for why they might have said that, and what could be done about different root causes. (TO not force whoever was the outlier to speak up).
Your manager sounds like an idiot/asshole, but the least I can say from looking up your name is at least your former manager isn't managing anyone anymore!