I run a social group that has about 3.6k+ people on it. We have about 200-300 active people at any given time. Most of the people who drop out of the group have 0 RSVP Yeses, and 0 RSVP Nos.
We do a lot to get attendance up and to create events that people want to attend.