So the ones who do not match the narrow skill set you are looking for do not get any response if I understand correctly?
Would that number be 90%?
Also 54 is not a lot. Consider responding to all candidates at your scale which is still very tiny.
Github gets a much larger number of applications (1000s) and they still respond with a lot more details about why they reject people.
I work with a lot of mentorship and coaching of young tech folks and this can drastically improve how people think of you.