There are legitimate criticisms you could make of the comment in question, but "I was curious what you looked like" is assuredly not a comment on someone's appearance.