I'll +1 that, and I'm one of those people but only if I'm already in a poor mental state. When I have something to feel anxious about (e.g, health concerns), then coffee consistently makes me feel more anxious.
Although, it doesn't make me feel anxious on most days, it's really only if I already have a prior reason, it just exacerbates it.