I have the same thing, one weird connection I realized was: coffee. Apart from the stress of being a solopreneur, I noticed whenever I had coffee, I ended up being anxious/panicky later in the day.
It might be placebo, but since I stopped drinking coffee, I rarely have those intense feelings of anxiety.