Yes, near a stable equilibrium you can always linearize a system to model its behavior quite accurately for small perturbations. That's the crux of what it was pointed above.

Outside of equilibrium things get more complicated. In principle, you can still do a first order expansion to understand the dynamics in a vicinity of that regime, the problem is that outside equilibrium you are not going to stay near the point of the solution space you started at. You will keep drifting, at least until you reach another stable equilibrium if there is one.

Systems outside equilibrium are much harder to study because we cannot linearize. Basically.