You don't have to be dominant to be successful. But you can't be a pushover.
If something bothers you, you have to speak up. Immediately and decisively. The first time it happens. Not when it becomes the established social norm.
If you speak up, normal mature people will say something like "Oh, sorry. I didn't realize that bothered you. I'll be more careful.". They might push back, if they think you're pushing too far or too hard because of whatever pre-existing beliefs.
But it's a dynamic balance. Both sides have to push and pull. Without active participation from everyone, teams become imbalanced and less effective.