Back when boards kept the IPMI on a separate interface it was easy to isolate them, including shutting down all port to port traffic on a switch.
Now, on many motherboards the BMC stuff will aggressively talk in-band even if you think you've disabled that.