Yes and that is far easier to do then containing a fusion reaction.
There are known well understood engineering solution that have been known since the 70s and that work fine.
The real danger is the high pressure that PWR are under and the chemical instability of the elements that were put together in those designs.
Reactors that are not under pressure and do not have chemical instability that lead to explosive cases have a very contained area of effect even in a worst case.