As in, the FPGA would have to be carefully segmented so the accelerator couldn't be used to access memory it shouldn't have access to.
I don't think it would happen in a general purpose chip but I could see it happening in a smaller one like the exploits christopher Domas demonstrated against some embedded X86 cores.