You do need a little testing because ARM is different, but the odds that are are doing something where it matters are low. I've been doing the above for years and only found two things. First was a bug in GCC (already fixed in a newer version by the time I traced it down). Second was x86 has a strong stronger memory model for sharing data between threads - hopefully you are not doing that (I only hit it because I maintain our cross thread message system).
You also can't test anything that uses GPIO type things - but this computer has different setup and so you couldn't with this anyway. (and you should abstract your GPIO for testing anyway so this because a small test case when you do switch to real hardware)