Going back to @theGimp's comment, it is probably safe to assume that nation-states that might want to decrypt this would have some form of access to that circuitry (either a specialized implementation or by using the apple chip) and could sidestep the speed issue. It seems like, to 0th order, it would either be slow for everyone or quick for everyone.