To be fair, all things considered, if you have to learn either language from scratch from a native language that has no link[1] whatsoever to it, I think English is harder than Japanese.
1. by which I mean, in the case of English, for example, if your native language is not french, german, etc.
In fact, I think English is harder to learn for Japanese native speakers than Japanese for English native speakers.
