I understand the idea of looking at completed characters and inferring the original order of strokes.

But are you saying that Japanese writing is only readable if you observe the writer during the act of writing? Because that's what some stroke recognition engines do.

Here's a tangible example. Imagine I write "h l o", pause, then go back and place an "e" in the first space, and an "l" in the second space, then hold it up to you. You're going to see "hello," right?

But an algorithm that tries to interpret the act of writing itself, might see "hlo el", because that's the order in which I wrote the characters.