On the klingon point: They theorized that the particular organization was a bunch of PHDs rather than farmed labor - and that it had learned from previous 'example answers' they had submitted. That particular organization, it was noted, was also an order of magnitude more expensive than the others.
This is a rather surprising finding.
---
Finally, the results for ImageToText are impressive. Relative to the other services, ImageToText has appre- ciable accuracy across a remarkable range of languages, including languages where none of the other services had few if any correct solutions (Dutch, Korean, Viet- namese, Greek, Arabic) and even two correct solutions of CAPTCHAs in Klingon. Either ImageToText recruits a truly international workforce, or the workers were able to identify the CAPTCHA construction and learn the correct answers. ImageToText is the most expensive service by a wide margin, but clearly has a dynamic and adaptive labor pool.
This last caveat leads to an interesting economic question. As noted above, retail prices for CAPTCHA-
solving vary over a wide range, from about $1 per thousand to $20 per thousand. This price spread, and
the fact that it’s technically feasible to route a CAPTCHA through the system more than once, suggests a
major arbitrage opportunity. We can set up a high-price CAPTCHA service and farm out all the actual work to
low-price competitors. In a free economy—and what economy could be freer of regulation than a criminal
one?—that situation is not supposed to endure.
Well, at least until they add CAPTCHAs.Finack's comment on the original post was worth noting here: Arbitrage has far more to do with information transparency than the free-ness of the economy, as such arbitrage is pretty common in criminal economies where prices aren't public information.