Sorry, "this" referred to the parent comment's claim.
> models starting becoming "moody" due to their proprietors arbitrarily modifying their performance capabilities
The tokenizer changes are measurable, the above is quite difficult to quantify.
There are a few sites floating around that purport to, but all of them have fatal flaws in their methodology.
