undefined | Better HN

0 pointskurthr3y ago0 comments

It's a bit weird that it still doesn't get 3 digit multiplications correct, but the last digit seems right.

What is more bizarre is that all of it's errors seem to be multiples of 60!

I'm wondering if it is confusing 60 based time (hour second) computations for regular multiplication?

Example:

   xGPT 987    456    321
   437 428919 199512 140397
   654 645258 298224 209994
   123 121401  56088  39483
   
   x    987    456    321
   437 431319 199272 140277
   654 645498 298224 209934
   123 121401  56088  39483
   
   error 987   456  321
   437   2400 -240 -120
   654   240   0   -60
   123   0     0    0

0 comments

MagicMoonlight3y ago

It’s not intelligent. It has no concept of mathematics so you can’t expect it to solve that.

It can repeat answers it has seen before but it can’t solve new problems.

kurthrOP3y ago

I understand it's just a language model, but clearly it has some embedded method of generating answers which are actually quite close. For example it gets all 2 digit multiplications correct. It's highly unlikely it has seen the same 6 ordered 3 digit (or even all 10k 2 digit multipies) integers from a space of 10^18 and yet it is quite close. Notably, it gets the same divisions wrong as well (for this small example) in exactly the same way.

I know of other people who have tried quite a few other multiplications who also had errors that were multiples of 60.

j / k navigate · click thread line to collapse