undefined | Better HN

0 pointshoseja3y ago0 comments

It's a fixed number of matrix multiplications. You can't make matrix multiplication crash by feeding it any sort of strange numbers (unless they haven't handled their Infs and NaNs).

0 comments

mike_d3y ago

> You can't make matrix multiplication crash by feeding it any sort of strange numbers

Matrices don't multiply themselves. You need hardware and software. As I pointed out the LLM is effectively just data that is being processed by a program. It is silly to assume you have no bugs in that software or the underlying operating system.

gs173y ago

The type of bug the first comment was discussing, where recursion could cause it to crash (out of memory? stack overflow?) is categorically impossible based on how the model works, and a bug in the software running it would not change that.

j / k navigate · click thread line to collapse

0 comments

mike_d3y ago

> You can't make matrix multiplication crash by feeding it any sort of strange numbers

gs173y ago

j / k navigate · click thread line to collapse