undefined | Better HN

0 pointscma4d ago0 comments

I think it also gets use in the /fast modes the providers sell at higher cost.

0 comments

They probably use it on all models. Fast is probably just a resource pool with less congestion and therefore faster throughput per user but less efficent.

cmaOP4d ago

If it speeds prefill too I guess so.

j / k navigate · click thread line to collapse

0 comments

gunalx4d ago

They probably use it on all models. Fast is probably just a resource pool with less congestion and therefore faster throughput per user but less efficent.

cmaOP4d ago

If it speeds prefill too I guess so.

j / k navigate · click thread line to collapse