undefined | Better HN

0 pointsanon2913y ago0 comments

Compile times are not a whole lot different than any other large model build. It's a kernel based compilation pipeline and the kernels are simply tiled over a 'core' area in the weight streaming architecture.

0 comments

2 comments · 1 top-level

IshKebab3y ago· 1 in thread

I seriously doubt that. What's your source?

I used to work for a competitor with a more flexible architecture and even our compile times were bad (significant fractions of a day in some cases). And we didn't have to do place and route!

I just googled it and it's apparently bad enough that they had to implement incremental place and route.

anon291OP3y ago

I used to work at Cerebras. They don't do place and route anymore. That's the old pipeline mode. They've shifted to weight streaming

j / k navigate · click thread line to collapse