undefined | Better HN

0 pointsbrucethemoose22y ago0 comments

Its presumably llama just like Mistral.

Everything open source is llama now. Facebook all but standardized the architecture.

I dunno about the moe. Is there existing transformers code for that part? It kinda looks like there is based on the config.

0 comments

Mistral is not llama architecture.

Its basically llama architecture, all but drop in compatible with llama runtimes.

Because it's JSON? :)

j / k navigate · click thread line to collapse

0 pointsbrucethemoose22y ago0 comments

Its presumably llama just like Mistral.

Everything open source is llama now. Facebook all but standardized the architecture.

I dunno about the moe. Is there existing transformers code for that part? It kinda looks like there is based on the config.

Mistral is not llama architecture.

Its basically llama architecture, all but drop in compatible with llama runtimes.

Because it's JSON? :)

j / k navigate · click thread line to collapse