undefined | Better HN

0 pointscoder5432y ago0 comments

You've already downloaded and thoroughly tested the 7B parameter model of "code llama"? I'm skeptical.

0 comments

bbor2y ago

It was made available internally, I believe. So this is one of the many Meta engineers on this site —- after all, Facebook is now less hated than Google here ;)

1 more reply

Eddygandr2y ago

Maybe confused Code Llama with Llama 2?

realce2y ago

Just sign up at meta and you'll get an email link in like 5 minutes

coder543OP2y ago

Yes, that's not a response to my comment.

No one who has been using any model for just the past 30 minutes would say that it has "pretty much replaced Google/SO" for them, unless they were being facetious.

tyre2y ago

They said 7b llama which I read as the base LLaMa model, not this one specifically. All of these LLMs are trained on Stack Overflow so it makes sense that they’d be good out of the box.

brandall102y ago

The top level comment is specifically citing performance of code llama against codex.

dataangel2y ago

GPT4 has replaced SO for me and I've been using it for months.

lddemi2y ago

Likely meta employee?

MertsA2y ago

I've been using this or something similar internally for months and love it. The thing that gets downright spooky is the comments believe it or not. I'll have some method with a short variable name in a larger program and not only does it often suggest a pretty good snippet of code the comments will be correct and explain what the intent behind the code is. It's just a LLM but you really start to get the feeling the whole is greater than the sum of the parts.

coder543OP2y ago

I just don’t understand how anyone is making practical use of local code completion models. Is there a VS Code extension that I’ve been unable to find? HuggingFace released one that is meant to use their service for inference, not your local GPU.

The instruct version of code llama could certainly be run locally without trouble, and that’s interesting too, but I keep wanting to test out a local CoPilot alternative that uses these nice, new completion models.

fredoliveira2y ago

There are a bunch of VSCode extensions that make use of local models. Tabby seems to be the most friendly right now, but I admittedly haven't tried it myself: https://tabbyml.github.io/tabby/

kateklink2y ago

there's also Refact (https://github.com/smallcloudai/refact/) with support of several open-source code LLMs and extension for VS Code and Jetbrains

j / k navigate · click thread line to collapse

0 comments

bbor2y ago

It was made available internally, I believe. So this is one of the many Meta engineers on this site —- after all, Facebook is now less hated than Google here ;)

1 more reply

Eddygandr2y ago

Maybe confused Code Llama with Llama 2?

realce2y ago

Just sign up at meta and you'll get an email link in like 5 minutes

coder543OP2y ago

Yes, that's not a response to my comment.

No one who has been using any model for just the past 30 minutes would say that it has "pretty much replaced Google/SO" for them, unless they were being facetious.

tyre2y ago

They said 7b llama which I read as the base LLaMa model, not this one specifically. All of these LLMs are trained on Stack Overflow so it makes sense that they’d be good out of the box.

brandall102y ago

The top level comment is specifically citing performance of code llama against codex.

dataangel2y ago

GPT4 has replaced SO for me and I've been using it for months.

lddemi2y ago

Likely meta employee?

MertsA2y ago

coder543OP2y ago

fredoliveira2y ago

There are a bunch of VSCode extensions that make use of local models. Tabby seems to be the most friendly right now, but I admittedly haven't tried it myself: https://tabbyml.github.io/tabby/

kateklink2y ago

there's also Refact (https://github.com/smallcloudai/refact/) with support of several open-source code LLMs and extension for VS Code and Jetbrains

j / k navigate · click thread line to collapse