You run the corpus through the model piecemeal, recording the model's interpretation for each chunk as a vector of floating point numbers. Then when performing a completions request you first query the vectors and include the closest matches as context.

Yeah, the example given in the OpenAI GPT4 twitter video is someone asking it to write a python script to analyze their monthly finances and it simply just importing dataframes, importing "finances.csv", running a columnar sum for all finances and then displaying the sum and the dataframe. I'm sure it's capable of some deeper software development but it almost always makes radical assumptions and is rarely ever self sufficient (you don't need to look it over and don't need to change the architecture of the code it produced).

Why would you think this? As long as the technical domain knowledge is at least partially published, I don't see them stopping becoming better.

UI stuff just has an input problem. But it is not that hard to think that ChatGPT could place widgets once it can consume images and has a way to move a mouse.

You just kind of concatenate the entire codebase into one file, tell the model to do something and output the modified codebase into another file, diff the two and produce a patch automatically.

I think there's ways but you might have to use pinecone db or something like lang chain to essentially give it a long term memory...

or another option is having one instance or chat order code page and one that basically just has an API index and knows which chat has the related things.

Yep, I know that’s been possible since at least GPT-3 davinci

> I bet there's a quite a bit of profit in there

Is this profit-seeking pricing or pricing that is meant to induce folks self-selecting out?

Genuine question — I don’t know enough about this area of pricing to have any idea.

Gotta pay back M$

Currently, CLIP's largest size is at patch-14 for 336x336 images, which translates to 577 ViT tokens [(336/14)^2+1]. It might end up being token-efficient depending on how it's implemented. (the paper doesn't elaborate)

LangChain/context prompting can theoetically allow compression of longer conversation, which will likely be the best business strategy.

My understanding is that image embeddings are a rather abstract representation of the image. What about if the image itself contains text, such as street signs etc?

Token is 0.75 words on average per OpenAI; 32k in tokens would be roughly 24k in words.

https://help.openai.com/en/articles/4936856-what-are-tokens-...

So are you in favour of granting human rights to a machine? If not, your analogy makes zero sense because we are talking about a copyright laundering tool creating derivative works, not a thinking human that presumably we both are.

You are confusing two distinct cases.

In the first case, you found/bought a book and read it. No one can or should make you pay for it, unless you stole the book.

In the second case, you found/bought a book then reprinted it infinitely and sold it for profit, ethically you should pay the author and legally you should be in violation of the law.

Even if you made a machine that ingests and recombines books automatically, and you keep that machine locked up and charge people for its use, it is the same scenario: the machine would be absolutely useless without the original books, those books cost people effort and money to produce, yet you pay those people nothing while the machine is basically an infinite money maker for you.

I hope the analogy makes sense.

I mean the authors who wrote the works which are resold by Microsoft for its own profit without any opt-in or even opt-out, much less compensation.

Yes, dead people are fine not being paid, so what’s your plan then I fear to ask?

Made my first million this year myself actually and I probably have many people to credit that I forgot to credit. I can start with Pythagoras, Galileo [insert everyone between], Kernighan, Ritchie. Also the guy who invented pencilin. I'm honestly not sure how these angles arise. Knowledge wants to be free. We are here today because of this fact.

When it comes to spam culture sure. But will we ever be there? "AI art" isn't impressive and will never be. It is impressive in the academic sense. Nothing more.

Imagine Google scraping the Internet and not directing you to search results. We’d be with pitchforks the next day. But when OpenAI does it, that’s somehow okay…

Because at the other end of this equation you would have companies like disney holding you at gunpoint for money if you ever spoke about mice.

Ok profits will be shared with all internet users. Send an invoice for $0.0000000000001 for your contributions to the internet corpus.

You can pay $17/month (Apple subscription only for now), for ~unlimited queries to GPT-4 (and Claude+)