Implementing GPTZero from scratch – Reverse engineering GPTZero (opens in new tab)

(github.com)

99 pointsburhanultayyab3y ago18 comments

18 comments

We've gone through the original implementation of GPTZero and successfully reverse engineer it. (it gives the same results as original GPTZero). We've also recorded the implementation process which can be found below.

Youtube Implementation Video: https://youtu.be/x9H-aY5sCDA

Github: https://github.com/BurhanUlTayyab/GPTZero

Website: https://gptzero.sg

Discord: https://discord.com/invite/F3kFan28vH

We're also working on a GPTZerov2 (inspired by LLM based transformers and GANs), which would be more accurate, and can detect lines changed by humans.

Please give some feedback on our work.

Thanks

forgotpwd163y ago

>our implementation gets the exact same results

Considering https://news.ycombinator.com/item?id=34556681 that isn't really a good thing to have.

That said, good work replicating it.

burhanultayyabOP3y ago

Thanks for the complement. We would be more cautious in the future.

rvz3y ago

Good. A detector should have been written and open-sourced before releasing GPT in the first place, especially by OpenAI themselves. A shame that someone else had to do the work other than them.

Better late than never to open source it now, unlike the original creator of GPT Zero or OpenAI doing it.

cwmoore3y ago

They would be in a position to log hashes of generated substrings, multiple of which in a document would indicate a high likelihood indicator of the source. Solving for the Turing Test appears to have been a poorly chosen goal.

burhanultayyabOP3y ago

You are correct, that's why we're working on a version 2 of it where we're using LLM Transformers fighting adverserially to make it better.

camjw3y ago

A bit weird that you claim 100% accuracy to the real GPTZero when most sentences I tried gave different results.

Also, kind of cringe to copy the original GPTZero down to the domain name - you are gptzero.sg right?

alexcdot3y ago

the model at https://gptzero.me is different now, it does sentence-level prediction as opposed to the old GPTZero

disclaimer: i'm familiar with creator

burhanultayyabOP3y ago

It's amazing what you guys are working on :)

We're working on v2 where two large LLMs fight with one another.

sdrg8223y ago

Given that GPTZero was an undergrad’s side project it’s not that surprising?

bablawexler3y ago

where can I see your code if that’s so easy

nicholaswork3y ago

Interesting and the website is more responsive than the original.

forgotpwd163y ago

Complementing the project in which you're one of the two devs is a bit strange imo.

https://github.com/BurhanUlTayyab/GPTZero/commits/main

dboreham3y ago

Why?

Bootvis3y ago

It’s disingenuous to pretend to be an ordinary commenter while praising your own work.

ausudhz3y ago

Conflict of interest

burhanultayyabOP3y ago

Thanks for the complement.

nacs3y ago

Do you/your dev-partner give each other compliments like this while developing too or just at the end?

j / k navigate · click thread line to collapse

18 comments

burhanultayyabOP3y ago

Youtube Implementation Video: https://youtu.be/x9H-aY5sCDA

Github: https://github.com/BurhanUlTayyab/GPTZero

Website: https://gptzero.sg

Discord: https://discord.com/invite/F3kFan28vH

We're also working on a GPTZerov2 (inspired by LLM based transformers and GANs), which would be more accurate, and can detect lines changed by humans.

Please give some feedback on our work.

Thanks

forgotpwd163y ago

>our implementation gets the exact same results

Considering https://news.ycombinator.com/item?id=34556681 that isn't really a good thing to have.

That said, good work replicating it.

burhanultayyabOP3y ago

Thanks for the complement. We would be more cautious in the future.

rvz3y ago

Good. A detector should have been written and open-sourced before releasing GPT in the first place, especially by OpenAI themselves. A shame that someone else had to do the work other than them.

Better late than never to open source it now, unlike the original creator of GPT Zero or OpenAI doing it.

cwmoore3y ago

burhanultayyabOP3y ago

You are correct, that's why we're working on a version 2 of it where we're using LLM Transformers fighting adverserially to make it better.

camjw3y ago

A bit weird that you claim 100% accuracy to the real GPTZero when most sentences I tried gave different results.

Also, kind of cringe to copy the original GPTZero down to the domain name - you are gptzero.sg right?

alexcdot3y ago

the model at https://gptzero.me is different now, it does sentence-level prediction as opposed to the old GPTZero

disclaimer: i'm familiar with creator

burhanultayyabOP3y ago

It's amazing what you guys are working on :)

We're working on v2 where two large LLMs fight with one another.

sdrg8223y ago

Given that GPTZero was an undergrad’s side project it’s not that surprising?

bablawexler3y ago

where can I see your code if that’s so easy

nicholaswork3y ago

Interesting and the website is more responsive than the original.

forgotpwd163y ago

Complementing the project in which you're one of the two devs is a bit strange imo.

https://github.com/BurhanUlTayyab/GPTZero/commits/main

dboreham3y ago

Why?

Bootvis3y ago

It’s disingenuous to pretend to be an ordinary commenter while praising your own work.

ausudhz3y ago

Conflict of interest

burhanultayyabOP3y ago

Thanks for the complement.

nacs3y ago

Do you/your dev-partner give each other compliments like this while developing too or just at the end?

j / k navigate · click thread line to collapse