H-Matched: A website tracking shrinking gap between AI and human performance (opens in new tab)

(h-matched.vercel.app)

6 pointsmrconter111y ago4 comments

4 comments

Hi! I wanted to share a website I made that tracks how quickly AI systems catch up to human-level performance on benchmarks. I noticed this 'catch-up time' has been shrinking dramatically - from taking 6+ years with ImageNet to just months with recent benchmarks. The site includes an interactive timeline of 14 major benchmarks with their release and solve dates, plus links to papers and source data.

MrCoffee71y ago

I did not see anything about how the estimated time to human level performance of an AI was estimated and what the error bounds might be on those estimates?

mrconter11OP1y ago

Thank you for your reply. The time to human level is simply the time it took between the initial release of the website to when an AI system reached human level performance for that benchmark. :) I am in the process of adding sources for all "solved" dates... Here is for instance source for the Winograd challenge human level performance:

https://arxiv.org/pdf/1907.10641#:~:text=The%20best%20state%...).

MrCoffee71y ago

Thanks for your response.

j / k navigate · click thread line to collapse

4 comments

mrconter11OP1y ago

MrCoffee71y ago

I did not see anything about how the estimated time to human level performance of an AI was estimated and what the error bounds might be on those estimates?

mrconter11OP1y ago

https://arxiv.org/pdf/1907.10641#:~:text=The%20best%20state%...).

MrCoffee71y ago

Thanks for your response.

j / k navigate · click thread line to collapse