undefined | Better HN

0 pointskillerstorm4mo ago0 comments

Well, there are certainly kinds of code LLMs would struggle with, but people generally underestimate what LLMs are capable of.

E.g. Victor Taelin is implementing ultra-advanced programming language/runtime writing almost all code using LLM now. Runtime (HVM) is based on Interaction Calculus model which was only an obscure academic curiosity until Taelin started working on it. So a hypothesis that LLMs are only capable of copying bits of code from Stack Overflow shall be dismissed.

0 comments

thesz4mo ago

I took a look at the Taelin's work [1].

[1] https://github.com/HigherOrderCO/HVM

From my understanding, main problem there is a compilation into (optimal) CUDA code and CUDA runtime, not language or internal representation per se. CUDA is hard to debug, some help can be warranted.

BTW, this HVM thing smells strange. The PAPER does not provide any description of experiments where linear parallel speedups were achieved. What were these 16K cores? What were these tasks?

killerstormOP4mo ago

Taelin is experimenting with possible applications of interaction calculus. That CUDA thing was one of experiments, and it didn't quite work out.

Currently he's working on a different thing: a code synthesis tool. AFAIK he got something better than anything else in this category, but whether it's useful is another question.

thesz4mo ago

  > something better than anything else in this category

That is a strong statement.

[1] https://en.wikipedia.org/wiki/Id_(programming_language)

Id [1] was run on the CM-5 (then) supercomputer and demonstrated superlinear parallel speedups on some of the tasks. That superlinear speedup was due to better cache utilization on individual nodes.

In some of the tasks the amount of parallel execution discovered by Id90 would lead to overflow of content-addressable memory and Id90's runtime implemented throttling to reduce available parallelism to make things to be done at all.

Does the PAPER of HVM refers to Id (Id90 to be precise)? No, it does not.

This is serious negligence of Taelin.

1 more reply

keithba4mo ago

I’ve also experimented with using rust to create a new programming language where I vibe coded (eg never wrote myself). My opinion is that it’s quite capable with disciplined management.

https://github.com/GoogleCloudPlatform/aether

Note: the syntax is ugly as a trade-off to make it explicit and unambiguous for LLMs to use.

j / k navigate · click thread line to collapse

0 comments

thesz4mo ago

I took a look at the Taelin's work [1].

[1] https://github.com/HigherOrderCO/HVM

BTW, this HVM thing smells strange. The PAPER does not provide any description of experiments where linear parallel speedups were achieved. What were these 16K cores? What were these tasks?

killerstormOP4mo ago

Taelin is experimenting with possible applications of interaction calculus. That CUDA thing was one of experiments, and it didn't quite work out.

Currently he's working on a different thing: a code synthesis tool. AFAIK he got something better than anything else in this category, but whether it's useful is another question.

thesz4mo ago

  > something better than anything else in this category

That is a strong statement.

[1] https://en.wikipedia.org/wiki/Id_(programming_language)

Id [1] was run on the CM-5 (then) supercomputer and demonstrated superlinear parallel speedups on some of the tasks. That superlinear speedup was due to better cache utilization on individual nodes.

Does the PAPER of HVM refers to Id (Id90 to be precise)? No, it does not.

This is serious negligence of Taelin.

1 more reply

keithba4mo ago

I’ve also experimented with using rust to create a new programming language where I vibe coded (eg never wrote myself). My opinion is that it’s quite capable with disciplined management.

https://github.com/GoogleCloudPlatform/aether

Note: the syntax is ugly as a trade-off to make it explicit and unambiguous for LLMs to use.

j / k navigate · click thread line to collapse