There is no intelligence here: it's still just giving plausible output. That's why it can't metrically scan its own lines or put a cæsura in the right place.
https://chatgpt.com/share/68954c9e-2f70-8000-99b9-b4abd69d1a...
This is not anywhere remotely close to general intelligence.
For much better results, use a custom trained model like the one at Soundslice: https://www.soundslice.com/sheet-music-scanner/
This would be a hilarious take to read in 2020
(Incidentally, go back in time even five years and this specific expectation of AI capability sounds comically overblown. "Everything's amazing and nobody's happy.")
An LLM will spit out what looks like poetry, but will violate certain rules. It will generate some hexameters but fail harder on trimeter, presumably because it is trained on more hexametric data (epic poetry: think Homer) than trimetric (iambic and tragedy, where it’s mixed with other meters). It is trained on text containing the rules for poetry too, so it can regurgitate rules like defining a penthemimeral cæsura. But, LLMs do not understand those rules and thus cannot apply them as a child could. That makes ancient poetry a great way to show how far LLMs are from actually performing simple, rules-based analysis and how badly they hide that lack of understanding by BS-ing.
LLMs are simple, it doesn't take much more than high school math to explain their building blocks.
What's interesting is that they can remix tasks they've been trained very flexibly, creating new combinations they weren't directly trained on: compare this to earlier smaller models like T5 that had a few set prefixes per task.
They have underlying flaws. Your example is more about the limitations of tokens than "understanding", for example. But those don't keep them from being useful.
"You’ve given:
Moon in the 10th house (from the natal Ascendant)
Venus in the 1st house (from the natal Ascendant)
Step-by-step: From the natal Ascendant’s perspective
Moon = 10th house
Venus = 1st house
Set Moon as the 1st house (Chandra Lagna)
The natal 10th house becomes the 1st house in the Chandra chart.
Therefore, the natal 1st house is 3rd house from the Moon:
10th → 1st (Moon)
11th → 2nd
12th → 3rd (which is the natal 1st)
Locate Venus from the Moon’s perspective
Since Venus is in the natal 1st, and natal 1st is 3rd from Moon,
Venus is in the 3rd house from Chandra Lagna.
Answer: From Chandra Lagna, Venus is in the 3rd house."
