The good ones (Claude 3 Opus, GPT-4) are really incredibly good at understanding scripts. It's very rare that they hallucinate anything, especially important details for the more widely used tools that I tend to stick to.

I trust LLMs with tools like Bash and jq and ffmpeg which have been around for years. I wouldn't trust them with anything released within the past 12-24 months.

An example from just the other day: https://til.simonwillison.net/go/installing-tools

I wanted to understand this:

    go install github.com/icholy/semgrepx@latest

How does that @latest reference mention? There's no branch or tag on that repo called "latest".

I tried and failed to find documentation. I gave up and asked GPT-4, which said:

> @latest: This specifies the version of the package you want to install. In this case, latest means that the Go tool will install the latest version of the package available. The Go tool uses the versioning information from the repository's tags to determine the latest version. If the repository follows semantic versioning, the latest version is the one with the highest version number. If there are no version tags, latest will refer to the most recent commit on the default branch of the repository.

Is that correct? I have no idea! But it still gave me more to go on than my failed attempts with the real documentation.