Worst one is the data pipeline we have. It’s some AWS lambda mess which uses curl to download a file from somewhere and put it into S3. Then another lambda turns up at some point and parses that out and pokes it into DynamoDB. This fucks up at least once a month because the guy who wrote the parser uses 80s BASIC style string manipulation and luck. Then another thing reads that out of DynamoDB and makes a CSV (sometimes escaped improperly) and puts that into another bucket.
I of course entirely ignore this and use one entire line of R to do the same job
Along comes a senior spider and says “maybe we can fix all these problems with AI”. No you can stop hiring acronym collectors.
