The problem I ran into was setting up a CNAME for an S3 bucket requires the bucket name to have periods in it, but https:// access no longer works for buckets with that naming convention[1]. So I ended up having to use CloudFront instead for my images.
[1]: https://docs.aws.amazon.com/AmazonS3/latest/dev/BucketRestri...