Considering you're using Linux, I'd do something of sorts:

  1. get all image files with "find", considering they are with a known extension
  2. run jdupes on the dump and deduplicate them.
  3. run exiftool on them to automatically divide them to folders based on any metadata field you like.
  4. Index all of the images with digikam and further organize them there.

Another path would be to add all drives as "removable collections" to digikam and manage all of them there. digikam also has fuzzy search so it can find not only identical but similar images so you can deduplicate them.

Both ways are applicable to videos as well.

I'm currently using the second path since Digikam is already my primary photo cataloging and managing tool for years and, it works wonders.

---

On mac, Gemini II and Retrobatch would allow for a similar workflow but, I didn't use them as my primary workflow tools. Gemini also has similarity search so it can deduplicate similar photos.

I'm not using Windows for more than a decade so, I don't know anything on that front.