You are correct although it rapidly turns into a square/cube law scaling problem. I have spent many thousands of working hours fifteen miles downwind of a F1 track but the dilution factor is immense. Also time factors in that the track I work downwind of only races once a year but drivers work all year. (although there are minor races all year, which may involve CF material vehicles)
Mechanics specializing in brake work are likely at very high exposure and "should be" dying at a dramatically higher rate than drivers or anyone else. But I haven't heard of anything like that.