They had very significant effects on the nuclear policy. Oppenheimer's (of course a big movement of which he figureheaded) big idea was to prevent a nuclear arms race, which obviously didn't fully materialize, but what was the basis for e.g. test bans, disarmantments and limiting proliferation.
I agree that you shouldn't ask the inventor just because they invented the gadget. But at least in the Manhattan project the scientists were in a very strong position that if they refuse to co-operate, the bomb just won't happen (soon enough). And for that you'd want inventors versed in the wider implications.
One difference from that era is probably that interest in wider philosophy and politics was encouraged from academics. E.g. the "giants of modern physics" (Oppenheimer, Einstein, Bohr etc) took great interest and scholarship in philosophy and societal issues whereas nowadays, as you said, there's practically 0% of the inventor of the gadget to understand the issues. They should "shut up and calculate", and leave the philosophy to philosophers and the societal impact to economists.
A problem is that philosophers and economists don't really understand the technology and its ramifications, and are heavily influenced by the hype. And philosophers have very little power to influence anyway. There are valid reasons for such specialization, but it has drawbacks.