These kinds of moral arguments are silly because they hit a brick wall as soon as they encounter how society operates in practice. If Tesla has a moral obligation to roll out an FSD that's a just a little safer than humans, then do they not also have an obligation to make it available to all their competitors? If not, does every individual have a moral obligation to buy only Tesla cars? Do governments now have an obligation to subsidize Tesla cars so anyone can afford them? Etc.
And all this only considers first order effects. If a 2x safer FSD feels more dangerous that normal driving and thus reduces FSD uptake for a decade, doesn't Tesla have a moral obligation not to release it to preserve the perception of safety of self driving technology?