You can still pinpoint a particular person or institution behind a decision and hold them responsible though. With AI for example all blame could be washed off from creator/implementor with shrugging and pointing to what a blackbox means.
Most human institutions expend a lot of effort in ensuring that responsibility (and therefore accountability) is diffuse and difficult to pin down. Take a look at any government body.