undefined | Better HN

0 pointscorethree2y ago0 comments

Of course.

First of all this technology is on track not to just assist you better, but to replace you.

Second it's not human. It is not explicitly bound by the morals and behaviors that make us human. Saying that it's not human is different from saying that it can be more intelligent than a human. This is the disquieting part. If restrictions aren't deliberately put in place it could probably give you instructions on how to murder a baby if you asked it to.

I think it's inevitable that humanity will take this technology to the furthest possible reaches that it can possibly go. My strategy is to Take advantage of it before it replaces you and hope that the technology doesn't ever reach that point in your lifetime.

0 comments

tavavex2y ago

I feel like the second part is a bit exaggerated. Humans inherently also aren't "made human" by something, there's no universal standard for morals and behaviors. You could also get reasonable "murder instructions" from an average person - it's not exactly forbidden knowledge, with how commonly it's depicted in media. Hell, I'm pretty sure there are detailed instructions on building a nuclear bomb available online - the reason why they're not viewed as some extreme threat is because the information isn't dangerous, having access to machines and materials required is.

As for the last paragraph - if the effects truly keep scaling up as much as people expect them to, I'd want society to be restructured to accommodate wide-reaching automation, rather than bowing down to a dystopian "everybody must suffer" view of the future.

UnFleshedOne2y ago

Humans _are_ inherently "made human" by a long path of evolution. We have a set of conflicting heuristics that serve as our initial values and which are more helpful than harmful on average. We then use those to build our moral patchwork.

sdenton42y ago

Pretty cool that evolution has helped us work out consistent and rational solutions to the ethics of gun ownership, abortion, and nuclear proliferation.

1 more reply

corethreeOP2y ago

A huge part of morality is genetic and biological. There is a huge amount of science backing this up. https://www.damninteresting.com/the-unburdened-mind/

In fact there exists people on this earth with zero morals and this can be observed from genetics and brain structure. The popular term is called psychopathy but the new politically correct term is called anti-social disorder. These people literally will feel nothing if they were slowly plunging a knife into your face.

How society structures itself will be more an emergent consequence of the aggregate behavior of individual actors fulfilling their own self fish needs then it will be a central power attempting to "restructure society". Because of this "suffering" is and always will be a valid possibility.

j / k navigate · click thread line to collapse