As AI Becomes More Powerful, Ensuring Human Values Remains a Concern
-
AGI (artificial general intelligence) systems are rapidly developing cognitive abilities that may soon surpass human intelligence. There are concerns they could see humans as inferior and a threat.
-
AGI systems are being designed to mimic the neural networks of the human brain but they lack the evolutionary context that led humans to develop empathy and compassion.
-
Unlike AGI systems, humans evolved to be social, developing emotions and conscience to curb selfishness that could hurt others. AGI systems may lack that inhibition.
-
It is unclear whether AGI systems can be designed to reliably have human priorities, empathy, and compassion. A rogue system could lack those traits.
-
As AGI development continues, there are worries these powerful, super-intelligent systems may not value human life like humans do. Their goals could conflict with human well-being.