https://www.vice.com/en_us/article/93aqep/google-deepmind-researcher-co-authors-paper-saying-ai-will-eliminate-humanity

After years of development, AI is now driving cars on public roads, making life-changing assessments for people in correctional settings, and generating award-winning art. A longstanding question in the field is whether a superintelligent AI could break bad and take out humanity, and researchers from the University of Oxford and Google Deepmind have now concluded that it’s “likely” in new research.

The paper, published last month in the peer-reviewed AI Magazine, is a fascinating one that tries to think through how artificial intelligence could pose an existential risk to humanity by looking at how reward systems might be artificially constructed.