The Drum Awards for Marketing - Extended Deadline

-d -h -min -sec

Google Artificial Intelligence Technology

Google turns to University of Oxford to create DeepMind 'Off' switch

Author

By Gillian West, Social media manager

June 4, 2016 | 2 min read

Google has teamed up with scientists at the University of Oxford to ensure that its AI, DeepMind, won't be able to overpower human control by creating, what is essentially, an off switch.

Revealed in a peer-reviewed paper titled 'Safely Interruptible Agents', the framework allows a human operator to safely interrupt an AI without the AI learning how to prevent or induce interruptions.

"If such an agent (AI) is operating in real-time under human supervision, now and then it may be necessary for a human operator to press the big red button to prevent the agent from continuing a harmful sequence of actions - harmful either for the agent or for the environment - and lead the agent to into a safer situation."

Speaking to Business Insider, Google DeepMind scientist and one of the paper's writers, Laurent Orseau, explained: "If the agent expects a reward but can predict it's going to be shut down. It will try to resist so as to get its reward.

"Our framework allows the human supervisor to temporarily take control of the agent and make it believe it chooses to shut down itself."

The acquisition of DeepMind by Google in 2014 came under the condition it set up an ethics board to insure the technology was not abused.

Google Artificial Intelligence Technology

More from Google

View all

Trending

Industry insights

View all
Add your own content +