PDA

View Full Version : The Hilarious (and Terrifying) Ways Algorithms Have Outsmarted Their Creators



Aragorn
25th March 2018, 08:30
https://hips.hearstapps.com/hmg-prod.s3.amazonaws.com/images/jumpo-1521142002.gif


Source: Popular Mechanics (https://www.popularmechanics.com/technology/robots/a19445627/the-hilarious-and-terrifying-ways-algorithms-have-outsmarted-their-creators/)



Evolutionary algorithms can turn up ingenious, unexpected solutions. They also love to cheat.


Flying saucers have yet to land—at least, not that we've confirmed (https://www.popularmechanics.com/military/a19421807/video-shows-us-navy-run-in-with-ufo/)—but alien intelligence is already here (https://www.popularmechanics.com/technology/robots/news/a28742/neural-nets-intelligent-aliens/). As research into AI grows ever more ambitious and complex, these robot brains will challenge the fundamental assumptions of how we humans do things. And, as ever, the only true law of robotics is that computers will always do literally, exactly what you tell them to (https://www.popularmechanics.com/technology/gadgets/a20152/dividing-by-zero-will-mechanical-calculator/).

A paper recently published to ArXiv (https://arxiv.org/abs/1803.03453v1) highlights just a handful of incredible and slightly terrifying ways that algorithms think. These AI were designed to reflect evolution by simulating generations while other competing algorithms conquered problems posed by their human masters with strange, uncanny, and brilliant solutions.










My favorite example of when AI surprised us, the scientists wielding it. A corner case in our algo challenged AI to learn to walk without touching its feet to the ground. Many more in https://t.co/7690RlnTwI from @joelbot3000with @jb_mouret (https://twitter.com/jb_mouret?ref_src=twsrc^tfw) @CULLYAntoine (https://twitter.com/CULLYAntoine?ref_src=twsrc^tfw) Cully et al Nature 2015 pic.twitter.com/YtzV7zgwhb (https://t.co/YtzV7zgwhb)

— Jeff Clune (@jeffclune) March 13, 2018 (https://twitter.com/jeffclune/status/973605950266331138?ref_src=twsrc^tfw)










The Surprising Creativity of Digital Evolution: A Collection of Anecdotes from the Evolutionary Computation and Artificial Life Research Communities (https://arxiv.org/abs/1803.03453v1) covers some 27 anecdotes from various computer science projects and is worth a read on its own, but here are a few highlights:



A study designed to evolve moving creatures generated 'hackers' that would break their simulation by clipping into the ground and using the "free energy" of the simulation's correction to speed towards their goal.


An AI project which pit programs against each other in games of five-in-a-row Tic-Tac-Toe on an infinitely expansive board surfaced the extremely successful method of requesting moves involving extremely long memory addresses which would crash the opponent's computer and award a win by default.


A program designed to simulate efficient ways of braking an aircraft as it landed on an aircraft carrier learned that by maximizing the force on landing—the opposite of its actual goal—the variable holding that value would overflow and flip to zero, creating a practically catastrophic, but technically perfect solution.


A test that challenged a simulated robot to walk without allowing its feet to touch the ground saw the robot flip on its back and walk on its elbows (or knees?) as shown in the tweet above.


A study to evolve a simulated creature that could jump as high as possible yielded top-heavy creatures on tiny poles that would fall over and spin in mid-air for a technically high 'jump.'






https://www.youtube.com/watch?v=N9DLEiakkEs



While the most amusing examples are clearly ones where algorithms abused bugs in their simulations (essentially glitches in the Matrix that gave them superpowers (https://twitter.com/JanelleCShane/status/974129150632980480)), the paper outlines (https://arxiv.org/pdf/1803.03453v1.pdf) some surprising solutions that could have practical benefits as well. One algorithm invented a spinning-type movement for robots which would minimize negative effect of inconsistent hardware between bots, for instance.

As the paper notes in its discussion—and you may already be thinking—these amusing stories also reflect the potential for evolutionary algorithms or neural networks to stumble upon solutions to problems that are outside-the-box in dangerous ways. They're a funnier version of the classic AI nightmare where computers tasked with creating peace on Earth decide the most efficient solution is to exterminate the human race.

The solution, the paper suggests, is not fear but careful experimentation. As humans gain more experience in training these sorts of algorithms, and tweaking along the way, experts gain a better sense of intuition. Still, as these anecdotes prove, it's basically impossible to avoid unexpected results. The key is to be prepared—and to not hand over the nuclear arsenal to a robot for its very first test.


Source: Popular Mechanics (https://www.popularmechanics.com/technology/robots/a19445627/the-hilarious-and-terrifying-ways-algorithms-have-outsmarted-their-creators/)

Gale Frierson
25th March 2018, 13:01
Kinda sounds like Dumpy when he's drunk. Hahaha! Sorry! My Bad!

Dumpster Diver
25th March 2018, 13:17
Kinda sounds like Dumpy when he's drunk. Hahaha! Sorry! My Bad!

...umm, I don’t drink, do drugs, or even attend parties. I can count the number of times in my life I was drunk on one hand.

Good or bad, when it comes to managing myself I’m a control freak, I never liked losing control.

...but thanks for thinking about me!

Elen
25th March 2018, 14:10
...umm, I don’t drink, do drugs, or even attend parties. I can count the number of times in my life I was drunk on one hand.

Good or bad, when it comes to managing myself I’m a control freak, I never liked losing control.



I believe you Batman ;)

Dreamtimer
26th March 2018, 13:29
That image is hilarious. "I won the high jump prize because I fell off a pole." Crash your opponent to win by default. That reminds me of Data in Star Trek TNG, playing Stratagema with the super smart, super smug dude. He won by always playing towards a stand-off rather than a win.


https://www.youtube.com/watch?v=yIRT6xRQkf8

Dumpster Diver
26th March 2018, 14:12
genetic programming is still the rage in AI. One lets the computer play out billions of “futures” and then “kills off” those that don’t do well. The challenge is setting up a scoring algorithm that truly matches the goal.

https://en.m.wikipedia.org/wiki/Genetic_programming