Embed Size (px)
Citation preview
General Game Playing: Challenges and Opportunities 1 of 19 Amin Babadi
In The Name Of God
General Game Playing Challenges and Opportunities
Amin Babadi1, Majid Rouhani2 1Isfahan University of Technology, 2Islamic Azad University of Kashan
2016 Conference on Computer Games: Challenges and Opportunities (CGCO 2016)
General Game Playing: Challenges and Opportunities 2 of 19 Amin Babadi
Outline
General Game Playing (GGP)
Applications
Benchmarks
Deep Reinforcement Learning
Challenges
Our Work
General Game Playing: Challenges and Opportunities 3 of 19 Amin Babadi
Games as a Benchmark for AI
Alan Turing proposed Chess as an AI benchmark.
Arthur Samuel in 1957, playing checkers against a mainframe computer.
General Game Playing: Challenges and Opportunities 4 of 19 Amin Babadi
Deep Blue
At 1997, IBM’s Deep Blue defeated the reigning human Chess champion, Garry Kasparov.
General Game Playing: Challenges and Opportunities 5 of 19 Amin Babadi
But…
Deep Blue essentially did tree search with plenty of domain-specific heuristics.
o But perhaps other games would be different?
General Game Playing: Challenges and Opportunities 6 of 19 Amin Babadi
General Game Playing
General Game Playing: Challenges and Opportunities 7 of 19 Amin Babadi
In the Language of Mordor
General Game Playing: Challenges and Opportunities 8 of 19 Amin Babadi
One Ring to Rule Them All
General Game Playing: Challenges and Opportunities 9 of 19 Amin Babadi
Why Is GGP So Hard?
Environment Unknown
Partially Observable
Dynamic Non-
Deterministic
Competitive
Multi-Agent
General Game Playing: Challenges and Opportunities 10 of 19 Amin Babadi
Why Is GGP So Interesting?
General Game Playing: Challenges and Opportunities 11 of 19 Amin Babadi
Applications
Artificial general intelligence
o Robotics
AI
o MCTS
o Deep Reinforcement Learning
Video game AI
o Total War Rome II
o Fable Legends
Having fun!
o Nice application don’t you think?!
Other possible applications:
Business process management
Electronic commerce
Military operations
General Game Playing: Challenges and Opportunities 12 of 19 Amin Babadi
Let’s Go!
General Game Playing: Challenges and Opportunities 13 of 19 Amin Babadi
Benchmarks
General Game Playing competition (GGP)
o General Game Playing
Arcade Learning Environment (ALE)
o General Atari Game Playing
General Video Game Artificial Intelligence competition (GVG-AI)
o General Video Game Playing
General Game Playing: Challenges and Opportunities 14 of 19 Amin Babadi
General Game Playing (GGP)
General Game Playing: Challenges and Opportunities 15 of 19 Amin Babadi
Arcade Learning Environment (ALE)
General Game Playing: Challenges and Opportunities 16 of 19 Amin Babadi
General Video Game AI (GVG-AI)
General Game Playing: Challenges and Opportunities 17 of 19 Amin Babadi
Challenges
Machine learning
o Deep reinforcement learning
o Transfer learning
o …
Extending frameworks
o Procedural content generation
o Multiplayer games
o Partial observable games
o Continuous games (states, actions)
o 3D games
o …
Applications
o …
General Game Playing: Challenges and Opportunities 18 of 19 Amin Babadi
Let’s Get to Work!
Model learning for general video game playing
Error diagrams on 10 test games:
General Game Playing: Challenges and Opportunities 19 of 19 Amin Babadi
Thank You Very Much!
Any questions?
Amin Babadi www.ababadi.ece.iut.ac.ir
Majid Rouhani
