The Alpha of ‘Go’. What is AlphaGo? | by Christopher Golizio | Apr, 2021 | Medium – Medium
Posted: April 24, 2021 at 1:58 am
Photo by Maximalfocus on Unsplash
The game of Go is believed to be the oldest, continuously played board game in the world. It was invented in China, over 2,500 years ago, and is still wildly popular to this day. A survey taken in 2016 found there to be around 20 million Go players worldwide, though they mostly live in Asia. The game board uses a grid system, and requires two players. Each player places either black or white stones on the board, one after another. If player A surrounds player Bs stone(s), then any surrounded stone is removed from the board, and later factors in to player As score. If a player connects a series of stones, the number of squares within that connected series will be at least a portion of the final score for that player. The player with the most points wins.
Of course that explanation of the game was over-simplified, but the game itself actually appears to be simple as well. This is true, in terms of the rules and the goal of the game, however the sheer number of legal board positions is over two times the total number of atoms in the observable universe (Go: 2.1*10, Atoms: 1*10). The incomprehensible amount of moves alone add an extreme level of complexity to the game. On top of that, it was, for a long time, believed that Go required a certain level of human intuition to excel at the game, however the reigning world champion of Go inherently disagrees with this particular assessment.
It was believed not too long ago that a computer would never be able to beat a high ranking human Go player. Its happened in other similar style games, namely chess. In 1997 a computer developed by IBM named Deep Blue beat Garry Kasparov, the reigning world chess champ, using the standard regulated time. Deep Blue used a brute force approach. This involves searching every possible move of each piece (both sides of the board) before ultimately choosing which move would give it the highest probability of winning. This was more a big win for hardware; AlphaGo is something completely different.
AlphaGo, developed by artificial intelligence research company Deep Mind, is the result of combining machine learning and tree search techniques, specifically the Monte Carlo tree search, along with extensive training. Its training consisted of playing games, and was carried out by both human and computer play. The decision making is executed via a deep neural network, which implements both a value network and a policy network. These two networks guide the hand of which tree branch should be traversed, and which should be ignored due to a low probability of winning. This greatly decreases the time complexity of AlphaGos operations, while also improving itself over time.
After being acquired by Google, and a couple of new versions, AlphaGo was eventually succeeded by AlphaGo Zero. AlphaGo Zero differed from its predecessor by being completely self-taught. All versions of AlphaGo were trained in part by showing it human played games. AlphaGo Zero however, did not use any dataset fed to it by humans. Even though it pursued a goal blindly, AlphaGo Zero was able to learn and improve until it was able to surpass the all versions of the original AlphaGo in a mere 40 days. Eventually AlphaGo Zero was generalized into AlphaZero.
AlphaGo, and the familial programs which succeeded it, were a major breakthrough in the world of AI. Driven of course by the hard work of many developers, and also due to the self-improvement capability, this is far from the ceiling of AlphaGos full potential. AlphaGo Zero and Alpha Zero further this; due to their lack of human-backed training, the probability is high of a completely generalized AI algorithm, which could be applied to many different and diverse situations, and over a period of time, begin to function at a level of which humans are easily outperformed.
Two more fun facts: Along with Go and chess, MuZero, the successor to AlphaZero, is also capable of playing at least 57 different Atari games at a superhuman level. Additionally, the hardware cost of a single unit used for the AlphaGo Zero system was quoted at $25 Million.
Continue reading here:
The Alpha of 'Go'. What is AlphaGo? | by Christopher Golizio | Apr, 2021 | Medium - Medium
- Facebooks Hanabi-playing AI achieves state-of-the-art results - VentureBeat [Last Updated On: December 11th, 2019] [Originally Added On: December 11th, 2019]
- Biggest scientific discoveries of the 2010s decade: photos - Business Insider [Last Updated On: December 11th, 2019] [Originally Added On: December 11th, 2019]
- DeepMind co-founder moves to Google as the AI lab positions itself for the future - The Verge [Last Updated On: December 11th, 2019] [Originally Added On: December 11th, 2019]
- AlphaGo - Wikipedia [Last Updated On: December 11th, 2019] [Originally Added On: December 11th, 2019]
- DeepMind Vs Google: The Inner Feud Between Two Tech Behemoths - Analytics India Magazine [Last Updated On: December 18th, 2019] [Originally Added On: December 18th, 2019]
- AI is dangerous, but not for the reasons you think. - OUPblog [Last Updated On: December 18th, 2019] [Originally Added On: December 18th, 2019]
- The Perils and Promise of Artificial Conscientiousness - WIRED [Last Updated On: December 18th, 2019] [Originally Added On: December 18th, 2019]
- AI has bested chess and Go, but it struggles to find a diamond in Minecraft - The Verge [Last Updated On: December 18th, 2019] [Originally Added On: December 18th, 2019]
- What is AlphaGo? - Definition from WhatIs.com [Last Updated On: December 22nd, 2019] [Originally Added On: December 22nd, 2019]
- What are neural-symbolic AI methods and why will they dominate 2020? - The Next Web [Last Updated On: January 18th, 2020] [Originally Added On: January 18th, 2020]
- AlphaZero beat humans at Chess and StarCraft, now it's working with quantum computers - The Next Web [Last Updated On: January 18th, 2020] [Originally Added On: January 18th, 2020]
- Why asking an AI to explain itself can make things worse - MIT Technology Review [Last Updated On: January 29th, 2020] [Originally Added On: January 29th, 2020]
- Why The Race For AI Dominance Is More Global Than You Think - Forbes [Last Updated On: February 10th, 2020] [Originally Added On: February 10th, 2020]
- AI on steroids: Much bigger neural nets to come with new hardware, say Bengio, Hinton, and LeCun - ZDNet [Last Updated On: February 10th, 2020] [Originally Added On: February 10th, 2020]
- I think, therefore I am said the machine to the stunned humans - Innovation Excellence [Last Updated On: February 10th, 2020] [Originally Added On: February 10th, 2020]
- From Deception to Attrition: AI and the Changing Face of Warfare - War on the Rocks [Last Updated On: February 20th, 2020] [Originally Added On: February 20th, 2020]
- Levels And Limits Of AI - Forbes [Last Updated On: February 20th, 2020] [Originally Added On: February 20th, 2020]
- How to overcome the limitations of AI - TechTarget [Last Updated On: February 20th, 2020] [Originally Added On: February 20th, 2020]
- The top 5 technologies that will change health care over the next decade - MarketWatch [Last Updated On: February 25th, 2020] [Originally Added On: February 25th, 2020]
- Chess grandmaster Gary Kasparov predicts AI will disrupt 96 percent of all jobs - The Next Web [Last Updated On: February 25th, 2020] [Originally Added On: February 25th, 2020]
- Enterprise AI Books to Read This Spring - DevOps.com [Last Updated On: March 14th, 2020] [Originally Added On: March 14th, 2020]
- The New ABCs: Artificial Intelligence, Blockchain And How Each Complements The Other - JD Supra [Last Updated On: March 14th, 2020] [Originally Added On: March 14th, 2020]
- The Turing Test is Dead. Long Live The Lovelace Test - Walter Bradley Center for Natural and Artificial Intelligence [Last Updated On: April 8th, 2020] [Originally Added On: April 8th, 2020]
- QuickBooks is still the gold standard for small business accounting. Learn how it's done now. - The Next Web [Last Updated On: April 19th, 2020] [Originally Added On: April 19th, 2020]
- This A.I. makes up gibberish words and definitions that sound astonishingly real - Digital Trends [Last Updated On: May 17th, 2020] [Originally Added On: May 17th, 2020]
- The Hardware in Microsofts OpenAI Supercomputer Is Insane - ENGINEERING.com [Last Updated On: June 5th, 2020] [Originally Added On: June 5th, 2020]
- Why the buzz around DeepMind is dissipating as it transitions from games to science - CNBC [Last Updated On: June 5th, 2020] [Originally Added On: June 5th, 2020]
- AlphaGo (2017) - Rotten Tomatoes [Last Updated On: June 5th, 2020] [Originally Added On: June 5th, 2020]
- AlphaGo - Top Documentary Films [Last Updated On: June 5th, 2020] [Originally Added On: June 5th, 2020]
- Enterprise hits and misses - contactless payments on the rise, equality on the corporate agenda, and Zoom and Slack in review - Diginomica [Last Updated On: June 8th, 2020] [Originally Added On: June 8th, 2020]
- Is Dystopian Future Inevitable with Unprecedented Advancements in AI? - Analytics Insight [Last Updated On: June 26th, 2020] [Originally Added On: June 26th, 2020]
- Test your Python skills with these 10 projects - Best gaming pro [Last Updated On: October 3rd, 2020] [Originally Added On: October 3rd, 2020]
- In the Know - UCI News [Last Updated On: October 3rd, 2020] [Originally Added On: October 3rd, 2020]
- How to Understand if AI is Swapping Civilization - Analytics Insight [Last Updated On: October 3rd, 2020] [Originally Added On: October 3rd, 2020]
- Investing in Artificial Intelligence (AI) - Everything You Need to Know - Securities.io [Last Updated On: November 2nd, 2020] [Originally Added On: November 2nd, 2020]
- What the hell is reinforcement learning and how does it work? - The Next Web [Last Updated On: November 2nd, 2020] [Originally Added On: November 2nd, 2020]
- An AI winter may be inevitable. What we should fear more: an AI ice age - ITProPortal [Last Updated On: December 4th, 2020] [Originally Added On: December 4th, 2020]
- Are Computers That Win at Chess Smarter Than Geniuses? - Walter Bradley Center for Natural and Artificial Intelligence [Last Updated On: December 4th, 2020] [Originally Added On: December 4th, 2020]
- What are proteins and why do they fold? - DW (English) [Last Updated On: December 12th, 2020] [Originally Added On: December 12th, 2020]
- Are we ready for bots with feelings? Life Hacks by Charles Assisi - Hindustan Times [Last Updated On: December 12th, 2020] [Originally Added On: December 12th, 2020]
- Examining the world through signals and systems - MIT News [Last Updated On: February 10th, 2021] [Originally Added On: February 10th, 2021]
- How AI is being used for COVID-19 vaccine creation and distribution - TechRepublic [Last Updated On: April 24th, 2021] [Originally Added On: April 24th, 2021]
- The 13 Best Deep Learning Courses and Online Training for 2021 - Solutions Review [Last Updated On: April 24th, 2021] [Originally Added On: April 24th, 2021]
- Why AI That Teaches Itself to Achieve a Goal Is the Next Big Thing - Harvard Business Review [Last Updated On: April 24th, 2021] [Originally Added On: April 24th, 2021]
- How will Edge Artificial Intelligence (AI) Chips Take IoT Devices to the Next Level - Enterprise Apps Today [Last Updated On: July 6th, 2022] [Originally Added On: July 6th, 2022]
- Machines with Minds? The Lovelace Test vs. the Turing Test - Walter Bradley Center for Natural and Artificial Intelligence [Last Updated On: July 6th, 2022] [Originally Added On: July 6th, 2022]
- For AI to Be Creative, Here's What It Would Take - Discovery Institute [Last Updated On: July 6th, 2022] [Originally Added On: July 6th, 2022]
- What is my chatbot thinking? Nothing. Here's why the Google sentient bot debate is flawed - Diginomica [Last Updated On: August 7th, 2022] [Originally Added On: August 7th, 2022]
- Incoherent, creepy and gorgeous: we asked six leading artists to make work using AI and here are the results - The Guardian [Last Updated On: December 4th, 2022] [Originally Added On: December 4th, 2022]
- Top 5 Applications of Reinforcement Learning in Real-Life - Analytics Insight [Last Updated On: December 4th, 2022] [Originally Added On: December 4th, 2022]
- OpenAI tweaks ChatGPT to avoid dangerous AI information - The Register [Last Updated On: December 4th, 2022] [Originally Added On: December 4th, 2022]
- Go champion who faced off against Google's AlphaGo says the rise of AI strips the games of artistry - DIGITIMES [Last Updated On: April 4th, 2024] [Originally Added On: April 4th, 2024]