AI is now beating us at poker, but not even Google co-founder Sergey Brin can say with any certainty what the next steps for machine learning are
Ten days ago, in a Davos still shellshocked by Trumps victory, one of the former masters of the universe sat down with an interviewer to talk about artificial intelligence (AI) and the future. His name is Sergey Brin and he is one of the co-founders of Google. The tone of the conversation was thoughtful but subdued, possibly because Brin is not a master in Trumps universe, but mainly because hes a smart and thoughtful guy. When asked about the future of AI he replied sensibly that it was impossible to forecast accurately and followed up with a story from his own experience.
Ten years ago, Brin was running Googles X lab, the place where they work on projects that have, at best, a 100-1 chance of success. One little project there was called Google Brain, which focused on AI. To be perfectly honest, Brin said, I didnt pay any attention to it at all. Brain was headed by a computer scientist named Jeff Dean who, Brin recalled, would periodically come up to me and say, Look the computer made a picture of a cat! and I would say, OK, thats very nice, Jeff go do your thing, whatever. Fast-forward a few years and now Brain probably touches every single one of our main projects ranging from search to photos to ads everything we do. This revolution in deep nets has been very profound and definitely surprised me even though I was right in there. I could, you know, throw paper clips at Jeff.
Fast-forward a week from that interview and cut to Pittsburgh, where four leading professional poker players are pitting their wits against an AI program created by two Carnegie Mellon university researchers. Theyre playing a particular kind of high-stakes poker called heads-up no-limit Texas holdem. The program is called Libratus, which is Latin for balanced. There is, however, nothing balanced about its performance. Just over halfway through the 20-day game, Libratus was $800,000 up on the humans, some of whom were beginning to feel depressed. I didnt realise how good it was until today, said one of them, Dong Kim. I felt like I was playing against someone who was cheating, like it could see my cards. Im not accusing it of cheating. It was just that good.
The match doesnt end until tomorrow (you can follow it via the hashtag #brainsvsai) and so we dont know yet if the computer will win. But even if it doesnt, another milestone has been passed on the road to artificial intelligence, because the Pittsburgh contest has shown that a machine can play a pretty mean game of poker against real human experts. This is a big deal, because poker requires reasoning and intelligence that have up until now eluded machines. Theres no single optimal move and the machine has to change its tactics to ensure that its opponents find it hard to guess when its bluffing. Poker, says Will Knight, a robotics expert, is fundamentally different from checkers, chess, or Go because an opponents hand remains hidden from view during play. In games of imperfect information, it is enormously complicated to figure out the ideal strategy given every possible approach your opponent may be taking. And no-limit Texas holdem is especially challenging because an opponent could essentially bet any amount.
The Pittsburgh contest will definitely take its place in a sequence of significant stages in the road to some kind of AI. Earlier ones have included IBMs 1997 Deep Blue victory over Garry Kasparov in chess, its Watson machines victory in the Jeopardy! quiz game in 2011 and DeepMinds AlphaGo beating the world Go champion in March 2016. Each of these was, understandably, regarded as a stunning achievement at the time, but in reality they were baby steps on what looks like being a very long journey, despite all the hype about superintelligence.