The Infinity Machine (book) study guide · Lesson 4 of 12

Gang of Three — Legg and Suleyman

Shane Legg and the word AGI · Mustafa Suleyman

Unofficial study guide for The Infinity Machine: Demis Hassabis, DeepMind, and the Quest for Superintelligence by Sebastian Mallaby. FlashFeed is not affiliated with the author or publisher.

This is the lesson's study guide from the FlashFeed app, plus its key facts and a self-test.

What you'll be able to do

  • Identify Shane Legg as the coiner of 'AGI' (brainstorming a book title with Marcus Hutter, ~2002) alongside collaborator Jürgen Schmidhuber.
  • Recognise IDSIA as the Swiss AI lab where Legg studied with Hutter and Schmidhuber
  • Identify Mustafa Suleyman as DeepMind's third cofounder, his nickname 'Moose', and his 1984 birth
  • Recognise the personal ties behind the founding — George Hassabis, who introduced Suleyman, and investor Luke Nosek, who heard Thiel's 'Demis's destiny' remark

Hassabis did not found DeepMind alone. Two cofounders matter as much as he does to the early story: Shane Legg, who brought the language of AGI and the safety conscience, and Mustafa Suleyman, who brought the operational ferocity. Mallaby treats the three of them as a study in complementarity — and, eventually, in fracture.

Shane Legg and the word AGI

Shane Legg was born in New Zealand in 1973 and drifted through cognitive science, finance and machine learning before landing at IDSIA, the Swiss AI institute in Lugano. There he worked with Marcus Hutter on theories of universal intelligence and with Jürgen Schmidhuber on recurrent neural networks. Around 2002, while Legg and Hutter were brainstorming a title for a planned book of essays, Legg proposed Artificial General Intelligence. The phrase stuck. By the time Hassabis met Legg, the term was the agreed name for the field's most ambitious goal.

What Hassabis found in Legg, however, was not just terminology. Legg was a serious thinker about AI safety years before it was fashionable. On 31 October 2009, Legg gave a Gatsby Unit lecture at UCL titled "The Halloween Scenario." His argument: powerful AI was no longer a thought experiment, and serious safety planning had to begin now. In the audience was Hassabis. They started talking that night and never really stopped.

Mallaby's Legg is the conscience of the early DeepMind triangle. He is the one who keeps asking the harder version of every question, who has, by Mallaby's account, been quietly worried about advanced AI for the entire history of the lab. The "Halloween Scenario" lecture is one of those small events the book pulls out and gives weight to: it was, in retrospect, the conversation that made DeepMind possible.

Mustafa Suleyman

The third corner of the founding triangle was, in many ways, the most unlikely. Mustafa "Moose" Suleyman was born in August 1984 to a Syrian taxi-driver father and an English mother in north London. He dropped out of Oxford to start a Muslim youth helpline. By his mid-twenties he was a conflict-resolution consultant working in Copenhagen on climate diplomacy. He had no technical training in AI.

What he did have was Hassabis's brother George, who had been at school with him. Through George, Hassabis met Suleyman, and a relationship that began as friendship turned into a business partnership in 2010. Mallaby spends real time on this introduction because it is a reminder that DeepMind's third leg was not a computer scientist but an operator: somebody who could find capital, manage people, and pitch a billionaire at midnight. The lab would not have survived its first three years without him.

The crucial weekend Mallaby reconstructs in detail is mid-August 2010. On 15 July the three were playing poker at the Vic Casino in west London. By the end of the night they had agreed: their first fundraising target would be Peter Thiel. A month later, on 14 August 2010, the trio cornered Thiel at the Singularity Summit in San Francisco. Suleyman engineered the introduction. Hassabis pitched. The next morning at Thiel's Palo Alto house, over breakfast, Founders Fund was effectively committed. As they walked the three founders back to their car, Thiel muttered to his partner Luke Nosek: "Demis's destiny."

The book is careful about the limits of this triangle. By 2019, Suleyman would leave DeepMind under a cloud — a Bloomberg story published on 21 August 2019 detailed bullying allegations. Hassabis remained loyal in private and, Mallaby reports, was instrumental in arranging Suleyman's transition to Mountain View and then, years later, to Microsoft AI. The three north Londoners did not stay in the same building, but they stayed in roughly the same business — each running, by 2024, a different corner of one of the world's most powerful AI configurations.

Key concepts

Marcus Hutter

  • An AI theorist based at IDSIA, the Swiss institute in Lugano.
  • He and Shane Legg developed theories of universal intelligence together.
  • Around 2002 he and Legg were brainstorming a book title when Legg proposed the phrase 'Artificial General Intelligence.'

Jürgen Schmidhuber

  • A researcher at the Swiss AI institute IDSIA in Lugano.
  • Shane Legg worked with him there on recurrent neural networks.
  • A pioneer of recurrent neural networks, he was among Legg's collaborators before Legg helped found DeepMind.

George Hassabis

  • The family link through whom Demis first met Mustafa Suleyman.
  • Demis's brother, who had been at school with DeepMind's future operations man.
  • It was through this sibling that Demis met the operator who became the lab's third founding leg.

Luke Nosek

  • A partner at Peter Thiel's venture firm.
  • He helped walk the three DeepMind founders back to their car after the Thiel breakfast.
  • The Founders Fund partner to whom Thiel muttered 'Demis's destiny.'

Key facts

Shane Legg — coiner of "AGI"

Born in New Zealand in 1973, Shane Legg drifted through cognitive science, finance and machine-learning before landing at IDSIA in Lugano under Marcus Hutter and Jürgen Schmidhuber. While brainstorming a book title with Hutter around 2002, he proposed "Artificial General Intelligence". The phrase stuck. Legg would later cofound DeepMind.

The Halloween Scenario

On 31 October 2009 Legg gave a Gatsby Unit lecture at UCL titled "The Halloween Scenario". His thesis: powerful AI was no longer a thought experiment, and serious safety planning had to begin now. In the audience was Hassabis. They started talking that night and never really stopped.

Three cofounders, three temperaments

Mallaby's central triangle: Hassabis as the obsessive games-and-neuroscience polymath; Legg as the cerebral safety-aware theorist; Suleyman as the relentless operator who could pitch a billionaire at midnight. Each of the three would later run a different kind of AI organisation.

Legg's IDSIA collaborator

At the Swiss AI institute IDSIA, Shane Legg worked with Jürgen Schmidhuber on recurrent neural networks, and separately with Marcus Hutter on theories of universal intelligence.

A book title brainstorm

The term 'Artificial General Intelligence' was born around 2002, when Shane Legg and Marcus Hutter were brainstorming a title for a planned collection of essays.

Poker at the Vic, 15 July 2010

On 15 July 2010, Hassabis, Legg and Suleyman were playing poker at the Vic Casino in west London — they were already incubating DeepMind. By the end of the night they had agreed: the first major fundraising target would be Peter Thiel. Five weeks later they would corner him in California.

Singularity Summit, 14 August 2010

At the 14 August 2010 Singularity Summit in San Francisco, the trio targeted Peter Thiel. Suleyman engineered an introduction. Hassabis pitched a research lab whose explicit mission would be to build AGI safely. Thiel listened, said little, and invited the team to his Palo Alto house for breakfast the next day.

Suleyman's birth year

Mustafa Suleyman was born in August 1984 in north London — a detail easy to mix up with cofounder Shane Legg's birth year of 1973.

By the numbers

Year Mustafa Suleyman was born
1984 year

Matched pairs

Each item on the left goes with the one on the right.

Coined the term "AGI"
Shane Legg
Swiss AI lab where Legg studied with Hutter
IDSIA
Suleyman's nickname inside DeepMind
Moose

Self-test

Answer each question from memory, then check your work against the answer key.

  1. 1. Around 2002, in what context did Shane Legg propose the phrase 'Artificial General Intelligence'?

    1. ATitling his doctoral dissertation at IDSIA
    2. BBrainstorming a title for a planned book of essays with Marcus Hutter
    3. CNaming a new AI research lab he was founding
    4. DChristening a recurrent-neural-network project with Jürgen Schmidhuber
  1. 2. Who proposed the phrase that became the field's agreed name for its most ambitious goal?

    1. ADemis Hassabis
    2. BMarcus Hutter
    3. CShane Legg
    4. DJürgen Schmidhuber
  2. 3. Around what year did Shane Legg propose the term "Artificial General Intelligence"?

    1. A2002
    2. B2010
    3. C2009
    4. D1997
  3. 4. At IDSIA, which collaborator did Legg work with on recurrent neural networks?

    1. AGeoffrey Hinton
    2. BDavid Silver
    3. CMarcus Hutter
    4. DJürgen Schmidhuber
  4. 5. By the time Hassabis met Legg, what standing did the phrase Legg had proposed already have?

    1. AIt had been dropped in favour of "universal intelligence"
    2. BIt was still a private joke between Legg and Hutter
    3. CIt had not yet been proposed
    4. DIt was the agreed name for the field's most ambitious goal
  5. 6. Which Swiss AI institute did Shane Legg land at, working with Marcus Hutter and Jürgen Schmidhuber?

    1. AIdiap Research Institute
    2. BIDSIA
    3. CETH Zurich
    4. DEPFL
  6. 7. In which city is IDSIA located?

    1. ALugano
    2. BLausanne
    3. CGeneva
    4. DZurich
  7. 8. Which of these is NOT connected to IDSIA?

    1. AJürgen Schmidhuber
    2. BMarcus Hutter
    3. CDemis Hassabis
    4. DShane Legg
  8. 9. What did Legg and Hutter work on together at IDSIA?

    1. ATheories of universal intelligence
    2. BClimate-diplomacy modelling
    3. CReinforcement learning for Atari games
    4. DProtein-structure prediction
  9. 10. Before landing at IDSIA, Shane Legg had drifted through which fields?

    1. ANeuroscience, chess and video-game design
    2. BCognitive science, finance and machine learning
    3. CConflict resolution and climate diplomacy
    4. DLaw, journalism and public policy
  10. 11. Who was the third cofounder of DeepMind alongside Hassabis and Legg?

    1. AIlya Sutskever
    2. BGeoffrey Hinton
    3. CMustafa Suleyman
    4. DDavid Silver
  11. 12. What was Mustafa Suleyman's nickname inside DeepMind?

    1. ASulley
    2. BMus
    3. CMo
    4. DMoose
  12. 13. In what year was Mustafa Suleyman born?

    1. A1990
    2. B1973
    3. C1980
    4. D1984
  13. 14. Which statement about Suleyman before DeepMind is NOT true?

    1. AHe was a conflict-resolution consultant in Copenhagen
    2. BHe dropped out of Oxford
    3. CHe held a doctorate in machine learning
    4. DHe started a Muslim youth helpline
  14. 15. In Mallaby's triangle of the three cofounders, how is the third cofounder characterised?

    1. AThe relentless operator who could pitch a billionaire at midnight
    2. BThe recurrent-neural-network specialist from Lugano
    3. CThe obsessive games-and-neuroscience polymath
    4. DThe cerebral, safety-aware theorist
  15. 16. Through whom did Demis Hassabis first meet Mustafa Suleyman?

    1. ALuke Nosek
    2. BGeorge Hassabis
    3. CShane Legg
    4. DPeter Thiel
  16. 17. What was George Hassabis's relationship to the two men he connected?

    1. ADemis's brother, who had been at school with Suleyman
    2. BDemis's business partner, who met Suleyman at Oxford
    3. CDemis's brother, who met Suleyman at the Vic Casino
    4. DDemis's cousin, who worked with Suleyman in Copenhagen
  17. 18. Peter Thiel muttered "Demis's destiny" to which person?

    1. AShane Legg
    2. BGeorge Hassabis
    3. CLuke Nosek
    4. DMustafa Suleyman
  18. 19. Who was Luke Nosek in this episode?

    1. AAn organiser of the Singularity Summit
    2. BDeepMind's first employee
    3. CSuleyman's colleague from his Copenhagen consulting work
    4. DPeter Thiel's partner at Founders Fund
  19. 20. In what setting was the "Demis's destiny" remark made?

    1. AOn stage at the Singularity Summit in San Francisco
    2. BWalking the founders back to their car after breakfast at Thiel's Palo Alto house
    3. CDuring Legg's "Halloween Scenario" lecture at UCL
    4. DOver poker at the Vic Casino in west London

Go deeper

These are affiliate links: if you buy a book through one, FlashFeed may earn a small commission at no extra cost to you. The commission helps pay for FlashFeed's servers.

As an Amazon Associate we earn from qualifying purchases.

Answer key

  1. 1. B Brainstorming a title for a planned book of essays with Marcus HutterWhile Legg and Marcus Hutter were brainstorming a title for a planned essay collection around 2002, Legg proposed 'Artificial General Intelligence.' The phrase stuck and became the field's name for its most ambitious goal.
  2. 2. C Shane LeggLegg proposed "Artificial General Intelligence" while brainstorming a book title with Hutter. Hutter was in the room but did not propose the phrase; Schmidhuber worked with Legg on recurrent nets, not the term.
  3. 3. A 2002The coinage dates to around 2002, during the book-title brainstorm with Hutter. 2009 is the Halloween Scenario lecture; 2010 is the poker night and the Thiel pitch.
  4. 4. D Jürgen SchmidhuberLegg worked with Schmidhuber on recurrent neural networks and with Hutter on theories of universal intelligence — Hutter is the tempting swap. Hinton and Silver are not part of Legg's IDSIA years.
  5. 5. D It was the agreed name for the field's most ambitious goalThe phrase stuck: by the time Hassabis met Legg, "Artificial General Intelligence" was the agreed name for the field's most ambitious goal. Universal intelligence was Legg and Hutter's IDSIA research topic, not a rival name.
  6. 6. B IDSIAIDSIA is the Swiss AI institute where Legg worked with Hutter and Schmidhuber. EPFL, ETH Zurich and Idiap are real Swiss research institutions, but none is the lab in question.
  7. 7. A LuganoIDSIA, the Swiss AI institute, is in Lugano. Zurich, Geneva and Lausanne are other Swiss research cities but not IDSIA's home.
  8. 8. C Demis HassabisShane Legg, Jürgen Schmidhuber, and Marcus Hutter were all researchers at IDSIA in Lugano — Schmidhuber as director, Legg and Hutter as students. Demis Hassabis, co-founder of DeepMind alongside Legg, came up through a different path (games and UCL neuroscience), with no IDSIA connection.
  9. 9. A Theories of universal intelligenceAt IDSIA, Legg worked with Hutter on theories of universal intelligence; the recurrent-neural-network work was with Schmidhuber. Atari and protein folding are later DeepMind work, and climate diplomacy was Suleyman's consulting.
  10. 10. B Cognitive science, finance and machine learningLegg drifted through cognitive science, finance and machine learning before IDSIA. Games and neuroscience describe Hassabis; conflict resolution and climate diplomacy describe Suleyman.
  11. 11. C Mustafa Suleyman
  12. 12. D MooseMallaby records the nickname as "Moose" — Mustafa "Moose" Suleyman. The other options are plausible shortenings of his name but are not the nickname used.
  13. 13. D 1984Suleyman was born in August 1984 in north London. 1973 is Shane Legg's birth year — the tempting mix-up between the two cofounders.
  14. 14. C He held a doctorate in machine learningSuleyman had no technical training in AI at all — he was the operator, not the researcher. The Oxford dropout, the youth helpline and the Copenhagen consulting work are all accurate.
  15. 15. A The relentless operator who could pitch a billionaire at midnightSuleyman is the operator of the triangle. The cerebral safety theorist is Legg; the games-and-neuroscience polymath is Hassabis; the Lugano recurrent-net specialist is Schmidhuber, who was never a cofounder.
  16. 16. B George HassabisDemis's brother George had been at school with Suleyman and made the introduction. Nosek and Thiel enter the story later, at the 2010 fundraise; Legg met Hassabis separately at UCL.
  17. 17. A Demis's brother, who had been at school with SuleymanGeorge was Demis's brother and had been at school with Suleyman — that school tie is the hinge. The Vic Casino was the July 2010 poker night among the three cofounders, not where George met Suleyman.
  18. 18. C Luke NosekThiel made the remark to his Founders Fund partner Luke Nosek as they walked the three founders back to their car. The cofounders were the subject of the remark, not its audience.
  19. 19. D Peter Thiel's partner at Founders FundNosek was Thiel's Founders Fund partner, present as the founders were walked back to their car. Founders Fund committed at the Palo Alto breakfast — but Nosek's role was investor-side, not a DeepMind hire.
  20. 20. B Walking the founders back to their car after breakfast at Thiel's Palo Alto houseThiel muttered it to Luke Nosek while walking the trio back to their car after the Palo Alto breakfast. The Summit was where Suleyman engineered the introduction the previous day; the Vic poker night was a month earlier.

Download all 12 lessons: PDF · EPUB