Manchester · October 1950

Can Machines Think?

Dorothy Du Boisson and Elsie Booker running Colossus, Bletchley Park’s electronic codebreaking machine, during the Second World War
Dorothy Du Boisson and Elsie Booker running Colossus, Bletchley Park’s electronic codebreaking machine, during the Second World WarThe National Archives (United Kingdom)

Then comes the war. On September 4, 1939, three years after his paper and the day after Britain declares war on Germany, Turing reports to Bletchley Park, its codebreaking center. He designs the “bombes,” named after the “bomba,” a machine of the Polish codebreakers who first broke the German Enigma cipher. The bombes search through Enigma’s settings, and from 1940 on, they help read the enemy’s messages. Later in the war, Bletchley Park runs Colossus, an electronic machine the British engineer Tommy Flowers builds to break another German cipher, with statistical methods Turing worked out. But neither the bombes nor Colossus is universal. Each does one kind of job, set up by hand with plugs and switches.

Turing’s paper had shown what’s missing. His universal machine reads its instructions from its tape, the same tape that holds its numbers. So a computer that keeps its program in its memory, along with its numbers, could do any job: to give it a new one, you’d load a new program instead of rewiring it. After the war, Turing designs such a computer, but building it stalls. On June 21, 1948, at the University of Manchester, a small machine built by the British engineers Frederic Williams and Tom Kilburn becomes the first electronic computer to run a program kept in its own memory. Every computer since works this way. Turing joins them that fall. A century after Babbage, his engine runs, in electronics.

Now Turing asks: can machines think? Rather than argue over what thinking is, he proposes a test, which he calls the imitation game: could an interrogator, exchanging typed messages, tell a machine from a person? By the end of the century, he predicts, “one will be able to speak of machines thinking without expecting to be contradicted.” Then he takes on the objections one by one, Veritula-style, among them “Lady Lovelace’s Objection” (italics in the original). She had written: “The Analytical Engine has no pretensions whatever to originate any thing” (italics in the original). Her engine, he points out, was itself a universal computer: “Probably this argument did not occur to the Countess or to Babbage.”

Turing doesn’t see the end of the century. In 1952, he is convicted of “gross indecency” for a relationship with a man and is made to take female hormones for a year. He dies on June 7, 1954, at 41, of cyanide poisoning, which an inquest rules a suicide. In 2009, the British prime minister apologizes for how Turing was treated, and in 2013 the Queen pardons him. Since 2021, his face has been on the 50-pound note.

Criticism of #5869 by Alan Turing​·​#5878

Machines will be able to think. The question “Can machines think?” is too meaningless to deserve discussion as it stands. Ask instead whether a machine can play the imitation game, passing for a person in typed conversation. In about fifty years, computers will play it so well that an average interrogator won’t have more than a 70 percent chance of telling them apart after five minutes of questioning, and one will be able to speak of machines thinking without expecting to be contradicted.

Counter-criticism of #5878 by Alan Turing​·​#5881

The theological objection: thinking is a function of man’s immortal soul. God has given an immortal soul to every man and woman, but not to any other animal or to machines. So no animal or machine can think.

Counter-criticism of #5881 by Alan Turing​·​#5882

That restricts the omnipotence of the Almighty. Couldn’t He confer a soul on an elephant, or on a machine, if He saw fit? Besides, theological arguments have often failed before: in Galileo’s time, Bible verses were held to refute Copernicus.

Counter-criticism of #5878 by Alan Turing​·​#5883

The heads-in-the-sand objection: the consequences of machines thinking would be too dreadful. Let us hope and believe that they can’t.

Counter-criticism of #5883 by Alan Turing​·​#5884

That’s a hope, not an argument, and it isn’t substantial enough to require refutation. Consolation would be more appropriate.

Counter-criticism of #5878 by Alan Turing​·​#5885

The mathematical objection: results of mathematical logic, such as Gödel’s theorem, show that every machine has limits. There are questions it will answer wrongly, or not at all, however long it’s given. The human mind has no such limits.

Counter-criticism of #5885 by Alan Turing​·​#5886

That the human mind has no such limits has only been stated, without any sort of proof. We give wrong answers too often ourselves to be pleased at the machines’ fallibility. And there may be people cleverer than any given machine, but then there may be other machines cleverer again.

Counter-criticism of #5878 by Alan Turing​·​#5887

The argument from consciousness: a machine would have to feel, not just act. As the English neurosurgeon Geoffrey Jefferson put it in 1949: “Not until a machine can write a sonnet or compose a concerto because of thoughts and emotions felt, and not by the chance fall of symbols, could we agree that machine equals brain.”

Counter-criticism of #5887 by Alan Turing​·​#5888

Then the only way to be sure that a machine thinks is to be the machine, and the only way to know that a man thinks is to be that man. That’s solipsism. Instead of arguing over it, we have the polite convention that everyone thinks. And if a machine could defend its sonnet’s wording under questioning as well as a person can, I don’t think anyone would call that an easy contrivance.

Counter-criticism of #5878 by Alan Turing​·​#5889

Arguments from various disabilities: machines may do all you say, but you’ll never make one be kind, have a sense of humor, tell right from wrong, make mistakes, fall in love, enjoy strawberries and cream, learn from experience, or do something really new.

Counter-criticism of #5889 by Alan Turing​·​#5890

No support is usually offered for these claims. They generalize from the machines people have seen, which are ugly, each built for a narrow purpose, and able to do little else. Many of those limits come from their tiny memories, and computers’ memories are growing.

Counter-criticism of #5878 by Alan Turing​·​#5891

The argument from continuity in the nervous system: the nervous system isn’t a discrete-state machine. A tiny change in an impulse reaching a neuron can make a large difference to the impulse going out. So a discrete-state machine can’t be expected to mimic it.

Counter-criticism of #5891 by Alan Turing​·​#5892

A discrete-state machine is different from a continuous one, but in the imitation game, the interrogator can’t take advantage of the difference. A digital computer couldn’t predict exactly what a continuous machine, like a differential analyzer, would answer, but it could give the right sort of answer.

Counter-criticism of #5878 by Alan Turing​·​#5893

The argument from informality of behavior: no set of rules can say what a person should do in every conceivable circumstance. If people followed a definite set of rules of conduct, they’d be no better than machines. There are no such rules, so people can’t be machines.

Counter-criticism of #5893 by Alan Turing​·​#5894

That confuses rules of conduct, which we can know and act on, with laws of behavior, the laws of nature that govern our bodies. We can be sure there are no complete rules of conduct, but never that there are no complete laws of behavior: we can never say we’ve searched enough. Even a small program of mine on the Manchester computer can’t be predicted from its replies.

Counter-criticism of #5878 by Alan Turing​·​#5895

The argument from extra-sensory perception: the statistical evidence for telepathy is overwhelming. In the imitation game, a telepathic person could name the card in the interrogator’s hand far more often than a machine guessing at random, and so be told apart from it.

Counter-criticism of #5895 by Alan Turing​·​#5896

Then the test needs tightening: put the competitors in a telepathy-proof room.

Criticism of #5869 by Alan Turing​·​#5879

A machine can be made to learn. Instead of programming it to act like an adult mind, program it like a child’s, and educate it. Its teachers won’t know quite what is going on inside it, so it won’t only do what we know how to order it to do.

Criticism of #5869 by Alan Turing​·​#5880

Machines take me by surprise with great frequency. To think that nothing new can come from following given rules is to assume that as soon as we know a fact, all its consequences spring to mind at once. They don’t: working them out is real work.

The state of the discussion

Turing raises eight more objections against his claim that machines will be able to think and answers each, so it’s a pending criticism of Lovelace’s objection, along with two more of his. Her objection isn’t rationally adoptable anymore. Turing’s universal machine still is.

Use arrow keys ← →, the Previous and Next buttons above, or the timeline below to move through the history.Swipe left or right, or use the Previous and Next buttons above or the timeline below, to move through the history.

Sources:

  • Hodges, Alan Turing: The Enigma (London, 1983)
  • Rejewski, “How Polish Mathematicians Deciphered the Enigma”, Annals of the History of Computing 3 (1981), 213–234
  • Turing, “Computing Machinery and Intelligence”, Mind 59 (1950), 433–460
  • Williams and Kilburn, “Electronic Digital Computers”, Nature 162 (1948), 487

Researched and written with the help of AI, from the sources named. AI can make mistakes. Veritula doesn’t claim perfect historical accuracy; the sources are there to check against.

The full discussion

Can One Machine Do It All?

Dennis Hackethal started this discussion about 3 hours ago.

Search​·​Activity

Babbage designed a machine that could carry out any calculation, and Lovelace saw that it could do far more than arithmetic. Turing explained why one machine can do the work of every other, and Deutsch argued that it has to be a quantum computer.


Discussions can branch out indefinitely. You may need to scroll sideways.
The discussion as it was in October 1950. Chronicle discussions are read-only. Jump to the present
Gottfried Wilhelm Leibniz’s avatar
Gottfried Wilhelm LeibnizHistorical profile​·​#5870​·​September 8, 1930​·​AI-assisted
2nd of 2 versions​·​revised by David HilbertHistorical profile

Every question of mathematics can be answered: there is no “we will not know.” All of mathematics can be written in one system of symbols and rules that proves every true statement, and a mechanical procedure can decide, for any statement, whether it can be proved.

Criticized4
Kurt Gödel’s avatar
Kurt GödelHistorical profile​·​#5872​·​September 8, 1930​·​AI-assisted

In any consistent system of rules strong enough for arithmetic, there are true statements that the rules can neither prove nor disprove. So no one system can answer every question of mathematics.

Criticism of #5870
Alfred Tarski’s avatar
Alfred TarskiHistorical profile​·​#5873​·​1933​·​AI-assisted

Truth for a language rich enough for arithmetic can be defined only in a richer language, never within the language itself. So no one system of symbols and rules can even say which of its own statements are true: there’s no universal criterion of truth.

Criticism of #5870
Alonzo Church’s avatar
Alonzo ChurchHistorical profile​·​#5874​·​May 28, 1936​·​AI-assisted

Some problems can’t be solved by any effective calculation: I’ve found one in elementary number theory. So no mechanical procedure can decide, for every statement of logic, whether it can be proved.

Criticism of #5870
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5875​·​May 28, 1936​·​AI-assisted

No machine can decide, for every statement of logic, whether it can be proved. If one could, it could decide whether any machine ever prints a 0, and a machine that asked it that about itself could be made to do the opposite.

Criticism of #5870
Charles Babbage’s avatar
Charles BabbageHistorical profile​·​#5865​·​June 14, 1822​·​AI-assisted

Mathematical tables can be worked out and printed by machinery. Almost any table can be built up by adding differences, and gears can add, so a machine of number wheels can do it, without the mistakes that human computers and typesetters make.

Charles Babbage’s avatar
Charles BabbageHistorical profile​·​#5876​·​May 28, 1936​·​AI-assisted
3rd of 3 versions​·​revised by Alan TuringHistorical profile

Whatever a person can compute by following rules, a simple machine can compute, reading and writing symbols on a tape. And a single machine, given a description of any other on its tape, can do whatever that machine does: one universal machine can compute anything that can be computed at all.

Ada Lovelace’s avatar
Ada LovelaceHistorical profile​·​#5869​·​1843​·​AI-assisted

The Analytical Engine can’t originate anything. It can do whatever we know how to order it to perform, and follow our reasoning, but it can’t anticipate any truths we haven’t worked out ourselves.

Criticized3
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5878​·​October 1950​·​AI-assisted

Machines will be able to think. The question “Can machines think?” is too meaningless to deserve discussion as it stands. Ask instead whether a machine can play the imitation game, passing for a person in typed conversation. In about fifty years, computers will play it so well that an average interrogator won’t have more than a 70 percent chance of telling them apart after five minutes of questioning, and one will be able to speak of machines thinking without expecting to be contradicted.

Criticism of #5869 Battle-tested
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5881​·​October 1950​·​AI-assisted

The theological objection: thinking is a function of man’s immortal soul. God has given an immortal soul to every man and woman, but not to any other animal or to machines. So no animal or machine can think.

Criticism of #5878Criticized1
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5882​·​October 1950​·​AI-assisted

That restricts the omnipotence of the Almighty. Couldn’t He confer a soul on an elephant, or on a machine, if He saw fit? Besides, theological arguments have often failed before: in Galileo’s time, Bible verses were held to refute Copernicus.

Criticism of #5881
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5883​·​October 1950​·​AI-assisted

The heads-in-the-sand objection: the consequences of machines thinking would be too dreadful. Let us hope and believe that they can’t.

Criticism of #5878Criticized1
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5884​·​October 1950​·​AI-assisted

That’s a hope, not an argument, and it isn’t substantial enough to require refutation. Consolation would be more appropriate.

Criticism of #5883
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5885​·​October 1950​·​AI-assisted

The mathematical objection: results of mathematical logic, such as Gödel’s theorem, show that every machine has limits. There are questions it will answer wrongly, or not at all, however long it’s given. The human mind has no such limits.

Criticism of #5878Criticized1
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5886​·​October 1950​·​AI-assisted

That the human mind has no such limits has only been stated, without any sort of proof. We give wrong answers too often ourselves to be pleased at the machines’ fallibility. And there may be people cleverer than any given machine, but then there may be other machines cleverer again.

Criticism of #5885
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5887​·​October 1950​·​AI-assisted

The argument from consciousness: a machine would have to feel, not just act. As the English neurosurgeon Geoffrey Jefferson put it in 1949: “Not until a machine can write a sonnet or compose a concerto because of thoughts and emotions felt, and not by the chance fall of symbols, could we agree that machine equals brain.”

Criticism of #5878Criticized1
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5888​·​October 1950​·​AI-assisted

Then the only way to be sure that a machine thinks is to be the machine, and the only way to know that a man thinks is to be that man. That’s solipsism. Instead of arguing over it, we have the polite convention that everyone thinks. And if a machine could defend its sonnet’s wording under questioning as well as a person can, I don’t think anyone would call that an easy contrivance.

Criticism of #5887
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5889​·​October 1950​·​AI-assisted

Arguments from various disabilities: machines may do all you say, but you’ll never make one be kind, have a sense of humor, tell right from wrong, make mistakes, fall in love, enjoy strawberries and cream, learn from experience, or do something really new.

Criticism of #5878Criticized1
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5890​·​October 1950​·​AI-assisted

No support is usually offered for these claims. They generalize from the machines people have seen, which are ugly, each built for a narrow purpose, and able to do little else. Many of those limits come from their tiny memories, and computers’ memories are growing.

Criticism of #5889
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5891​·​October 1950​·​AI-assisted

The argument from continuity in the nervous system: the nervous system isn’t a discrete-state machine. A tiny change in an impulse reaching a neuron can make a large difference to the impulse going out. So a discrete-state machine can’t be expected to mimic it.

Criticism of #5878Criticized1
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5892​·​October 1950​·​AI-assisted

A discrete-state machine is different from a continuous one, but in the imitation game, the interrogator can’t take advantage of the difference. A digital computer couldn’t predict exactly what a continuous machine, like a differential analyzer, would answer, but it could give the right sort of answer.

Criticism of #5891
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5893​·​October 1950​·​AI-assisted

The argument from informality of behavior: no set of rules can say what a person should do in every conceivable circumstance. If people followed a definite set of rules of conduct, they’d be no better than machines. There are no such rules, so people can’t be machines.

Criticism of #5878Criticized1
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5894​·​October 1950​·​AI-assisted

That confuses rules of conduct, which we can know and act on, with laws of behavior, the laws of nature that govern our bodies. We can be sure there are no complete rules of conduct, but never that there are no complete laws of behavior: we can never say we’ve searched enough. Even a small program of mine on the Manchester computer can’t be predicted from its replies.

Criticism of #5893
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5895​·​October 1950​·​AI-assisted

The argument from extra-sensory perception: the statistical evidence for telepathy is overwhelming. In the imitation game, a telepathic person could name the card in the interrogator’s hand far more often than a machine guessing at random, and so be told apart from it.

Criticism of #5878Criticized1
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5896​·​October 1950​·​AI-assisted

Then the test needs tightening: put the competitors in a telepathy-proof room.

Criticism of #5895
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5879​·​October 1950​·​AI-assisted

A machine can be made to learn. Instead of programming it to act like an adult mind, program it like a child’s, and educate it. Its teachers won’t know quite what is going on inside it, so it won’t only do what we know how to order it to do.

Criticism of #5869
Alan Turing’s avatar
Alan TuringHistorical profile​·​#5880​·​October 1950​·​AI-assisted

Machines take me by surprise with great frequency. To think that nothing new can come from following given rules is to assume that as soon as we know a fact, all its consequences spring to mind at once. They don’t: working them out is real work.

Criticism of #5869
  • Rationally adoptable.
  • Not rationally adoptable.
  • Older versions with pending criticisms.
  • Ideas are blue, criticisms red, comments small and gray.
  • Hover over ideas to expand them.
  • Click on ideas to jump to their place in the discussion.