the worlds we can lose when intelligence becomes artificial

In 1958, Hannah Arendt could see where were were headed:

This future man, whom the scientists tell us they will produce in no more than a hundred years, seems to be possessed by a rebellion against human existence as it has been given, a free gift from nowhere (secularly speaking), which he wishes to exchange, as it were, for something he has made himself. …

It would be as though our brain, which constitutes the physical, material condition of our thoughts, were unable to follow what we do, so that from now on we would indeed need artificial machines to do our thinking and speaking. If it should turn out to be true that knowledge (in the modern sense of know-how) and thought have parted company tor good, then we would indeed become the helpless slaves, not so much of our machines as of our know-how, thoughtless creatures at the mercy of every gadget which is technically possible, no matter how murderous it is. (Hannah Arendt, The Human Condition, 1958, p. 3)

What is “human existence as it has been given”?

For most of our history, most human beings have lived with other people whose names they know. They have worked individually and collaboratively with materials in their context to make an environment that I will call a “world.”

A world has these features:

  • It is imbued with moral significance, because other people have made it, given it meaning, cared about it, and been affected by it. An individual cannot interact with a world without causing good or harm to other people.
  • It is real, not imaginary, and therefore it is stubborn. It rarely turns out the way we want, but we can learn from experience to work more effectively with it.
  • The other people involved in any world hold partially conflicting interests and goals and can be stubborn in their own way. Both the materials and the people resist any single will.
  • Each person has partial and even biased knowledge, beliefs, and feelings about the world. But their varied ideas can accumulate as they express them and record them. Each person can therefore explore not only a world but the accumulated human experience of that world.
  • Because we must act in the company of other people and learn by acting, our “thinking and speaking” are closely connected.
  • Because our deepest concerns (moral, spiritual, and otherwise) relate to the world that we shape with our minds and hands, our “thought” is also connected to our “know-how.”
  • Each world typically predates each human being and survives the person’s death, yet each person can affect it. In fact, the birth of any human being automatically changes the world, if for no other reason than a birth turns people into parents, siblings, and other kinds of relatives.
  • There is not one world but many human worlds. But worlds can interact to various degrees without becoming subsumed into one bigger world.

Why it is good to live in a world

It is not obvious that living in this kind of world is the best imaginable form of life. Most people have envisioned heaven or a political utopia differently. (For instance, in an ideal world, the other people usually become less stubborn!) But I could make three arguments in favor of living in a world like this.

First, it seems plausible that homo sapiens evolved for such a life. Our brains, senses, and bodies are equipped to navigate it.

For instance, newborn infants already recognize faces, which are designed to communicate information and emotions. And our languages and cultures have accumulated deep resources for sharing a world with finite other human beings. The Proto-Indo-European language already used first-, second-, and third-person verbs and indicative, imperative, and subjunctive moods to make distinctions that are useful for group discussions about a common world. Thus a world is arguably our habitat.

Second, the combination of agency and humility seems morally compelling. It is fitting that we can affect our environment but not do just anything we individually want with it. And we should see our context as imbued with moral significance.

Third, navigating a world is a way for creatures like us to achieve comprehension, to make sense of matters. As Arendt writes:

There may be truths beyond speech, and they may be of great relevance to man in the
singular, that is, to man in so far as he is not a political being, whatever else he may be. Men in the plural, that is, men in so far as they live and move and act in this world, can experience meaningfulness only because they can talk with and make sense to each other and to themselves (1958, p. 4).

Threats to human worlds

Each human world has always been fragile, subject to destruction if invaders arrive, a plague strikes, or the community breaks down.

In addition, tyrants threaten any shared world because they can turn individuals into means to their solo ends.

Mass society puts each world at risk by bringing us into relationships with millions of others, whose names we will never learn. And mass economic exploitation makes matters worse. In Origins of Totalitarianism, Arendt says, “loneliness, on the experience of not belonging to the world at all, … is among the most radical and desperate experiences of man. [It is] is closely connected with uprootedness and superfluousness which have been the curse of modern masses since the beginning of the industrial revolution and have become acute with the rise of imperialism at the end of the last century and the break-down of political institutions and social traditions in our own time.”

When history seems to move quickly and beyond anyone’s control, humans cease to feel that they are agents in any recognizable world.

Ideology can be defined as any system of thought that substitutes core assumptions for actual engagement with other people in a common world.

Finally, although media can enrich any given world, it can also disrupt it. Imagine people sitting alone or in passive company before a TV screen that tells them about gruesome crimes. Their actual world may be safe, or less dangerous than it was in the past, but the mediated world is cruel.

New threats in the age of AI

This theoretical framework comes from Arendt, who drew on Heidegger’s fundamental insight that the human form of being (Dasein) is always “‘in’ the world in the sense that it deals with entities encountered within-the-world, and does so concernfully and with familiarity” (Being and Time, H105, trans. by Macquarrie & Robinson). Arendt makes Heidegger’s theory political and republican by emphasizing that people can talk and decide what to do with their worlds.

I have sketched this view to help make sense of a new phenomenon: intelligence that is artificial (AI). But Arendt already feared that we might “need artificial machines to do our thinking and speaking.”

When a person expresses a view, the content of what they say helps us to understand the world that the person inhabits. Even when people are flat-out wrong, the fact that they err or lie is part of our reality. In addition, a human view comes from a creature that can suffer. As such, it makes a claim on our compassion. In short, we attend not only to the content of the statement but also to the person who expressed it.

In contrast, when a large language model (LLM) answers a query (typically in the first-person singular and with emotive language like “I will be glad to …”), it does not reflect any particular perspective, nor does it come from a body that is capable of suffering. It just pretends to be a fellow participant in our world. We can attend to the words but not to the speaker.

Walter Cronkite was not really a visitor to Americans’ living rooms in 1970. He just appeared on TV screens. But he was a real person who could be assessed as such. An LLM is qualitatively different.

An LLM can be just another tool or resource, like a Heidegger’s hammer or perhaps like a library. I have collaborated with teams of Tufts engineering students to build the Civic Helpdesk and other applications of AI that are not yet publicly available. Working with them to fine-tune instructions or to design a user interface feels very much like collaborative work in a shared world. Note that I naturally said we “built” these tools, because the work feels roughly like building a shed, or perhaps an organization.

I have also developed what I think is a fairly tight practice of asking Claude about the Sanskrit and Pali original words in texts that I can only read in translation. This feels like a modest expansion of my inner life, if not a contribution to any shared world. (By the way, Claude is probably pulling these definitions from a finite set of published lexicons that have human authors.)

On the other hand, as Pope Leo notes in Magnifica humanitas, “current AI systems are more ‘cultivated’ than ‘built,’ for developers do not directly design every detail, but instead create a framework within which the intelligence ‘grows.’ As a result, fundamental scientific aspects — such as the internal representations and computational processes of these systems — remain, at present, unknown.” This sounds more like Arendt’s nightmare of a time when our thoughts cannot grasp what we have done.

The deepest concern is that we have developed biologically and culturally to flourish in what Arendt would call a world, but an individual who uses AI is no longer there.


See also: the papal encyclical on AI; Reading Arendt in Palo Alto; the human coordination involved in AI; the difference between human and artificial intelligence: relationships; the design choice to make ChatGPT sound like a human; and love of the world

Leave a Reply