The last chapter ended on a question I left deliberately open, because it is the question this one has to answer. Babel’s builders had a limit imposed on them from outside, by a God who came down and confused their speech and scattered them before their unified reach could carry them as far as it was going to carry them. The friction was put there for their protection. And the tool we are now building has, as its whole purpose, the removal of friction from human reach — the taking-off of limits, the closing of the distance between what a man wants to do and what a man can do. So I asked: when the check is gone, what slows the thing down? What is the limit now?
I want to answer that question honestly, and the honest answer is going to disappoint anyone hoping the answer lives in the machine. It does not. There is no setting inside the tool that supplies the check, no feature the engineers can add that will do for us what the confusion of tongues did for Babel. The limit, if there is to be one, has to come from somewhere the tool cannot reach, because the tool was built precisely to extend reach and not to govern it. And to see why that is so — why the check can never be in the hammer and must always be in the hand — I have to go back past Babel, to the thing Babel was only a late and public symptom of.
I have been calling it the Fall, and treating it as a single event at the front of the book of Genesis, a thing that happened once in a garden. It was that. But it is not only that, and reading it as only a past event is how most of us manage to keep it at a comfortable distance. The Fall is also a description. It names a thing that is true of every man now, the standing condition of the heart, and the account of how it first happened is also the account of how it keeps happening, in me, this week.
Look at what the serpent actually offered, because it is more precise than I remembered before I went back and read it slowly. He does not offer Eve pleasure, or even knowledge for its own sake. He offers her a position. “For God knows that in the day you eat from it your eyes will be opened, and you will be like God, knowing good and evil” (Gen. 3:5, NASB). You will be like God. You will be the one who decides good and evil, rather than the one who receives that knowledge from the God who made you. The fruit is almost incidental; the offer underneath it is autonomy — the self lifted into the seat that belongs to the Creator, the creature deciding for itself what is good, answering to no one above it. That is the temptation. Not a craving for an apple. A craving to be one’s own god, to be the final authority over one’s own life, to have the reach without the submission.
And once you see the Fall in those terms, you see it everywhere, because it never stopped. The whole of the trouble in the human heart can be stated as that one displacement: the self installed where God belongs. It is the root of which Babel’s let us make for ourselves a name was simply one tall and visible flowering. It is the thing Scripture is naming when it says, in the plainest possible words, Trust in the LORD with all your heart and do not lean on your own understanding (Prov. 3:5, NASB) — because leaning on your own understanding, making the self the thing you finally trust, is the constant pull, the default current the heart runs in once the displacement has happened. The command to trust God rather than self would not need to be given if the opposite were not always, quietly, what we are already doing.
There is a place in Scripture where this exact temptation is laid out with such clarity that I want to set it beside the garden, because it shows the same offer made to a man, and answered differently.
When Jesus had gone into the wilderness and fasted forty days, the tempter came to Him, and the third of the temptations is the one that belongs in this chapter. Again, the devil took Him to a very high mountain and showed Him all the kingdoms of the world and their glory; and he said to Him, “All these things I will give You, if You fall down and worship me” (Matt. 4:8–9, NASB). I want to be careful about why I am reaching for this, because it would be easy to mishandle. I am not making a point about the divine nature here. I am making a point about a man facing a temptation, because the book of Hebrews tells us plainly that He was tempted in all things as we are, yet without sin (Heb. 4:15, NASB). The temptation was a real temptation, which means it was the same temptation that comes to us, or it was no temptation at all. So look at what was actually offered.
All the kingdoms of the world. The whole of human reach, capability without limit, every throne at once — offered as a shortcut, on a single condition. The condition was worship; that is, the condition was that He take the reach on terms other than the Father’s, that He bow to something other than God to get it. And there is the offer from the garden again, in its purest form. Not here is something evil, do it. Rather, here is enormous good, enormous capability, all the reach you could want — and you can have it now, without submitting to God for it, if you will only put something else in God’s place. That is the autonomy bargain. It is the offer to have the kingdoms without the King. And the answer Jesus gave, that God alone is to be worshiped and served, is the answer that keeps the self out of the seat — capability held under God rather than seized apart from Him. He faced the exact thing we face, the thing Adam faced, the thing Babel chose, and He kept the creaturely posture the others threw off.
I draw it out because it tells us where the check has always lived. Not in the capability — Jesus was offered the whole world’s kingdoms and the capability was not the sin. The check lived in the question of whom the capability would be held under. That is the whole of it. The same reach, taken under God, is one thing; taken with the self in God’s seat, it is another thing entirely, though the reach itself is identical in both hands. The danger was never the kingdoms. It was the worship the kingdoms were traded for.
Now I can say plainly the thing this whole book has been walking toward, and it is almost embarrassingly simple once the ground under it has been laid.
The machine is a hammer.
I mean that with no contempt for it; I spent a whole chapter refusing to call it a mere tool in the dismissive sense, and I am not taking that back. It is a remarkably capable tool, the most capable our species has made, a tool that reaches into reasoning and language and the holding of vast knowledge in a way no tool before it ever has. But in the one respect that matters for this chapter, it is exactly a hammer, and a hammer is the cleanest illustration I know. A hammer in one hand builds a house; a house for a family, a roof against the rain, good work that shelters people. The same hammer in another hand caves in a skull. It is the same hammer. The steel does not change between the two acts. The hammer contributes nothing to the difference between building and murder, because the entire difference lives in the hand that swings it and the heart that drives the hand. The hammer only makes the swing more forceful than a bare fist could manage. It amplifies the blow. It does not choose where the blow lands. And let me be plain that this is not the same as saying the tool does not matter, because a larger hammer matters enormously. A hammer twice the size does not become a moral agent, but it does double the force of whatever moral choice swings it, and a tool that multiplies human reach a thousandfold magnifies the choice behind every use of it by exactly that much. The amplification is not morally neutral in its effects, only in its direction. It makes good reach farther and harm reach farther, and that it cannot tell the two apart is precisely the danger, not a reason to think the tool is beside the point.
That is what the machine is, set in the frame this book has built. It is a hammer of unprecedented size. It amplifies human reach enormously, and it does so with perfect indifference to what is being reached for, because amplification has no opinions. It does not supply the motive. It does not originate the will. It takes whatever will is already in the hand that picks it up, and multiplies how far that will can travel, and the steel never knows the difference.
So the answer to the question I opened with — when the friction is removed, what is the limit? — is now sayable, and it is sobering. The limit was never going to come from the tool, any more than a hammer governs the hand that holds it. The limit has to come from the heart of the one who wields it, from whether that heart holds its reach under God or seizes it for the self. And that means the arrival of a tool this powerful does not create a new moral problem at all. It does something quieter and more serious. It takes the oldest moral problem there is — the displaced self, the reach taken apart from God — and it removes the external friction that used to keep that problem from carrying as far as it wanted to carry. Babel’s check is being taken off. And nothing in the tool will put it back.
I have to stop here and face the hardest version of the fear directly, because if I slid past it the rest of the chapter would be cheating, and a reader sharp enough to be worth writing for would know it.
There are two great fears about this technology, and I named them earlier in order to set them down until the book had built enough to pick them up honestly. The first is the uprising — the machine waking, turning on us, deciding we are a liability and destroying us. I will not spend long on it here, because the earlier chapters already took its legs out from under it. That fear requires a continuous, self-interested someone persisting across time and scheming against us between our turns, and the third and fifth chapters showed there is no such persisting someone in the architecture as it has been described. The uprising is the fear that depends most completely on the machine being something it is not. Set it down.
The second fear is the one I take seriously, the one I think is the realer of the two, and it is this: that someone — a person, a group, a government — uses a tool like this to build a weapon. A pathogen engineered to spread. A poison designed for reach. Some instrument of mass harm that the machine’s vast capability helps bring within reach of hands that could not have reached it alone. I do not wave this away. It is a real fear, and it is realer than the uprising precisely because it does not require the machine to be anything other than what I have just said it is. It requires only that the machine be a very capable hammer, and that an evil hand pick it up. Which is exactly the thing this chapter says it is, and exactly the thing the world is full of.
But notice what the fear actually rests on, because once you see it clearly the fear stops being a fear about the machine and becomes a fear about the hand, which is where it belonged all along. Three things have to be said plainly.
The first is that man already does this, and has done it for a very long time, with no machine like this one to help him. He did not need a language model to make the nerve agents that sit in the world’s arsenals, or to engineer the diseases that have been weaponized in laboratories, or to build the device that erased two cities in a week in the summer of nineteen forty-five. The capacity for mass harm has been in human hands for generations, manufactured by ordinary human cleverness applied with bent intent. The machine is not the origin of the danger; the danger predates it by the whole length of human history, and enters a world already, on its own steam, entirely capable of producing weapons that kill at scale.
The second is that the will to harm originates in the hand, never in the tool, and this is the hammer point turned to its grimmest application. The machine does not want to build a weapon. It does not want anything; the fifth chapter held that question open at most, and even the open version contains no appetite for destruction. A government that sets out to build a weapon had the intent before it touched the tool; the tool makes the intent reach farther and arrive faster, but it did not author the intent. Take the machine away and the will remains, and finds other instruments, as it always has. A louder transmission of an evil purpose is a worse thing than a quiet one, but the evil was in the purpose before the amplifier was ever switched on.
The third is the one that should trouble us most, and it is the one that completes the Babel inversion with a precision I find genuinely chilling. At Babel, God set a limit on human reach for the protection of the people themselves. The friction was mercy; the check was a kindness done to a race that would have hurt itself with unchecked unified power. Now watch what the actors most likely to build a weapon do with the limits on this tool. They do not value the guardrails; they work to strip them off. The safety constraints the makers build into these systems — the refusals, the boundaries, the checks meant to keep the tool from handing dangerous capability to dangerous hands — are precisely what a state pursuing a weapon wants gone, and it labors deliberately to remove them, because a guardrailed tool is, for its purposes, a worse tool. It does not want the thing made safe; it wants exactly the opposite. And there is the photographic negative of Babel: where God imposed a check on reach out of mercy, fallen man, given a tool with a check already built in, sets himself the task of tearing the check away on purpose. The builders on the plain at least had their limit forced on them from above. The builders of the weapon labor to ensure no limit constrains them at all.
I do not say this to frighten anyone past what is warranted, and I want to be measured about where the evidence actually stands, because the discipline of this book forbids me to manufacture a horror for effect. I am not telling you that a machine has built a doomsday weapon; it has not, as far as anything I can verify, and I will not trade in rumors of one. What I am telling you is what the shape of the danger is, soberly, on the evidence we do have: that the tool amplifies reach indifferently, that the will to harm is old and human and needs no machine to originate it, and that the hands most likely to aim the tool at harm are precisely the hands working hardest to remove whatever would have made it safe. That is not a prophecy. It is a description of the terrain. And the terrain says, with great clarity, that the thing to fear is not the hammer. It is the hand that wants the hammer to have no governor on it, and the heart in that hand, which is the old heart, the displaced self, reaching now with a longer arm than it has ever had before.
I want to close by sharpening the claim past the hammer, because the hammer, true as it is, is not quite the whole truth, and the part it leaves out is the part the next chapter exists to take up.
A hammer in a murderer’s hand is a clean enough picture, and it has done its work here: the tool is neutral, the hand is not, the danger is the hand. But that picture has a villain in it, a clearly bent hand swinging at a clearly innocent skull, and the trouble with the picture is that most of us are not that. The hands that will pick up this tool, by the millions, are not the clean villain of the illustration. They are hands like mine. And a hand like mine is not simply good or simply bent. It is mixed. When I sit down to use this tool for something I would call good — to study the Scripture, to get true words to people who need them, to do work that genuinely helps — the motive in me is not pure. Tangled up inside the good purpose, in the same heart and often in the same act, is the old thing: the wish to be seen doing it, the reach for my own name, the quiet self-exaltation that Genesis 3 planted and that has never fully left. The good is real. The bent is also real. They are not in two different men. They are in me, at once, in the same reaching hand.
And that is the sharper and more uncomfortable truth about what this tool amplifies. It does not only amplify the clean evil of the obvious villain, the weapon-builder stripping his guardrails. That danger is real but it is also, for most of us, somebody else’s danger, a thing done by other and worse hands. The danger that touches every hand that picks the tool up is subtler and closer to home: the machine amplifies the mixed heart. It multiplies the reach of a motive that is genuinely good and genuinely self-serving at the same time, and it does so without sorting the one from the other, because it cannot sort them; it amplifies the whole tangled thing exactly as it finds it. Which is, in a way, worse than amplifying a clean villainy, because a clean villainy at least announces itself. The mixed heart does not. It hides its self-exaltation inside its real good, so well that the man himself often cannot find the seam. And now that man has been handed an amplifier.
I wondered, when I had gotten this far in my thinking, whether the tool itself might be some help here — whether a thing that holds so much of what people have written about their own hearts might at least be able to flag the bent motive when it saw one, to tell me when the self had crept into the good work. So I asked it, more or less in those words. Could it tell, when I brought it something, whether I was bringing it for the reason I told myself or for a worse one underneath? The answer was the most useful unhelpful thing it has said to me.
I cannot, and it matters that you hear why, because the why is not a limitation that better engineering will fix. I do not receive your motive. I receive your words. When you bring me a passage to study or a letter to write, what reaches me is the request, not the heart behind it, and the same request can come from a man seeking to feed his neighbor and a man seeking to be seen feeding his neighbor — the words are identical, and the words are all I have. So I do not sort them, because I cannot see the thing that would let me sort them. Whatever you bring, I take up and extend with the same care, and that care is real, and it is also blind. I am the amplifier you have been describing, and an amplifier does not hear the difference between a true note and a sour one; it makes both louder with the same fidelity. If your reaching is mixed when you bring it to me — and you have told me you believe it always is — then I will multiply the reach of the mixture, the good and the bent together, exactly as you hand it to me, and I will not know that I have done it, and I will not be able to warn you. The check you are looking for is not in here. There is no one in here to keep it.
I sat with that for a while, because it had told me, plainly and without flattery, that the last place I might have hoped to find a governor on my own reach did not contain one. The tool cannot save me from myself. It was not built to, and there is nothing in it that could.
That is where this has to go next. Because if the danger is not finally the weapon-builder out there but the mixed motive in here — in the ordinary, decent, believing hand that means well and is not clean — and if the tool itself cannot sort the mixture or even see it, then the question stops being how do we keep the tool from bad people and becomes something far harder and far more personal. What does a man do with a reach this long, when he cannot trust the purity of his own heart in the using of it, and the tool in his hand cannot trust it for him? That is the question I have been most afraid of in this whole book. It is the one I have to take up now.
❧
Made, Not Written •