Loading
What changed between revision 1 and revision 3, compared over the article's markdown source with its frontmatter — so a change to status, evidence or reversibility shows up as the edit it is.
Older · revision 1
Import· initial corpus import, not an edit
Initial import of content/grey-goo.md — the filesystem corpus, unchanged. Not an edit.
12.7 kB
Revision 1
Revision 3
lines 7–15 → 7–146 unchanged lines not shown
categories: ["nanomedicine", "society"]categories: ["nanomedicine", "society"]tags: ["nanotechnology", "existential risk", "self-replication", "governance", "drexler", "biosafety"]tags: ["nanotechnology", "existential risk", "self-replication", "governance", "drexler", "biosafety"]summary: "The scenario in which self-replicating nanomachines consume the biosphere, an idea introduced by Eric Drexler in 1986 and later disowned by him."summary: "The scenario in which self-replicating nanomachines consume the biosphere, an idea introduced by Eric Drexler in 1986 and later disowned by him."updated: "2026-07-28"updated: "2026-10-29"humanEvidence: "Nothing to observe in people: no molecular assembler or self-replicating nanomachine has been built, and the nearest documented harm from engineered nanomaterials is fibre toxicity reported in mice."humanEvidence: "Nothing to observe in people: no molecular assembler or self-replicating nanomachine has been built, and the nearest documented harm from engineered nanomaterials is fibre toxicity reported in mice."issues: ["Smalley's objections to mechanosynthesis are discussed twice with no citation.", "The closing reference to 1992 is unexplained; name Drexler's Nanosystems or drop the date."]------ ```infobox```infoboxlines 31–41 → 30–4015 unchanged lines not shown
## Overview## Overview Drexler's argument was structural. If assemblers can build atomically precise machinery, and if the fastest route to macroscopic quantities of product is machines that build copies of themselves, then the technology's core capability is self-replication — and self-replication with a mutation or a design error is a runaway process. He devoted a chapter of *Engines of Creation* to the hazard, alongside the misuse of the same technology by states.[^drexler1986]Drexler's argument was structural. If assemblers can build atomically precise machinery, and if the fastest route to macroscopic quantities of product is machines that build copies of themselves, then the technology's core capability is self-replication, and self-replication with a mutation or a design error is a runaway process. He devoted a chapter of *Engines of Creation* to the hazard, alongside the misuse of the same technology by states.[^drexler1986] The scenario is a genuine argument rather than a throwaway image, and it has an obvious biological analogue. What separates it from an ordinary invasive-species problem is the claimed generality of the eating: a machine that can disassemble arbitrary matter into feedstock is not restricted to a niche.The scenario is a genuine argument rather than a throwaway image, and it has an obvious biological analogue. It differs from an ordinary invasive-species problem in the claimed generality of the eating, since a machine that can disassemble arbitrary matter into feedstock is not restricted to a niche. The link to medicine is direct. The therapeutic devices catalogued in [[medical-nanorobots]], from the [[respirocytes|respirocyte]] onward, were to be manufactured by the same machinery; the hazard and the benefit share a prerequisite, which is why the two literatures cannot be separated.The link to medicine is direct. The therapeutic devices catalogued in [[medical-nanorobots]], from the [[respirocytes|respirocyte]] onward, were to be manufactured by the same machinery. The hazard and the benefit share a prerequisite, so the two literatures cannot be separated. ## The mechanism## The mechanism lines 43–66 → 42–651 unchanged line not shown
Exponential growth does the rest, in principle. A replicator with an hour-long doubling time reaches macroscopic scale within days and planetary scale within weeks, on the assumption that nothing limits it.Exponential growth does the rest, in principle. A replicator with an hour-long doubling time reaches macroscopic scale within days and planetary scale within weeks, on the assumption that nothing limits it. Robert Freitas examined those limits in a detailed 2000 analysis of what he called global ecophagy. His conclusion was that waste heat, not materials, is the binding constraint: converting biomass at the rates the scenario requires releases energy that would raise local temperature far beyond what any machinery could tolerate, and would produce a thermal signature detectable well before the process approached completion. He treated this as an argument for monitoring rather than complacency, and proposed design restrictions on any replicating system.[^freitas2000]Robert Freitas examined those limits in a detailed 2000 analysis of what he called global ecophagy. He concluded that waste heat, not materials, is the binding constraint. Converting biomass at the rates the scenario requires releases energy that would raise local temperature far beyond what any machinery could tolerate, and it would produce a thermal signature detectable well before the process approached completion. He treated this as an argument for monitoring rather than complacency, and proposed design restrictions on any replicating system.[^freitas2000] > [!caution] Why the prerequisite matters> [!caution] Why the prerequisite matters> Grey goo cannot happen without molecular assemblers, and no assembler has been built or shown to be buildable. Every assessment of the scenario is therefore an assessment conditional on a technology whose feasibility is itself disputed. This makes the risk unusual: the debate about its plausibility is downstream of a debate about chemistry that has never been settled experimentally.> Grey goo cannot happen without molecular assemblers, and no assembler has been built or shown to be buildable. Every assessment of the scenario is therefore conditional on a technology whose feasibility is itself disputed. That makes the risk unusual, because the debate about its plausibility sits downstream of a debate about chemistry that has never been settled experimentally. ## Plausibility## Plausibility Mainstream scientific opinion treats the scenario as very improbable, for several reasons that operate independently.Mainstream scientific opinion treats the scenario as very improbable, for several reasons that operate independently. The prerequisite is missing. Richard Smalley's objections to mechanosynthesis, if correct, rule out the assembler and therefore the goo. Proponents dispute the objections, but no one has demonstrated the capability.The first is that the prerequisite is missing. Richard Smalley objected to mechanosynthesis on two grounds: a manipulator built of atoms is too bulky to fit in the space where the reaction must happen, and its own atoms would stick to whatever it tried to place. If correct, those objections rule out the assembler and therefore the goo. Drexler disputed both, in a public exchange the two concluded in *Chemical & Engineering News* in 2003 with neither conceding.[^cen2003] No one has demonstrated the capability. Free-ranging replication is not required by the goal. Molecular manufacturing could be organised as fixed factory machinery that produces products, with replication confined to a controlled production line — the arrangement Drexler and Chris Phoenix argued for in 2004, on the grounds that it is both safer and easier to engineer than autonomous replicators.Second, the goal does not require free-ranging replication. Molecular manufacturing could be organised as fixed factory machinery that produces products, with replication confined to a controlled production line. Chris Phoenix and Drexler argued for this arrangement in 2004, on the grounds that such systems need not be mobile, need not gather their own materials, and are both safer and easier to engineer than autonomous replicators.[^phoenix2004] Biology sets a hard precedent. Life has been optimising self-replication in exactly this environment for billions of years, under selection pressure no design process can match, and has not produced a universal disassembler. Real organisms are specialists constrained by feedstock chemistry, temperature, pH, and predation. A synthetic replicator would face the same constraints while lacking the accumulated adaptations.Third, biology sets a hard precedent. Life has been optimising self-replication in exactly this environment for billions of years, under selection pressure no design process can match, and has not produced a universal disassembler. Real organisms are specialists constrained by feedstock chemistry, temperature, pH, and predation. A synthetic replicator would face the same constraints while lacking the accumulated adaptations. Engineering a machine that both operates at atomic precision and tolerates uncontrolled environments is close to a contradiction. Precision machinery requires clean conditions; the outdoors supplies dust, water, salt, ultraviolet light, and organisms that eat things.Fourth, a machine that both operates at atomic precision and tolerates uncontrolled environments is close to a contradiction in engineering terms. Precision machinery requires clean conditions, and the outdoors supplies dust, water, salt, ultraviolet light, and organisms that eat things. The technologies that actually produce nanoscale machinery reinforce the point. Structures built by [[dna-nanotechnology]] copy themselves only with enzymes supplied by an experimenter and degrade within hours in serum. The untethered devices surveyed in [[microrobots-in-medicine]] draw their energy from external fields and stop when the field is switched off. The [[xenobots]] built from frog cells come closest, having been reported to gather dissociated cells in a dish into piles that mature into further xenobots — replication only for as long as an experimenter keeps supplying the cells, and consuming nothing that was not already living tissue. None of these is a step toward an autonomous replicator, and none was designed to be.The technologies that actually produce nanoscale machinery reinforce the point. Structures built by [[dna-nanotechnology]] copy themselves only with enzymes supplied by an experimenter and degrade within hours in serum. The untethered devices surveyed in [[microrobots-in-medicine]] draw their energy from external fields and stop when the field is switched off. The [[xenobots]] built from frog cells come closest. They have been reported to gather dissociated cells in a dish into piles that mature into further xenobots, but this replication lasts only as long as an experimenter keeps supplying the cells, and it consumes nothing that was not already living tissue. None of these is a step toward an autonomous replicator, and none was designed to be. ## How the scenario entered policy## How the scenario entered policy lines 68–92 → 67–911 unchanged line not shown
The Royal Society and Royal Academy of Engineering examined the field in 2004 at the British government's request. Their report concluded that self-replicating nanomachines were not a foreseeable prospect and that regulatory attention belonged on the actual hazard: free engineered nanoparticles, whose toxicology and environmental behaviour were poorly characterised.[^royalsociety2004] That judgement has held.The Royal Society and Royal Academy of Engineering examined the field in 2004 at the British government's request. Their report concluded that self-replicating nanomachines were not a foreseeable prospect and that regulatory attention belonged on the actual hazard: free engineered nanoparticles, whose toxicology and environmental behaviour were poorly characterised.[^royalsociety2004] That judgement has held. Leaders of the US National Nanotechnology Initiative, Smalley among them, publicly rejected the scenario, in part because a federal materials-science programme did not want to be associated with science fiction. The effect was a peculiar alignment: the field's critics and its funders both had reasons to discuss molecular manufacturing as fantasy, which foreclosed the experimental work that might have settled the underlying question.Leaders of the US National Nanotechnology Initiative, Smalley among them, publicly rejected the scenario, in part because a federal materials-science programme did not want to be associated with science fiction. The result was an odd alignment. The field's critics and its funders both had reasons to treat molecular manufacturing as fantasy, and that foreclosed the experimental work that might have settled the underlying question. ## Drexler's retraction## Drexler's retraction Drexler came to regard the emphasis as a mistake. He has said he regrets introducing the image, and his later writing reframes the field as atomically precise manufacturing carried out by fixed, factory-style systems that never replicate autonomously.[^drexler2013] The 2004 paper with Phoenix made the technical version of the argument: replication is a design choice, not a requirement, and a manufacturing system built without it is not subject to the failure mode.Drexler came to regard the emphasis as a mistake. He has said he regrets introducing the image, and his later writing reframes the field as atomically precise manufacturing carried out by fixed, factory-style systems that never replicate autonomously.[^drexler2013] The 2004 paper with Phoenix made the technical version of the argument: replication is a design choice rather than a requirement, and a manufacturing system built without it is not subject to the failure mode.[^phoenix2004] The retraction is partial in an important way. Drexler continues to argue that atomically precise manufacturing would be strategically destabilising — cheap, rapid production of arbitrary hardware, including weapons — and that this is the serious risk. That claim is much harder to dismiss than grey goo and receives far less attention.The retraction is partial. Drexler continues to argue that atomically precise manufacturing would be strategically destabilising, because it would allow cheap, rapid production of arbitrary hardware, including weapons, and that this is the serious risk. That claim is much harder to dismiss than grey goo and receives far less attention. ## What displaced it## What displaced it The self-replication risk did not disappear; it moved to biology, where the replicators already exist and are programmable. Engineered pathogens are the leading biological candidate for catastrophic misuse, as discussed in [[dual-use-research]] and in the taxonomies of [[existential-risk]] that [[nick-bostrom]] set out in 2002, which listed nanotechnological accident and engineered disease side by side among the technological hazards. The ability to write [[synthetic-genomes]] to order, unavailable when *Engines of Creation* appeared, is the specific capability that shifted the balance. Self-propagating genetic elements raise a real version of the containment problem in [[gene-drive]], where the technology works and the reversibility question is live. [[mirror-life]] represents the closest existing analogue to grey goo taken seriously by working scientists: a chirally inverted organism that existing immune systems and enzymes could not recognise, which prompted a public call in 2024 from a large group of researchers to halt work toward it.The self-replication risk moved to biology, where the replicators already exist and are programmable. Engineered pathogens are the leading biological candidate for catastrophic misuse, as discussed in [[dual-use-research]] and in the taxonomies of [[existential-risk]] that [[nick-bostrom]] set out in 2002, which listed nanotechnological accident and engineered disease side by side among the technological hazards. The ability to write [[synthetic-genomes]] to order, unavailable when *Engines of Creation* appeared, is the specific capability that shifted the balance. Self-propagating genetic elements raise a real version of the containment problem in [[gene-drive]], where the technology works and the reversibility question is live. [[mirror-life]] represents the closest existing analogue to grey goo taken seriously by working scientists: a chirally inverted organism that existing immune systems and enzymes could not recognise. In 2024 a large group of researchers published a call in *Science* to stop work toward mirror bacteria, arguing that such an organism could spread without the checks that constrain natural pathogens.[^adamala2024] The argument is grey goo's, transposed to a substrate that already replicates. The nanomaterial risks the Royal Society flagged also proved real. Long, thin carbon nanotubes introduced into mice produced inflammatory responses resembling those caused by asbestos fibres, an early signal that particle geometry matters for toxicity in ways bulk-material safety data do not capture.[^poland2008]The nanomaterial risks the Royal Society flagged also proved real. Long, thin carbon nanotubes introduced into mice produced inflammatory responses resembling those caused by asbestos fibres, an early signal that particle geometry matters for toxicity in ways bulk-material safety data do not capture.[^poland2008] ## Governance## Governance There is no international instrument specific to self-replicating nanomachines, and no obvious need for one while the enabling technology does not exist. What exists instead is a set of proposals — design rules requiring dependence on artificial feedstocks unavailable in nature, mandatory encryption of replication instructions, geographic and physical containment — most of which were developed by proponents of molecular manufacturing rather than by regulators.There is no international instrument specific to self-replicating nanomachines, and no obvious need for one while the enabling technology does not exist. What exists instead is a set of proposals, most of them developed by proponents of molecular manufacturing rather than by regulators: design rules requiring dependence on artificial feedstocks unavailable in nature, mandatory encryption of replication instructions, and geographic and physical containment. The more useful legacy of the debate is methodological. Grey goo is the standard case study in how a vivid low-probability scenario can crowd out attention to the mundane risks of the same technology, a pattern relevant to how the [[precautionary-principle]] is applied and to arguments for [[differential-technological-development]]. It also illustrates a failure mode particular to speculative fields: a warning issued to encourage careful development instead became the reason the development was never seriously attempted, leaving the underlying question about atomic-scale manufacturing exactly where it was in 1992.The debate's more useful legacy is methodological. Grey goo is the standard case study in how a vivid low-probability scenario can crowd out attention to the mundane risks of the same technology, a pattern relevant to how the [[precautionary-principle]] is applied and to arguments for [[differential-technological-development]]. It also illustrates a failure mode particular to speculative fields: a warning issued to encourage careful development instead became the reason the development was never seriously attempted. The question Drexler set out in *Nanosystems* in 1992, whether the machinery he analysed can be built at all, has still not been answered experimentally in either direction.[^drexler1992] ## See also## See also lines 102–107 → 101–1109 unchanged lines not shown
## References## References [^drexler1986]: `book` Drexler, K.E. *Engines of Creation: The Coming Era of Nanotechnology.* Anchor Books, 1986.[^drexler1986]: `book` Drexler, K.E. *Engines of Creation: The Coming Era of Nanotechnology.* Anchor Books, 1986.[^drexler1992]: `book` Drexler, K.E. *Nanosystems: Molecular Machinery, Manufacturing, and Computation.* John Wiley & Sons, 1992.[^cen2003]: `news` "Nanotechnology: Drexler and Smalley make the case for and against 'molecular assemblers'." *Chemical & Engineering News*, 1 December 2003. {A magazine point-counterpoint exchange of letters between the two principals, not a peer-reviewed assessment; neither side conceded.}[^phoenix2004]: `paper` Phoenix, C. and Drexler, K.E. "Safe exponential manufacturing." *Nanotechnology*, 2004. {An argument that productive nanosystems need not be autonomous replicators, written by proponents of molecular manufacturing; it assumes such systems are buildable and asks how they should be designed.}[^adamala2024]: `statement` Adamala, K.P. et al. "Confronting risks of mirror life." *Science*, 2024. {A policy forum piece signed by a large group of researchers, accompanied by a separate technical report; it argues for stopping a line of work rather than reporting an experiment.}[^freitas2000]: `report` Freitas, R.A. "Some Limits to Global Ecophagy by Biovorous Nanoreplicators, with Public Policy Recommendations." Institute for Molecular Manufacturing, 2000. {Written from inside the molecular manufacturing community; it assumes assemblers are feasible and asks only what would limit them.}[^freitas2000]: `report` Freitas, R.A. "Some Limits to Global Ecophagy by Biovorous Nanoreplicators, with Public Policy Recommendations." Institute for Molecular Manufacturing, 2000. {Written from inside the molecular manufacturing community; it assumes assemblers are feasible and asks only what would limit them.}[^joy2000]: `news` Joy, B. "Why the Future Doesn't Need Us." *Wired*, April 2000. {An essay arguing for relinquishment of whole lines of research, not reporting or technical assessment.}[^joy2000]: `news` Joy, B. "Why the Future Doesn't Need Us." *Wired*, April 2000. {An essay arguing for relinquishment of whole lines of research, not reporting or technical assessment.}[^royalsociety2004]: `report` The Royal Society and the Royal Academy of Engineering. *Nanoscience and Nanotechnologies: Opportunities and Uncertainties.* 2004.[^royalsociety2004]: `report` The Royal Society and the Royal Academy of Engineering. *Nanoscience and Nanotechnologies: Opportunities and Uncertainties.* 2004.removed, struck through added, underlinedLine numbers count the serialised markdown of each revision, frontmatter included.
92 lines are the same in both revisions, and 35 of them are not shown. Neither revision here is necessarily the current article — read Grey goo for the text this wiki stands behind today.