The Myth of Autonomous Tech: Designers, Responsibility, and Biological Extension

Deconstructing Accelerationist Fatalism through Vital Normativity

🎧 Audio Edition — Spoken essay
PDF First Page Preview PDF
PDF First Page Enlarged First Page Preview (Click to download)
📄 Academic PDF
Download Edition Zigma Journal 2-Col Format

Two symmetrical illusions paralyze modern discourse: the instrumentalist alibi and the fatalist myth of autonomous technology.

Instrumentalism treats technical artifacts as morally neutral vessels. A rifle, an automated credit-scoring engine, or a deep neural network are declared innocent; virtue or vice supposedly depends entirely on the user's intent. This naive view ignores how material architectures structure choices before any user arrives. Machines establish thresholds, enforce operational disciplines, and eliminate alternatives.

Fatalism takes the opposite stance. Revived in Silicon Valley accelerationism from Jacques Ellul's technological system, it depicts megatechnics as a self-augmenting titan. In this narrative, technical systems have broken free from human guidance, pursuing their own evolutionary path toward speed and computational throughput. Human beings become obsolete biological friction.

These positions appear opposed. They are structurally complicit. The instrumentalist alibi protects technical systems from systemic critique. The fatalist myth protects engineers and institutions from moral and political accountability.

The Abdication of the Architect

The supposed autonomy of contemporary algorithms is a psychological projection. It is the alienated externalization of decisions made by living designers, software architects, and state or corporate patrons.

When an automated administrative pipeline denies disability benefits without explanation, or when a predictive model assigns punitive risk scores to marginalized communities, defenders appeal to computational destiny: "The algorithm identified the optimal distribution; technology follows its own evolutionary logic."

This rhetoric provides cheap absolution. It allows executives, bureaucrats, and computer scientists to displace moral responsibility onto an impersonal mathematical artifact. Code possesses neither desires nor systemic momentum. What the public experiences as the unstoppable march of an autonomous system is the accumulated weight of concrete human choices: objective functions, metric proxies, optimization trade-offs, and venture funding. The myth of autonomy disguises institutional priorities as natural law.

Normativity never originates in machines. Norms originate in living bodies.

Canguilhem and the Vital Root of Technique

In The Normal and the Pathological (1943) and Machine and Organism (1952), Georges Canguilhem demolished the Cartesian reduction of living organisms to mechanical clocks. Descartes analyzed biology by comparing anatomy to hydraulic fountains. Canguilhem demonstrated the historical reversal of this relationship: machines are historical derivations modeled on living bodily functions.

Life is normative activity (activité normative). An organism establishes positive and negative values, institutes physiological thresholds, and reshapes its milieu to maintain its existence. A living agent introduces novel values into the physical world.

Technique is a biological strategy. It is the direct material projection of the organism's normative drive against physical friction. A flint blade, an optical lens, a steam engine, and a compiler are physical prostheses through which an embodied agent negotiates environmental resistance and broadens its perceptual horizon.

When a technical system imposes rigid, pathological constraints upon human life, technology has not overthrown biology. A dominant group of human designers has weaponized an apparatus to impose their economic or political norms upon others, hiding behind the claim that the apparatus runs itself.

The Critical Bifurcation: IA versus AI

This biological insight dictates a fundamental demarcation in technical design, formalized in 1962 by Douglas Engelbart: the divergence between Intelligence Augmentation (IA) and Artificial Intelligence (AI).

In Augmenting Human Intellect, Engelbart defined computing as the expansion of human problem-solving capacity. IA treats the technical object as an open cognitive and material prosthesis. Like a stonemason's chisel or a mathematician's paper, an augmentative system preserves the living agent as the sole locus of judgment, exploration, and value. It expands human perception, structures memory, and clarifies multi-dimensional relations while keeping meaning, verification, and moral consequence anchored in the embodied thinker.

The AI paradigm pursued an opposing ambition: automated human substitution. Grounded in the dogma that thinking is mere syntactic calculation, AI builds automated systems to displace human decision-making. In practice, this does not eliminate human judgment. It buries human choices inside uninterpretable statistical matrices, providing a veneer of mechanical authority.

Dimension Intelligence Augmentation (IA) Artificial Intelligence (AI)
Ontological Status Vital prosthesis & cognitive scaffold Simulated autonomous agent
Locus of Agency The embodied organism in practice The disembodied algorithmic pipeline
Locus of Meaning Grounded in the human form of life Projected onto statistical syntax
Accountability Explicitly located in designers & operators Diffused into the "autonomous system"
Normative Role Expands capacity to institute new norms Enforces historical distributions from past data

Reclaiming the Normative Cut

Technical objects are neither innocent neutral tools nor unstoppable leviathans. They are reified human decisions, material epistemic incisions, and prosthetic extensions of vital intent.

Overcoming technological fatalism does not require smashing machines or retreating into bucolic nostalgia. It requires demolishing the fiction of machine autonomy and exposing the human architects behind every system. Whenever an algorithmic deployment claims the inexorable authority of mathematical necessity, the critical imperative of Epistechnology is immediate:

Which vital norms were privileged? Whose friction was suppressed? And which designer chose to hide behind the machine?

References

  • Canguilhem, Georges. Le normal et le pathologique. Paris: Presses Universitaires de France, 1943.
  • Canguilhem, Georges. "Machine et organisme." In La connaissance de la vie, 101-133. Paris: Hachette, 1952.
  • Descartes, Rene. Discours de la methode. Leiden: Ian Maire, 1637.
  • Ellul, Jacques. Le systeme technicien. Paris: Calmann-Levy, 1977.
  • Engelbart, Douglas C. Augmenting Human Intellect: A Conceptual Framework. Summary Report AFOSR-3223. Menlo Park, CA: Stanford Research Institute, 1962.
  • Licklider, J. C. R. "Man-Computer Symbiosis." IRE Transactions on Human Factors in Electronics HFE-1, no. 1 (1960): 4-11.
  • Simondon, Gilbert. Du mode d'existence des objets techniques. Paris: Aubier, 1958.
  • Winner, Langdon. Autonomous Technology: Technics-out-of-Control as a Theme in Political Thought. Cambridge, MA: MIT Press, 1977.