Norbert Wiener On Communication, Control, The Morality Of Machines, Progress And Cybernetics
Maria Popova, Brain Pickings
“Information will never replace illumination,” Susan Sontag asserted in considering the conscience of words. “Words are events, they do things, change things,” Ursula K. Le Guin wrote in the same era in her exquisite meditation on the magic of real human communication. “They transform both speaker and hearer; they feed energy back and forth and amplify it. They feed understanding or emotion back and forth and amplify it.”But what happens when words are stripped of their humanity, fed into unfeeling machines, and used as currencies of information that no longer illuminates?
Half a century before the golden age of algorithms and two decades before the birth of the Internet, the mathematician and philosopher Norbert Wiener (November 26, 1894–March 18, 1964) tried to protect us from that then-hypothetical scenario in his immensely insightful and prescient 1950 book The Human Use of Human Beings: Cybernetics and Society (public library) — a book Wiener described as concerned with “the limits of communication within and among individuals,” which went on to influence generations of thinkers, creators, and entrepreneurs as wide-ranging as beloved author Kurt Vonnegut, anthropologist Mary Catherine Bateson, and virtual reality pioneer Jaron Lanier.
Norbert Wiener
Wikiquote
Wiener had coined the word cybernetics two years earlier, drawing on the Greek word for “steersman” — kubernētēs, from which the word “governor” is also derived — to describe “the scientific study of control and communication in the animal and the machine,” pioneering a new way of thinking about causal chains and how the feedback loop taking place within a system changes the system itself. (Today’s social media ecosystem is a superficial but highly illustrative example of this.)
In a complement to Hannah Arendt’s contemporaneous insight into how tyrants use isolation as a weapon of oppression and manipulation, Wiener explains why, under this model of information systems, communication and control are inexorably linked:
Information is a name for the content of what is exchanged with the outer world as we adjust to it, and make our adjustment felt upon it. The process of receiving and of using information is the process of our adjusting to the contingencies of the outer environment, and of our living effectively within that environment. The needs and the complexity of modern life make greater demands on this process of information than ever before, and our press, our museums, our scientific laboratories, our universities, our libraries and textbooks, are obliged to meet the needs of this process or fail in their purpose. To live effectively is to live with adequate information. Thus, communication and control belong to the essence of man’s inner life, even as they belong to his life in society.
A pillar of Weiner’s insight is the second law of thermodynamics and its central premise that entropy — the growing tendency toward disorder, chaos, and unpredictability — increases over time in any closed system. But even if we were to consider the universe itself a closed system — an assumption neglecting the possibility that our universe may be one of many universes — neither individual human beings nor the societies they form can be thought of as closed systems. Rather, they are pockets of attempted order and decreasing entropy amid the vast expanse of cosmic chaos — attempts encoded in our systems of organizing and communicating information. Weiner examines the parallel between organisms and machines in this regard — a radical notion in his day and plainly obvious, if still poorly understood, in ours:
When I compare the living organism with such a machine, I do not for a moment mean that the specific physical, chemical, and spiritual processes of life as we ordinarily know it are the same as those of life-imitating machines. I mean simply that they both can exemplify locally anti-entropic processes, which perhaps may also be exemplified in many other ways which we should naturally term neither biological nor mechanical.
Alan: I will add that information means that "something" is "in form." Consequently, while we can posit that information is neither matter nor energy, it's existence -- at least insofar as humans understand existence through sensory mediation -- requires matter and energy for it to take on form, even if that form is limited to data print-out. Information is a human construct which tries to capture, through "human distillation," the knowledge that can be metaphorically called the "skeletal framework" of Reality as we know it.
In a sentiment of astounding foresight, Wiener adds:
[…]In control and communication we are always fighting nature’s tendency to degrade the organized and to destroy the meaningful; the tendency… for entropy to increase.
In consonance with Neil Gaiman’s conception of stories as “genuinely symbiotic organisms that we live with, that allow human beings to advance,” Wiener considers how living organisms resemble and are aided by information systems:
[…]We are not stuff that abides, but patterns that perpetuate themselves. A pattern is a message.
He adds:
Weiner illustrates this idea with an example that would have pleased Emily Dickinson:
[…]The prevalence of cliches is no accident, but inherent in the nature of information. Property rights in information suffer from the necessary disadvantage that a piece of information, in order to contribute to the general information of the community, must say something substantially different from the community’s previous common stock of information. Even in the great classics of literature and art, much of the obvious informative value has gone out of them, merely by the fact that the public has become acquainted with their contents. Schoolboys do not like Shakespeare, because he seems to them nothing but a mass of familiar quotations. It is only when the study of such an author has penetrated to a layer deeper than that which has been absorbed into the superficial clichés of the time, that we can re-establish with him an informative rapport, and give him a new and fresh literary value.
From this follows a corollary made all the clearer by the technologies and media landscapes which Wiener never lived to see and with which we must and do live:
[…]Information is more a matter of process than of storage… Information is important as a stage in the continuous process by which we observe the outer world, and act effectively upon it… To be alive is to participate in a continuous stream of influences from the outer world and acts on the outer world, in which we are merely the transitional stage. In the figurative sense, to be alive to what is happening in the world, means to participate in a continual development of knowledge and its unhampered exchange.
Alan: I am reminded of Bucky Fuller saying, "I seem to be a verb."
In a passage that calls to mind Zadie Smith’s lucid antidote to the illusion of universal progress and offers a sobering counterpoint to today’s strain of social scientists purveying feel-good versions of “progress” via the tranquilizing half-truths of highly selective statistics willfully ignorant of the for whom question, Wiener writes:
[…]Thus the question of whether to interpret the second law of thermodynamics pessimistically or not depends on the importance we give to the universe at large, on the one hand, and to the islands of locally decreasing entropy which we find in it, on the other. Remember that we ourselves constitute such an island of decreasing entropy, and that we live among other such islands. The result is that the normal prospective difference between the near and the remote leads us to give far greater importance to the regions of decreasing entropy and increasing order than to the universe at large.
Wiener considers the central flaw of the claim that the arrow of historical time is aligned with the arrow of “progress” in a universal sense:
With this, Weiner turns to the most gaping void in the narrative of progress — a recognition of the interconnectedness of existence across scales and species, which the pioneering naturalist John Muir so memorably captured a century earlier in his assertion that “when we try to pick out anything by itself, we find it hitched to everything else in the universe.” A decade before Rachel Carson awakened the modern environmental conscience, Wiener considers the larger planetary costs of humanity’s “progress”:
[…]The new industrial revolution is a two-edged sword… It may be used for the benefit of humanity, but only if humanity survives long enough to enter a period in which such a benefit is possible. It may also be used to destroy humanity, and if it is not used intelligently it can go very far in that direction.
Three decades later, the great physician, etymologist, poet, and essayist Lewis Thomas would articulate the flip side of the same sentiment in his beautiful meditation on the peril and possibility of progress: “We are in for one surprise after another if we keep at it and keep alive. We can build structures for human society never seen before, thoughts never thought before, music never heard before… Provided we do not kill ourselves off, and provided we can connect ourselves by the affection and respect for which I believe our genes are also coded, there is no end to what we might do on or off this planet.” Weiner’s most visionary point is that if we are to not only survive but thrive as a civilization and a species, we must encode these same values of affection and respect into our machines, our information systems, and our technologies of communication, so that “the new modalities are used for the benefit of man, for increasing his leisure and enriching his spiritual life, rather than merely for profits and the worship of the machine as a new brazen calf.”
Man as Industrial Palace (1926) by infographics pioneer Fritz Kahn
More than a century after Mary Shelley raised these enduring questions of innovation and responsibility in Frankenstein, Weiner offers a sentiment of astonishing prescience and relevance to the artificial intelligence precipice on which we now stand, in an era when algorithms are deciding for us what we read, where we go, and how much of reality we see:
[…]The modern man, and especially the modern American, however much “know-how” he may have, has very little “know-what.” He will accept the superior dexterity of the machine-made decisions with out too much inquiry as to the motives and principles behind these… Any machine constructed for the purpose of making decisions, if it does not possess the power of learning, will be completely literalminded. Woe to us if we let it decide our conduct, unless we have previously examined the laws of its action, and know fully that its conduct will be carried out on principles acceptable to us! On the other hand, the machine [that] can learn and can make decisions on the basis of its learning, will in no way be obliged to make such decisions as we should have made, or will be acceptable to us. For the man who is not aware of this, to throw the problem of his responsibility on the machine, whether it can learn or not, is to cast his responsibility to the winds, and to find it coming back seated on the whirlwind.
At the heart of Weiner’s decades-old book is a point of great timelessness and great urgency, which ought to be inscribed on the mental motherboard of every coder, technologist, and entrepreneur. Eight years after the trailblazing philosopher Susanne Langer considered how the questions we ask shape the answers we give and the world we build, he writes:
Precisely because our existence is so improbable against the backdrop of a universe governed by entropy, it is imbued with a singular responsibility — a responsibility that is the source and succor of meaning in human life. In a sentiment which the Nobel-winning Polish poet Wisława Szymborska would later echo, Weiner writes:
In a very real sense we are shipwrecked passengers on a doomed planet. Yet even in a shipwreck, human decencies and human values do not necessarily vanish, and we must make the most of them. We shall go down, but let it be in a manner to which we may look forward as worthy of our dignity.
Nearly a century later, The Human Use of Human Beings remains an immensely insightful and increasingly relevant read. Complement it with the great cellist Pablo Casals on making our world worthy of its children, then revisit Thomas Merton’s beautiful letter to Rachel Carson about technology, wisdom, and the difficult art of civilizational self-awareness.
No comments:
Post a Comment