·  HOME

Pangaro Incorporated

 

CYBERNETICS: A Definition


Artificial Intelligence and cybernetics: Aren't they the same thing? Or, isn't one about computers and the other about robots? The answer to these questions is emphatically, No.

Artificial Intelligence (AI) uses computer technology to strive toward the goal of machine intelligence and considers implementation as the most important result; cybernetics uses epistemology (the limits to how we know what we know) to understand the constraints of any medium (technological, biological, or social) and considers powerful descriptions as the most important result.

The field of AI came into being when the concept of universal computation [Minsky 1967], the cultural view of the brain as a computer, and the availability of digital computing machines were combined. The field of cybernetics came into being when concepts of information, feedback, and control [Wiener 1948] were generalized from specific applications in engineering to systems in general, including systems of living organisms, abstract intelligent processes, and language.

Origins of "cybernetics"

The term itself began its rise to popularity in 1947 when Norbert Wiener used it to name a discipline apart from, but touching upon, such established disciplines as electrical engineering, mathematics, biology, neurophysiology, anthropology, and psychology. Wiener, Arturo Rosenblueth, and Julian Bigelow needed a new word to refer to their new concept, and they adapted a Greek word meaning "the art of steering" to evoke the rich interaction of goals, predictions, actions, feedback, and response in systems of all kinds (the term "governor" derives from the same root) [Wiener 1948]. Early applications in the control of physical systems (aiming artillery, designing electrical circuits, and maneuvering simple robots) clarified the fundamental roles of these concepts in engineering; but the relevance to social systems and the softer sciences was also clear from the start. Many researchers from the 1940s through 1960 worked solidly within the tradition of cybernetics without necessarily using the term, some likely (R. Buckminster Fuller) but many less obviously (Gregory Bateson, Margaret Mead).

Limits to knowing

In working to derive functional models common to all systems, early cybernetic researchers quickly realized that "the science of observed systems" cannot be divorced from "the science of observing systems" [von Foerster 1974] --- because it is we who observe. The cybernetic approach is centrally concerned with this unavoidable limitation of what we can know: our own subjectivity. In this way cybernetics is aptly called "applied epistemology". At minimum, its utility is the production of useful descriptions, and, specifically, descriptions that include the observer in the description --- so-called "second-order cybernetics", in contrast to "first-order cybernetics", the science of feedback, goals, and information without distinguishing an observer. Cybernetic descriptions of psychology, language, arts, performance, or intelligence (to name a few) may be quite different from more conventional, hard "scientific" views --- although cybernetics can be rigorous too. Implementation may then follow in software and/or hardware, or in the design of social, managerial, and other classes of interpersonal systems.

Origins of AI in cybernetics

Ironically but logically, AI and cybernetics have each gone in and out of fashion and influence in the search for machine intelligence. Cybernetics started in advance of AI, but AI dominated between 1960 and 1985. From the late 1980s, difficulties in AI led to renewed search for solutions that mirror prior approaches of cybernetics. Warren McCulloch and Walter Pitts were the first to propose a synthesis of neurophysiology and logic that tied the capabilities of brains to the limits of Turing computability [McCulloch & Pitts 1965]. The euphoria that followed spawned the field of AI [Lettvin 1989] along with early work on computation in neural nets, or, as then called, perceptrons. However the fashion of symbolic computing rose to squelch perceptron research. Only when discontent slowly grew over repeated failures to achieve machine intelligence by symbolic means within AI did interest in neural networks rise again in the late 1980s. However this is not to say that current fashion in neural nets is a return to where cybernetics has been. Much of the modern work in neural nets rests in the philosophical tradition of AI and not that of cybernetics.

Philosophy of cybernetics

AI is predicated on the presumption that knowledge is a commodity that can be stored inside of a machine, and that the application of such stored knowledge to the real world constitutes intelligence [Minsky 1968]. Only within such a "realist" view of the world can, for example, semantic networks and rule-based expert systems appear to be a route to intelligent machines. Cybernetics in contrast has evolved from a "constructivist" view of the world [von Glasersfeld 1987] where objectivity derives from shared agreement about meaning, and where information (or intelligence for that matter) is an attribute of an interaction rather than a commodity stored in a computer [Winograd & Flores 1986]. These differences are not merely semantic in character, but rather determine fundamentally the source and direction of research performed from a cybernetic, versus an AI, stance.



Figure 1. Underlying philosophical differences between AI and cybernetics are displayed by showing how they each construe the terms in the central column. For example, the concept of "representation" is cast quite differently in the two fields. Relations on the left are causal arrows and reflect the reductionist reasoning inherent in AI's "realist" perspective that via our nervous systems we discover the-world-as-it-is. Relations on the right are non-hierarchical and circular to reflect a "constructivist" perspective, where the world is invented (in contrast to being discovered) by an intelligence acting in a social tradition and through hermeneutic cycles that create shared meaning.

Influences

Winograd and Flores credit the influence of Humberto Maturana, a biologist who recasts the concepts of "language" and "living system" with a cybernetic eye [Maturana & Varela 1988], in shifting their opinions away from the AI perspective. They quote Maturana: "Learning is not a process of accumulation of representations of the environment; it is a continuous process of transformation of behavior through continuous change in the capacity of the nervous system to synthesize it. Recall does not depend on the indefinite retention of a structural invariant that represents an entity (an idea, image or symbol), but on the functional ability of the system to create, when certain recurrent demands are given, a behavior that satisfies the recurrent demands or that the observer would class as a reenacting of a previous one." [Maturana 1980] Cybernetics has directly affected software for intelligent training, knowledge representation, cognitive modeling, computer-supported cooperative work, and neural modeling. Useful results have been demonstrated in all these areas. Like AI, however, cybernetics has not produced recognizable solutions to the machine intelligence problem, or at least not for domains considered complex in the metrics of symbolic processing. Many beguiling artifacts have been produced with an appeal more familiar in an entertainment medium or to organic life than a piece of software [Pask 1971]. Meantime, in a repetition of history in the 1950s, the influence of cybernetics is being felt throughout the hard and soft sciences, as well as in AI. This time however it is cybernetics' epistemological stance --- that all human knowing is constrained by our perceptions and our beliefs, and hence is subjective --- that is its contribution to these fields.

Bibliography

Lettvin, Jerome Y., "Introduction to Volume 1" in W S McCulloch., Volume 1, ed., Rook McCulloch, Salinas, California: Intersystems Publications, 1989, 7-20.

McCulloch, Warren S. and Walter H. Pitts, "A Logical Calculus of the Ideas Immanent in Nervous Activity", in
Embodiments of Mind by Warren S. McCulloch. Cambridge, Massachusetts: The MIT Press, 1965, 19-39.

Maturana, Humberto R., Biology of Cognition, 1970. Reprinted in Maturana, Humberto R. and Francisco Varela,
Autopoiesis and Cognition: The Realization of the Living. Dordrecht: Reidel, 1980, 2-62.

Maturana, Humberto R. and Francisco J. Varela,
The Tree of Knowledge. Boston and London: New Science Library, Shambala Publications, Inc, 1988.

Minsky, Marvin,
Computation: Finite and Infinite Machines. New Jersey: Prentice Hall, Inc., 1967.

Minsky, Marvin, ed.,
Semantic Information Processing. Cambridge, Massachusetts: The MIT Press, 1968.

Pask, Gordon, "A Comment, a Case History and a Plan". In
Cybernetic Serendipity, ed, J. Reichardt. Rapp and Carroll, 1970. Reprinted in Cybernetics, Art and Ideas, ed., J. Reichardt. London: Studio Vista, 1971, 76-99.

von Foerster, Heinz, ed.,
Cybernetics of Cybernetics. Sponsored by a grant from the Point Foundation to the Biological Computer Laboratory, University of Illinois, Urbana, Illinois, 1974.

von Glasersfeld, Ernst,
The Construction of Knowledge, Contributions to Conceptual Semantics. Seaside, California: Intersystems Publications, 1987.

Wiener, Norbert,
Cybernetics, or control and communication in the animal and the machine. Cambridge, Massachusetts: The Technology Press; New York: John Wiley & Sons, Inc., 1948.

Winograd, Terry and Fernando Flores,
Understanding Computers And Cognition: A New Foundation for Design. Norwood, New Jersey: Ablex Publishing Corporation, 1986.

-end-


[In 1990 Heinz von Foerster was approached by Macmillan to compose an entry for their 1991 Encyclopedia of Computers and von Foerster kindly pointed them to me. The resulting text incorporates a figure created for an earlier purpose, and published in a slightly edited form from the above. Final text is Copyright (c) Macmillan Publishing. - Paul Pangaro]


Related Links

Conversation Theory, an informal introduction

Video Footage of Cyberneticians


© Copyright Paul Pangaro 1994 - 2005. All Rights Reserved.