Stevan Harnad

In our century a Frege/Brentano wedge has gradually been driven into the mind/body problem so deeply that it appears to have split it into two: The problem of "qualia" and the problem of "intentionality." Both problems use similar intuition pumps: For qualia, we imagine a robot that is indistinguishable from us in every objective respect, but it lacks subjective experiences; it is mindless. For intentionality, we again imagine a robot that is indistinguishable from us in every objective respect but its "thoughts" lack "aboutness"; they are meaningless. I will try to show that there is a way to re-unify the mind/body problem by grounding the "language of thought" (symbols) in our perceptual categorization capacity. The model is bottom-up and hybrid symbolic/nonsymbolic

When certain formal symbol systems (e.g., computer programs) are implemented as dynamic physical symbol systems (e.g., when they are run on a computer) their activity can be interpreted at higher levels (e.g., binary code can be interpreted as LISP, LISP code can be interpreted as English, and English can be interpreted as a meaningful conversation). These higher levels of interpretability are called "virtual" systems. If such a virtual system is interpretable as if it had a mind, is such a "virtual mind" real? This is the question addressed in this "virtual" symposium, originally conducted electronically among four cognitive scientists: Donald Perlis, a computer scientist, argues that according to the computationalist thesis, virtual minds are real and hence Searle's Chinese Room Argument fails, because if Searle memorized and executed a program that could pass the Turing Test in Chinese he would have a second, virtual, Chinese-understanding mind of which he was unaware (as in multiple personality). Stevan Harnad, a psychologist, argues that Searle's Argument is valid, virtual minds are just hermeneutic overinterpretations, and symbols must be grounded in the real world of objects, not just the virtual world of interpretations. Computer scientist Patrick Hayes argues that Searle's Argument fails, but because Searle does not really implement the program: A real implementation must not be homuncular but mindless and mechanical, like a computer. Only then can it give rise to a mind at the virtual level. Philosopher Ned Block suggests that there is no reason a mindful implementation would not be a real one

2. Invariant Sensorimotor Features ("Affordances"). To say this is not to declare oneself a Gibsonian, whatever that means. It is merely to point out that what a sensorimotor system can do is determined by what can be extracted from its motor interactions with its sensory input. If you lack sonar sensors, then your sensorimotor system cannot do what a bat's can do, at least not without the help of instruments. Light stimulation affords color vision for those of us with the right sensory apparatus, but not for those of us who are color-blind. The geometric fact that, when we move, the "shadows" cast on our retina by nearby objects move faster than the shadows of further objects means that, for those of us with normal vision, our visual input affords depth perception. From more complicated facts of projective and solid geometry it follows that a 3-dimensional shape, such as, say, a boomerang, can be recognized as being the same shape Ð and the same size Ð even though the size and shape of its shadow on our retinas changes as we move in relation to it or it moves in relation to us. Its shape is said to be invariant under these sensorimotor transformations, and our visual systems can detect and extract that invariance, and translate it into a visual constancy. So we keep seeing a boomerang of the same shape and size even though the shape and size of its retinal shadows keep changing

There has been much discussion recently about the scope and limits of purely symbolic models of the mind and about the proper role of connectionism in cognitive modeling. This paper describes the symbol grounding problem : How can the semantic interpretation of a formal symbol system be made intrinsic to the system, rather than just parasitic on the meanings in our heads? How can the meanings of the meaningless symbol tokens, manipulated solely on the basis of their shapes, be grounded in anything but other meaningless symbols? The problem is analogous to trying to learn Chinese from a Chinese/Chinese dictionary alone. A candidate solution is sketched: Symbolic representations must be grounded bottom-up in nonsymbolic representations of two kinds: iconic representations, which are analogs of the proximal sensory projections of distal objects and events, and categorical representations, which are learned and innate feature-detectors that pick out the invariant features of object and event categories from their sensory projections. Elementary symbols are the names of these object and event categories, assigned on the basis of their categorical representations. Higher-order symbolic representations, grounded in these elementary symbols, consist of symbol strings describing category membership relations. Connectionism is one natural candidate for the mechanism that learns the invariant features underlying categorical representations, thereby connecting names to the proximal projections of the distal objects they stand for. In this way connectionism can be seen as a complementary component in a hybrid nonsymbolic/symbolic model of the mind, rather than a rival to purely symbolic modeling. Such a hybrid model would not have an autonomous symbolic module, however; the symbolic functions would emerge as an intrinsically dedicated symbol system as a consequence of the bottom-up grounding of categories ' names in their sensory representations. Symbol manipulation would be governed not just by the arbitrary shapes of the symbol tokens, but by the nonarbitrary shapes of the icons and category invariants in which they are grounded

We are accustomed to thinking that a primrose is "concrete" and a prime number is "abstract," that "roundness" is more abstract than "round," and that "property" is more abstract than "roundness." In reality, the relation between "abstract" and "concrete" is more like the (non)relation between "abstract" and "concave," "concrete" being a sensory term [about what something feels like] and "abstract" being a functional term (about what the sensorimotor system is doing with its input in order to produce its output): Feelings and things are correlated, but otherwise incommensurable. Everything that any sensorimotor system such as ourselves manages to categorize successfully is based on abstracting sensorimotor "affordances" (invariant features). The rest is merely a question of what inputs we can and do categorize, and what we must abstract from the particulars of each sensorimotor interaction in order to be able to categorize them correctly. To categorize, in other words, is to abstract. And not to categorize is merely to experience. Borges's Funes the Memorious, with his infinite, infallible rote memory, is a fictional hint at what it would be like not to be able to categorize, not to be able to selectively forget and ignore most of our input by abstracting only its reliably recurrent invariants. But a sensorimotor system like Funes would not really be viable, for if something along those lines did exist, it could not categorize recurrent objects, events or states, hence it could have no language, private or public, and could at most only feel, not function adaptively (hence survive). Luria's "S" in "The Mind of a Mnemonist" is a real-life approximation whose difficulties in conceptualizing were directly proportional to his difficulties in selectively forgetting and ignoring. Watanabe's "Ugly Duckling Theorem" shows how, if we did not selectively weight some properties more heavily than others, everything would be equally (and infinitely and indifferently) similar to everything else. Miller's "Magical Number Seven Plus or Minus Two" shows that there are (and must be) limitations on our capacity to process and remember information, both in our capacity to discriminate relatively (detect sameness/difference, degree-of-similarity) and in our capacity to discriminate absolutely (identify, categorize, name), The phenomenon of categorical perception shows how selective feature-detection puts a Whorfian "warp" on our feelings of similarity in the service of categorization, compressing within-category similarities and expanding between-category differences by abstracting and selectively filtering inputs through their invariant features, thereby allowing us to sort and name things reliably. Language does allow us to acquire categories indirectly through symbolic description....

William Gardner's proposal to establish a searchable, retrievable electronic archive is fine, as far as it goes. The potential role of electronic networks in scientific publication, however, goes far beyond providing searchable electronic archives for electronic journals. The whole process of scholarly communication is currently undergoing a revolution comparable to the one occasioned by the invention of printing. On the brink of intellectual perestroika is that vast PREPUBLICATION phase of scientific inquiry in which ideas and findings are discussed informally with colleagues, presented more formally in seminars, conferences and symposia, and distributed still more widely in the form of preprints and tech reports that have undergone various degrees of peer review. It has now become possible to do all of this in a remarkable new way that is not only incomparably more thorough and systematic in its distribution, potentially global in scale, and almost instantaneous in speed, but so unprecedentedly interactive that it will substantially restructure the pursuit of knowledge

Computationalism. According to computationalism, to explain how the mind works, cognitive science needs to find out what the right computations are -- the same ones that the brain performs in order to generate the mind and its capacities. Once we know that, then every system that performs those computations will have those mental states: Every computer that runs the mind's program will have a mind, because computation is hardware independent : Any hardware that is running the right program has the right computational states.

After people learn to sort objects into categories they see them differently. Members of the same category look more alike and members of different categories look more different. This phenomenon of within-category compression and between-category separation in similarity space is called categorical perception (CP). It is exhibited by human subjects, animals and neural net models. In backpropagation nets trained first to auto-associate 12 stimuli varying along a onedimensional continuum and then to sort them into 3 categories, CP arises as a natural side-effect because of four factors: (1) Maximal interstimulus separation in hidden-unit space during autoassociation learning, (2) movement toward linear separability during categorization learning, (3) inverse-distance repulsive force exerted by the between-category boundary, and (4) the modulating effects of input iconicity, especially in interpolating CP to untrained regions of the continuum. Once similarity space has been "warped" in this way, the compressed and separated "chunks" have symbolic labels which could then be combined into symbol strings that constitute propositions about objects. The meanings of such symbolic representations would be "grounded" in the system's capacity to pick out from their sensory projections the object categories that the propositions were about.

Research is done (mostly at universities) and funded (publicly and privately) in order to advance scientific and scholarly knowledge as well as to produce public benefits (technological and biomedical applications as well as educational and cultural ones). Research and researchers are accordingly funded not only to conduct their research, but to make their findings public, by publishing them. Their employment, salaries, careers and research funding depend on publishing their findings. This is what is often called "publish or perish.&quot

I want to report a thoroughly (perhaps surreally) modern experience I had recently. First a little context. I've always been a zealous scholarly letter writer (to the point of once being cited in print as "personal communication, pp. 14 - 20"). These days few share my epistolary penchant, which is dismissed as a doomed anachronism. Scholars don't have the time. Inquiry is racing forward much too rapidly for such genteel dawdling -- forward toward, among other things, due credit in print for one's every minute effort. So I too had resigned myself to the slower turnaround but surer rewards of conventional scholarly publication. Until I came upon electronic mail: almost as rapid and direct and spontaneous as a telephone call, but with the added discipline and permanence of the written medium. I quickly became addicted, "logging on" to check my e mail at all hours of the day and night and accumulating files of intellectual exchanges with similarly inclined e epistoleans, files that rapidly approached book length

In innate Categorical Perception (CP) (e.g., colour perception), similarity space is "warped," with regions of increased within-category similarity (compression) and regions of reduced between-category similarity (separation) enh ancing the category boundaries and making categorisation reliable and all-or-none rather than graded. We show that category learning can likewise warp similarity space, resolving uncertainty near category boundaries. Two Hard and two Easy texture learning tasks were compared: As predicted, there were fewer successful Learners with the Hard task, and only the successful Learners of the Hard task exhibited CP. In a second experiment, the Easy task was made Hard by making the corrective feedback during learn ing only 90% reliable; this too generated CP. The results are discussed in relation to supervised, unsupervised and dual-mode models of category learning and representation.The world is full of things that vary in their similarity and interconfusability.O rganisms must somehow resolve this confusion, sorting and acting upon things adaptively. It might be important, for example, to learn which kinds of mushrooms are poisonous and which are safe to eat, minimising the confusion between them (Greco, Cangelosi & Harnad 1997).

There are many entry points into the problem of categorization. Two particularly important ones are the so-called top-down and bottom-up approaches. Top-down approaches such as artificial intelligence begin with the symbolic names and descriptions for some categories already given; computer programs are written to manipulate the symbols. Cognitive modeling involves the further assumption that such symbol-interactions resemble the way our brains do categorization. An explicit expectation of the top-down approach is that it will eventually join with the bottom-up approach, which tries to model how the hardware of the brain works: sensory systems, motor systems and neural activity in general. The assumption is that the symbolic cognitive functions will be implemented in brain function and linked to the sense organs and the organs of movement in roughly the way a program is implemented in a computer, with its links to peripheral devices such as transducers and effectors.

To appreciate what a huge difference there is between the author of a peer reviewed journal article and just about any other kind of author we need only remind ourselves why universities have their "publish or perish" policy: Aside from imparting existing knowledge to students through teaching, the work of a university scholar or scientist is devoted to creating new knowledge for other scholars and scientists to use, apply, and build upon, for the benefit of us all. Creating new knowledge is called "research," and its active use and application are called "research impact." Researchers are encouraged, indeed required, to publish their findings because that is the only way to make their research accessible to and usable by other researchers. It is the only way for research to generate further research. Not publishing it means no access to it by other researchers, and no access means no impact -- in which case the research may as well not have done in the first place.

Both Artificial Life and Artificial Mind are branches of what Dennett has called "reverse engineering": Ordinary engineering attempts to build systems to meet certain functional specifications, reverse bioengineering attempts to understand how systems that have already been built by the Blind Watchmaker work. Computational modelling (virtual life) can capture the formal principles of life, perhaps predict and explain it completely, but it can no more be alive than a virtual forest fire can be hot. In itself, a computational model is just an ungrounded symbol system; no matter how closely it matches the properties of what is being modelled, it matches them only formally, with the mediation of an interpretation. Synthetic life is not open to this objection, but it is still an open question how close a functional equivalence is needed in order to capture life. Close enough to fool the Blind Watchmaker is probably close enough, but would that require molecular indistinguishability, and if so, do we really need to go that far?

Europe is losing almost 50% of the potential return on its research investment until research funders and institutions mandate that all research findings must be made freely accessible to all would be users, webwide. It is not the number of articles published that reflects the return on Europe's research investment: A piece of research, if it is worth funding and doing at all, must not only be published, but used, applied and built upon by other researchers, worldwide. This is called 'research impact' and a measure of it is the number of times an article is cited by other articles ('citation impact').

Almost all words are the names of categories. We can learn most of our words (and hence our categories) from dictionary definitions, but not all of them. Some have to be learned from direct experience. To understand a word from its definition we need to already understand the words used in the definition. This is the “Symbol Grounding Problem” [1]. How many words (and which ones) do we need to ground directly in sensorimotor experience in order to be able to learn all other words via definition alone? The answer may shed some light both on the developmental origin of word meanings and on the evolutionary origin and adaptive value of language. We used an algorithm to reduce each of our dictionaries (Longmans LDOCE, Cambridge CIDE and WordNet) to its “grounding kernel” (“Kernel”) (which turned out to be about 10% of the dictionary) by systematically eliminating..

This is a paperback reissue of a 1988 special issue of Cognition - dated but still of interest. The book consists of three chapters, each making one major negative point about connectionism. Fodor & Pylyshyn (F&P) argue that connectionist networks (henceforth 'nets') are not good models for cognition because they lack 'systematicity', Pinker & Price (P&P) argue that nets are not good substitutes for rule-based models of linguistic ability, and Lachter & Bever (L&B) argue that nets can only model the associative relations between cognitive structures, not the structures themselves.

Behavioral scientists studied behavior; cognitive scientists study what generates behavior. Cognitive science is hence theoretical behaviorism (or behaviorism is experimental cognitivism). Behavior is data for a cognitive theorist. What counts as a theory of behavior? In this paper, a methodological constraint on theory construction -- "neoconstructivism" -- will be proposed (by analogy with constructivism in mathematics): Cognitive theory must be computable; given an encoding of the input to a behaving system, a theory must be able to compute (an encoding of) its outputs. It is a mistake to conclude, however, that this constraint requires cognitive theory to be computational, or that it follows from this that cognition is computation