Eric Schwartz

Under shift, caused for example by eye movement, or by relative movement of the subject or object of perception, the cortical representation undergoes very large changes in “size” and “shape.” Space-variance of cortical representation rules out models that fundamentally require linear interpolation between shifted patterns (e.g., Edelman's model) or rigid shift of an invariant retinal stimulus corresponding to shift at the cortex (e.g., the shifter theory of van Essen). Recently, a computational solution of “quasi-shift” invariance for space-variant mappings has been constructed (Bonmassar & Schwartz 1997a; 1997b).

In the target article Pylyshyn revives the spectre of the “little green man,” arguing for a largely symbolic representation of visual imagery. To clarify this problem, we provide precise definitions of the key term “picture,” present some examples of our definition, and outline an information-theoretic analysis suggesting that the problem of addressing data in the brain requires a partially analogue and partially symbolic solution. This is made concrete in the ventral stream of object recognition, from V1 to IT cortex.