John Tuskey

Allen Coin & Veljko Dubljević discuss the potential implications of a brain-computer interface (BCI) that sends input signals to a calculator which would then “…transmit the result of the calculation to the subject in such a way that the subject could immediately mentally note, verbalize, or record the result” [1]. In other words, the system sends an output, presumably via deep brain stimulation (DBS), which induces thought-like experiences. They characterize this system as being able to enhance cognition and restore the mathematical capacity and self-esteem of those with dyscalculia. However, many reports suggest that DBS and BCI technology can have negative unintended psychological consequences. I introduce a related conceptual model of a “BCI-LLM system” to better illustrate the possible negative unintended psychological consequences of contentful DBS, or neural stimulations that produce meaningful sensations, regardless of whether true cognitive enhancement occurs. It is possible, for example, that a subject can be fooled into thinking that the output of the device is one’s own thought. I call this the Illusion of Directed Production (IDP). I model the phenomenality of contentful DBS experiences alongside auditory verbal hallucinations (AVHs) and thought insertions (TIs) to show the potential for delusion formation and metacognitive and self-narrating disturbances [2–4] when using such systems. I argue that psychological risks and worries are present in such systems regardless of whether they truly enhance cognition or extend the mind.