•  90
    Soul searching and heart throbbing for biological modeling
    with Chi-Sang Poon
    Behavioral and Brain Sciences 24 (6): 1080-1081. 2001.
    Biological models are useful not only because they can simulate biological behaviors, but because they may shed light on the inner workings of complex biological structures and functions as deduced by top-down and/or bottom-up reasoning. Beyond the stylistic appeal of specific implementation methods, a model should be appraised according to its ability to bring out the underlying organizing and operating principles – which are truly the model's heart and soul.
  •  22
    I argue that alignment in artificial agents requires structural metabolic vulnerability, not behavioral constraint. Current alignment methods---reinforcement learning from human feedback, Constitutional AI, constrained policy optimization, safety pretraining---achieve real progress at adjusting the weighing of scalar objectives, but they share a common assumption: that alignment is a problem about policy behavior rather than agent constitution. That assumption, I argue, misses what makes biologi…Read more