•  150
    We formalize how learning produces origination and control. A system understands a domain relative to an evaluator if it can modify its own program in response to that feedback, such that the modified program generalizes over the domain. An evaluator is a source of feedback, which is consistent in the sense that it gives the same judgment for the same input. We show that when understanding is realized through a learning rule applied to procedural traces (here, gradient descent), organized knowle…Read more
  •  29
    We propose an operational, quantitative definition of intelligence for arbitrary physical systems. The intelligence density of a system is the ratio of the logarithm of its independent outputs to its total description length. A system memorizes if its description length grows with its output count; it knows if its description length remains fixed while its output count diverges. The criterion for knowing is generalization. A system knows its domain if a single finite mechanism can produce correc…Read more