The Optimal Choice of Hypothesis Is the Weakest, Not the Shortest

arXiv:2301.12987v4 Announce Type: replace-cross
Abstract: If $A$ and $B$ are sets such that $A \subset B$, generalisation may be understood as the inference from $A$ of a hypothesis sufficient to construct $B$. One might infer any number of hypotheses from $A$, yet only some of those may generalise to $B$. How can one know which are likely to generalise? One strategy is to choose the shortest, equating the ability to compress information with the ability to generalise (a proxy for …

abstract arxiv construct cs.ai cs.lg hypothesis inference math.lo type