How CPython Implements and Uses Bloom Filters for String Processing

How CPython Implements and Uses Bloom Filters for String Processing

Fascinating dive into Python string internals by Abhinav Upadhyay. It turns out CPython uses very simple bloom filters in several parts of the core string methods, to solve problems like splitting on newlines where there are actually eight codepoints that could represent a newline, and a tiny bloom filter can help filter a character in a single operation before performing all eight comparisons only if that first check failed.

bloom core filters performance processing python simple solve string