Fast Multivalue Look-ups For Huge Data Sets

1. Synopsis


2. Rationale


3. Context


4. The Recipe


5. Caveats

This article provides a recipe for building fast look-up tables for huge CSV data sets in Python.

Look-up tables are meant to be read-only data structures used to search for a presence of a given key and to retrieve multiple values associated with existing keys.

Recipe is meant to be a rough approach in contrast to a precise algorithm.

Huge is relative and means significantly exceeding the amount of available …

bigdata csv data numpy python ups