Using Higher-Order Containers to Efficiently Process 7,163 (or More) DataFrames

Introducing the StaticFrame Bus, Batch, Quilt, and Yarn

DataFrame processing routines commonly work with collections of tables. Examples of such collections include a multi-year dataset with a single table per year, historical stock data with a table per ticker, or data from multiple sheets in an XLSX file. This article introduces novel “higher-order” containers for working with such collections of DataFrames, implemented in the Python StaticFrame package (a Pandas alternative that offers immutable DataFrames). The three core …

big data containers dataframes data science datastrucutre immutability