A Serverless Query Engine from Spare Parts

An open-source implementation of a Data Lake with DuckDB and AWS Lambdas

In this post we will show how to build a simple end-to-end application in the cloud on a serverless infrastructure. The purpose is simple: we want to show that we can develop directly against the cloud while minimizing the cognitive overhead of designing and building infrastructure. Plus, we will put together a design that minimizes costs compared …

analytics application aws aws lambda big big query building cloud cognitive costs data data engineering data lake design duckdb implementation infrastructure lake query serverless show snowflake warehouses