Applying graph theory for inferring your BigQuery SQL transformations: an experimental DataOps tool

If you work with Google Cloud for your Data Platform there are chances that you use BigQuery and run your Data pipelines transformations in a ELT manner: using BQ query engine to run transformations as a series of SELECT statements, one after another. Indeed over the last few years, ELT and tools like DBT or Dataform have been the de-facto standard for running and organizing your Data transformations at scale.

Theses tools, that we may group under the “SQL orchestration …

bigquery cloud data dataops data pipelines data platform elt experimental google google cloud googlecloud graph indeed pipelines platform query query engine series sql theory tool work