Data Observability vs. Data Testing: Everything You Need to Know

You already test your data. Do you need data observability, too?

Image courtesy of ESB Professional from Shutterstock.com, purchased with Standard Licensing

For the past decade, the first-and-only line of defense against bad data was testing.

Similar to how software engineers would use unit tests to identify buggy code before it was pushed to production, data engineers would leverage tests to detect and prevent potential data quality issues from moving further downstream. This approach was (mostly) fine — until …

data data engineering data-observability data-reliability data science data-testing observability testing