April 27, 2023, 6:06 a.m. | Davide Massidda

Towards Data Science - Medium towardsdatascience.com

Using and interpreting Hotelling’s T² and Squared Prediction Error Q in anomaly detection systems

Image from geralt on Pixabay

A substantial part of my job as a data scientist consists in building anomaly detection systems for process control in manufacturing, and the Principal Component Analysis (from now PCA) has an essential role in my toolbox.

The scientific literature suggests two measures to trace anomalies through the PCA: Hotelling’s T² and Squared Prediction Error, aka Q error. Although their calculation …

analysis anomaly anomaly detection building control data data scientist detection error errors job literature manufacturing multivariate multivariate-analysis part pca-analysis prediction principal-component process role software systems

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne