Building/training Stable Diffusion from scratch locally. [P]

I'm interested in implementing stable diffusion from scratch in PyTorch on my MacBook. This is mostly just educational, building VAEs, transformers, and the rest from scratch, training them, etc. I know the actual model has many parameters and trains over 5 billion captioned images; my model will necessarily be much smaller. How should I get started? Any specific papers, datasets, and articles that review this material would be greatly appreciated. I've seen the architecture has undergone many iterations already, where …

billion building diffusion educational etc images macbook machinelearning parameters pytorch rest scratch stable diffusion them training trains transformers will