Harvard Researchers Introduce A Novel ViT Architecture Called Hierarchical Image Pyramid Transformer (HIPT) That Can Scale Vision Transformers To Gigapixel Images Via Hierarchical Self-Supervised Learning

Web: https://www.reddit.com/r/computervision/comments/vfgn3d/harvard_researchers_introduce_a_novel_vit/

🚦 HIPT is pretrained across 33 cancer types using 10,678 gigapixel WSIs, 408,218 4096×4096 images, and 104M 256 × 256 images

🚦 HIPT pushes the boundaries of both Vision Transformers and self-supervised learning in two important ways.

🚦 The code is available

[Continue reading](https://www.marktechpost.com/2022/06/18/harvard-researchers-introduce-a-novel-vit-architecture-called-hierarchical-image-pyramid-transformer-hipt-that-can-scale-vision-transformers-to-gigapixel-images-via-hierarchical-self-supervised-lear/) | *Checkout the* [*paper*](https://arxiv.org/pdf/2206.02647.pdf)*,* [*github*](https://github.com/mahmoodlab/HIPT)

​

https://i.redd.it/c0ivcnxbeg691.gif

architecture computervision harvard hierarchical image images learning researchers scale self-supervised learning supervised learning transformer transformers vision