[N] PyTorch 2.2: FlashAttention-v2, AOTInductor

# [PyTorch 2.2: FlashAttention-v2, AOTInductor](https://github.com/pytorch/pytorch/releases/tag/v2.2.0)

* Highlights
* Backwards Incompatible Changes
* Deprecations
* New Features
* Improvements
* Bug fixes
* Performance
* Documentation

# Highlights

We are excited to announce the release of PyTorch® 2.2! PyTorch 2.2 offers \~2x performance improvements to scaled\_dot\_product\_attention
via FlashAttention-v2 integration, as well as AOTInductor, a new ahead-of-time compilation and deployment tool built for non-python server-side deployments.

This release also includes improved torch.compile support for Optimizers, a number of new inductor optimizations, and …

bug fixes compilation deployment deployments documentation features highlights improvements integration machinelearning new features performance python pytorch release server tool via