[D] Do we know how Gemini 1.5 achieved 10M context window?

Do we know how Gemini 1.5 achieved its 1.5M context window? Wouldn’t compute go up quadratically as the attention window expands?

attention compute context context window gemini gemini 1.5 machinelearning