How to know which layers should i freeze in deep learning architectures for transfer learning?

I am trying to make generalizations about which layers to freeze. I know that I must freeze feature extraction layers but some feature extraction layers should not be frozen (for example in transformer architecture encoder part and multi-head attention part of the decoder(which are feature extraction layers) should not be frozen). Which layers I should call "feature extraction layer" in that sense? What kind of "feature extraction" layers should i freeze?

deep learning deeplearning learning transfer transfer learning