Tranforming keypoints of a source image to fit a destination image

If i have certain keypoints of 2 images and I want the source image's keypoints to overlap the destination image's keypoints via some transform, what would be the best choice? That is, I want the source image's keypoints to either "stretch", "shrink","shear", etc. to fit the target image's keypoints.

I've been exploring transforms like Affine, etc but it turns out they're all linear and only work on 3 points and that might not work for me.c

Any help here is …

computervision etc image images shear via