[D] Adjusting a subset of one unet based on another one

Lets say I have 2 unets: 1 has 50,000 values, and one has 18,000.
They have have the same number of dimensions.
The smaller one is a strict subset of the larger one, in the sense that i can tell you that Smallset\[x\] represents the same concept as Largeset\[y\]

Now comes the issue.


While I know which indexes in Smallset correspond to ones in Largeset.... the actual unet weights were independently trained. Therefore, the weights for Smallset\[x\] are completely unrelated …

adjusting concept dimensions machinelearning sense unet values