[D] Question on generating embeddings with Transformer Encoder-Decoder

I am currently trying to generate embeddings I have of a heterogeneous datasource I am working with. The problem is, that for every sample, I have a varying amount of input features. For the ones interested, the problem is biological. In particular I am trying to calculate a gene-level representation of this data and for every gene I have a different number of variants, with each variant having one feature value associated to it.


My solution to homogenise these features …

decoder embeddings encoder encoder-decoder every features gene generate machinelearning question representation sample transformer transformer encoder