Reprogramming Pretrained Language Models for Protein Sequence Representation Learning

The representation reprogramming via dictionary learning framework reprograms a pretrained English language model to learn the embeddings of protein sequences by learning a sparse linear mapping between English and protein vocabulary embeddings.