Performance of AMPLIFY for subsequent prediction tasks

[philippschw]

I greatly appreciate you providing the full training recipes for a protein language model, however our own test on a binding prediction task showed very poor performance of embeddings obtained from AMPLIFY_120M model. Did you test the performance of AMPLIFY on subsequent prediction tasks and benchmarked against: ProstT5, ESM-2, and others?

Example prediction tasks:

• per-residue prediction of secondary structure
• binding residues
• conservation
• per-protein prediction of subcellular location

[qfournier]

I don't have results to share on downstream tasks like binding or secondary structure prediction at this time. The main reason is that designing biologically relevant tasks is essential but challenging and time-consuming. You are welcome to fine-tune and evaluate the pre-trained AMPLIFY models! There are several datasets on Hugging Face for the tasks you mentioned, but be sure to validate them as they may be biased and underestimate or overestimate the model's performance.