BERTOLOGY MEETS BIOLOGY: INTERPRETING ATTENTION IN PROTEIN LANGUAGE MODELS

Keyphrases

• Protein Structure 100%
• Transformer Architecture 100%
• Protein Language Model 100%
• Bertology 100%
• Amino Acids 50%
• 3D Visualization 50%
• 3D Structure 50%
• Binding Site 50%
• Target Binding 50%
• Biophysical Properties 50%
• Folded Structure 50%
• Present Challenges 50%
• Functional Components 50%
• Generation Task 50%
• Depth Layers 50%
• Classification Task 50%
• Protein Classification 50%
• Transformer Model 50%
• Attention Structure 50%
• XLNet 50%
• ALBERT 50%

Biochemistry, Genetics and Molecular Biology

• Amino Acids 100%
• Binding Site 100%
• Protein Structure 100%
• Protein Classification 100%