A Close Look into the Calibration of Pre-trained Language Models

Keyphrases

• Calibration Method 50%
• Confidence Estimation 16%
• Control Variables 16%
• Controlled Experiment 16%
• Dynamic Change 16%
• Fine-grained Control 16%
• Label Smoothing 16%
• Large-scale Pre-trained Model 16%
• Model Calibration 33%
• Model Confidence 16%
• Model Pretraining 16%
• Overconfidence 16%
• Pre-trained Language Model 100%
• Predictive Uncertainty 16%
• Reliable Estimate 16%
• Sample Training 16%
• Training Model 16%
• Training Process 16%
• Training Samples 16%
• Training Step 16%
• Tunable Parameters 16%

Computer Science

• Confidence Estimation 14%
• Experimental Result 14%
• Grained Control 14%
• Model Calibration 28%
• Parameter Model 14%
• Pre-Trained Language Models 100%
• Training Process 14%
• Training Sample 14%