Quick Dense Retrievers Consume KALE: Post Training Kullback.Leibler Alignment of Embeddings for Asymmetrical dual encoders

Keyphrases

• Kullback-Leibler 100%
• Dual Encoder 100%
• Dense Retrievers 100%
• Encoder 60%
• Dense Retrieval 60%
• Inference Efficiency 40%
• Size Asymmetry 20%
• Pruning 20%
• Retrieval Methods 20%
• Retrieval System 20%
• Accurate Method 20%
• Generative Models 20%
• Language Model 20%
• Fast Inference 20%
• Model Size 20%
• Traditional Knowledge 20%
• Index Generation 20%
• Knowledge Distillation 20%
• Inference Latency 20%
• Asymmetric Training 20%
• Structural Compression 20%
• DistilBERT 20%
• Bi-encoder 20%

Computer Science

• retrieval method 100%
• Language Modeling 100%
• Knowledge Distillation 100%
• DistilBERT 100%