Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup

Keyphrases

• Encoder 100%
• Batch Size 100%
• Limited Memory 100%
• Contrastive Loss 100%
• Deep Contrastive Learning 100%
• Scaling Deep 100%
• Constant Memory 50%
• Backpropagation 50%
• Data Dependency 50%
• Memory Consumption 50%
• GPU Memory 50%
• Vector Representation 50%
• Backward Pass 50%
• Caching Technique 50%
• Contrastive Learning 50%

Computer Science

• Contrastive Loss 100%
• Contrastive Learning 100%
• Constant Memory 50%
• Data Dependency 50%
• Positive Example 50%
• Graphics Processing Unit 50%