arXiv preprint 2026

On the Role of the Projector in Contrastive Self-Supervised Learning: Last-Layer Rank Dynamics Drive Representation Quality

S Manna P Mandal U Pal S Bhattacharya

Abstract

Our method improves Top-1 accuracy by more than 1% on SimCLR on the ImageNet100 dataset and consistently outperforms baseline SimCLR variants on CIFAR datasets, supporting our interpretation of the projector's role.

More works

All publications →

BibTeX

@article{manna2026role,
  title={On the Role of the Projector in Contrastive Self-Supervised Learning: Last-Layer Rank Dynamics Drive Representation Quality},
  author={Manna, S and Mandal, P and Pal, U and Bhattacharya, S},
  journal={arXiv preprint arXiv:2609.26334},
  year={2026},
  url={https://sadimanna.github.io/papers/projector-rank/}
}