Robuta

https://imbue.com/research/2020-08-24-understanding-self-supervised-contrastive-learning/ Understanding self-supervised and contrastive learning with "Bootstrap Your Own Latent"... Summary (1) BYOL often performs no better than random when batch normalization is removed, and (2) the presence of batch normalization… understanding self supervised https://imbue.com/research/2020-08-24-appendix-for-understanding-self-supervised-contrastive-learning/ Appendix for "Understanding self-supervised and contrastive learning with 'Bootstrap Your... The BYOL terminology is used throughout this blog post. To compare to other papers, see the below table. Name SimCLR MoCo BYOL (used… understanding self supervised