You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+19-20Lines changed: 19 additions & 20 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -28,7 +28,7 @@ This self-supervised learning framework offers the following features:
28
28
29
29
- Modular framework, which exposes low-level building blocks such as loss functions and
30
30
model heads.
31
-
- Easy to use and written in a PyTorchlike style.
31
+
- Easy to use and written in a PyTorch-like style.
32
32
- Supports custom backbone models for self-supervised pre-training.
33
33
- Support for distributed training using PyTorch Lightning.
34
34
@@ -39,25 +39,24 @@ and PyTorch Lightning distributed examples for all models to kickstart your proj
39
39
40
40
**Models**:
41
41
42
-
- AIM, 2024 [paper](https://arxiv.org/abs/2401.08541)[docs](https://docs.lightly.ai/self-supervised-learning/examples/aim.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/aim.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/aim.ipynb)
43
-
- Barlow Twins, 2021 [paper](https://arxiv.org/abs/2103.03230)[docs](https://docs.lightly.ai/self-supervised-learning/examples/barlowtwins.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/barlowtwins.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/barlowtwins.ipynb)
44
-
- BYOL, 2020 [paper](https://arxiv.org/abs/2006.07733)[docs](https://docs.lightly.ai/self-supervised-learning/examples/byol.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/byol.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/byol.ipynb)
45
-
- DCL & DCLW, 2021 [paper](https://arxiv.org/abs/2110.06848)[docs](https://docs.lightly.ai/self-supervised-learning/examples/dcl.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/dcl.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/dcl.ipynb)
46
-
- DenseCL, 2021 [paper](https://arxiv.org/abs/2011.09157)[docs](https://docs.lightly.ai/self-supervised-learning/examples/densecl.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/densecl.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/densecl.ipynb)
47
-
- DINO, 2021 [paper](https://arxiv.org/abs/2104.14294)[docs](https://docs.lightly.ai/self-supervised-learning/examples/dino.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/dino.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/dino.ipynb)
48
-
- MAE, 2021 [paper](https://arxiv.org/abs/2111.06377)[docs](https://docs.lightly.ai/self-supervised-learning/examples/mae.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/mae.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/mae.ipynb)
49
-
- MSN, 2022 [paper](https://arxiv.org/abs/2204.07141)[docs](https://docs.lightly.ai/self-supervised-learning/examples/msn.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/msn.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/msn.ipynb)
50
-
- MoCo, 2019 [paper](https://arxiv.org/abs/1911.05722)[docs](https://docs.lightly.ai/self-supervised-learning/examples/moco.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/moco.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/moco.ipynb)
51
-
- NNCLR, 2021 [paper](https://arxiv.org/abs/2104.14548)[docs](https://docs.lightly.ai/self-supervised-learning/examples/nnclr.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/nnclr.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/nnclr.ipynb)
52
-
- PMSN, 2022 [paper](https://arxiv.org/abs/2210.07277)[docs](https://docs.lightly.ai/self-supervised-learning/examples/pmsn.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/pmsn.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/pmsn.ipynb)
53
-
- SimCLR, 2020 [paper](https://arxiv.org/abs/2002.05709)[docs](https://docs.lightly.ai/self-supervised-learning/examples/simclr.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/simclr.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/simclr.ipynb)
54
-
- SimMIM, 2021 [paper](https://arxiv.org/abs/2111.09886)[docs](https://docs.lightly.ai/self-supervised-learning/examples/simmim.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/simmim.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/simmim.ipynb)
55
-
- SimSiam, 2021 [paper](https://arxiv.org/abs/2011.10566)[docs](https://docs.lightly.ai/self-supervised-learning/examples/simsiam.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/simsiam.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/simsiam.ipynb)
56
-
- SMoG, 2022 [paper](https://arxiv.org/abs/2207.06167)[docs](https://docs.lightly.ai/self-supervised-learning/examples/smog.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/smog.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/smog.ipynb)
57
-
- SwaV, 2020 [paper](https://arxiv.org/abs/2006.09882)[docs](https://docs.lightly.ai/self-supervised-learning/examples/swav.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/swav.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/swav.ipynb)
58
-
- TiCo, 2022 [paper](https://arxiv.org/abs/2206.10698)[docs](https://docs.lightly.ai/self-supervised-learning/examples/tico.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/tico.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/tico.ipynb)
59
-
- VICReg, 2022 [paper](https://arxiv.org/abs/2105.04906)[docs](https://docs.lightly.ai/self-supervised-learning/examples/vicreg.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/vicreg.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/vicreg.ipynb)
60
-
- VICRegL, 2022 [paper](https://arxiv.org/abs/2210.01571)[docs](https://docs.lightly.ai/self-supervised-learning/examples/vicregl.html)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/vicregl.ipynb)[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/vicregl.ipynb)
42
+
| Model | Year | Paper | Docs | Colab (PyTorch) | Colab (PyTorch Lightning) |
| AIM | 2024 |[paper](https://arxiv.org/abs/2401.08541)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/aim.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/aim.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/aim.ipynb)|
45
+
| Barlow Twins | 2021 |[paper](https://arxiv.org/abs/2103.03230)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/barlowtwins.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/barlowtwins.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/barlowtwins.ipynb)|
46
+
| BYOL | 2020 |[paper](https://arxiv.org/abs/2006.07733)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/byol.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/byol.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/byol.ipynb)|
47
+
| DCL & DCLW | 2021 |[paper](https://arxiv.org/abs/2110.06848)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/dcl.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/dcl.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/dcl.ipynb)|
48
+
| DenseCL | 2021 |[paper](https://arxiv.org/abs/2011.09157)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/densecl.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/densecl.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/densecl.ipynb)|
49
+
| DINO | 2021 |[paper](https://arxiv.org/abs/2104.14294)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/dino.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/dino.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/dino.ipynb)|
50
+
| MAE | 2021 |[paper](https://arxiv.org/abs/2111.06377)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/mae.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/mae.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/mae.ipynb)|
51
+
| MSN | 2022 |[paper](https://arxiv.org/abs/2204.07141)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/msn.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/msn.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/msn.ipynb)|
52
+
| MoCo | 2019 |[paper](https://arxiv.org/abs/1911.05722)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/moco.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/moco.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/moco.ipynb)|
53
+
| NNCLR | 2021 |[paper](https://arxiv.org/abs/2104.14548)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/nnclr.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/nnclr.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/nnclr.ipynb)|
54
+
| PMSN | 2022 |[paper](https://arxiv.org/abs/2210.07277)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/pmsn.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/pmsn.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/pmsn.ipynb)|
55
+
| SimCLR | 2020 |[paper](https://arxiv.org/abs/2002.05709)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/simclr.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/simclr.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/simclr.ipynb)|
56
+
| SimMIM | 2022 |[paper](https://arxiv.org/abs/2111.09886)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/simmim.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/simmim.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/simmim.ipynb)|
57
+
| SimSiam | 2021 |[paper](https://arxiv.org/abs/2011.10566)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/simsiam.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/simsiam.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/simsiam.ipynb)|
58
+
| SwaV | 2020 |[paper](https://arxiv.org/abs/2006.09882)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/swav.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/swav.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/swav.ipynb)|
59
+
| VICReg | 2021 |[paper](https://arxiv.org/abs/2105.04906)|[docs](https://docs.lightly.ai/self-supervised-learning/examples/vicreg.html)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch/vicreg.ipynb)|[](https://colab.research.google.com/github/lightly-ai/lightly/blob/master/examples/notebooks/pytorch_lightning/vicreg.ipynb)|
0 commit comments