Update README.md

README.md

@@ -4,7 +4,25 @@ emoji: 🚀
 colorFrom: pink
 colorTo: blue
 sdk: static
-pinned: false
+pinned: true
+license: openrail
 ---
 
-Edit this `README.md` markdown file to author your organization card.
+The NDEM community provides pretrained models along with their checkpoint with the purpose of:
+   
+   - Studying the learning dynamics of the models
+   - Studying how well these learning dynamics match brain learning dynamics
+
+Models are pretrained on the Jean-Zay public supercluster:
+This work was granted access to the HPC resources of IDRIS under the allocations
+2023-AD011014524 and 2022-AD011013176R1 made by GENCI (P.Orhan).
+
+Models currently available are:
+
+  - Wav2vec2 base model () pretrained (no fine-tuning) on Librispeech (English speech), FMA (music), subset of audioset, or all of them together. It also includes a model pretrained on VoxPopuli french dataset.
+  - Wav2vec2 tiny model, where we used only 3 transformer layers. Models' performances are surprisingly high.
+
+Scientific papers using the models provided in this repository:
+Orhan, P., Boubenec, Y., & King, J.-R. (2024). Algebraic structures emerge from the self-supervised learning of natural sounds. https://doi.org/10.1101/2024.03.13.584776
+
+Models are pretrained using HuggingFace's trainer.