Update README.md

README.md

@@ -27,4 +27,10 @@ Orhan, P., Boubenec, Y., & King, J.-R. (2024). Algebraic structures emerge from
 
 Models are pretrained using HuggingFace's trainer.
 These models pretraining are often shorter (100,000 steps compared to 400 000) than original pretraining because of resource scarcity. 
-In my experience, most emergences I studied had happened before 100 000 steps.
+In my experience, most emergences I studied had happened before 100 000 steps.
+
+Known version compatibility issues for Wav2vec2:
+ Some Wav2vec2 models are trained with a torch <=2.0.1, while other are trained with torch>2.1.1
+ This can create critical error when loading the model, at the step of loading the Wav2Vec2PositionalConvEmbedding, 
+     which uses different module for the weight_norm depending on the pretraining version. This is quite unfortunate.
+  Consequently I recommend checking for the error message of HuggingFace with from_pretrained(), and changing your torch version if the weights can't be properly loaded.