Add new SentenceTransformer model

README.md

@@ -12,51 +12,50 @@ tags:
 - retrieval
 - reranking
 - generated_from_trainer
-- dataset_size:9233417
+- dataset_size:3587
 - loss:ArcFaceInBatchLoss
 base_model: answerdotai/ModernBERT-large
 widget:
-- source_sentence: Hayley Vaughan portrayed Ripa on the ABC daytime soap opera , ``
-    All My Children `` , between 1990 and 2002 .
+- source_sentence: Hunter College was originally Lehman College 's uptown campus .
   sentences:
-  - Traxxpad is a music application for Sony 's PlayStation Portable published by
-    Definitive Studios and developed by Eidos Interactive .
-  - Between 1990 and 2002 , Hayley Vaughan Ripa portrayed in the ABC soap opera ``
-    All My Children `` .
-  - Between 1990 and 2002 , Ripa Hayley portrayed Vaughan in the ABC soap opera ``
-    All My Children `` .
-- source_sentence: Olivella monilifera is a species of dwarf sea snail , small gastropod
-    mollusk in the family Olivellidae , the marine olives .
+  - Acquired programming includes the Irish soap `` Fair City `` and Finnish drama
+    `` Black Widows `` .
+  - According to the United States Census Bureau , the town has a total area of ;
+    of the area is land and 0.66 % is water .
+  - Hunter College originally was Lehman College Uptown Campus .
+- source_sentence: He hoped to defeat them and then marry Ravonna .
   sentences:
-  - Olivella monilifera is a species of the dwarf - sea snail , small gastropod mollusk
-    in the Olivellidae family , the marine olives .
-  - He was cut by the Browns after being signed by the Bills in 2013 . He was later
-    released .
-  - Olivella monilifera is a kind of sea snail , marine gastropod mollusk in the Olivellidae
-    family , the dwarf olives .
-- source_sentence: Hayashi said that Mackey `` is a sort of `` of the original model
-    for Tenchi .
+  - Stillwater Creek received its official name in 1884 when William L. Couch established
+    his `` boomer colony `` on its banks .
+  - Note that the invertible of a matrix is always an exponential matrix .
+  - He hoped to defeat them and marry Ravonna .
+- source_sentence: Born on February 2 , 1984 , Abrar Khan is a professional Pakistani
+    international Kabaddi player .
   sentences:
-  - In the summer of 2009 , Ellick shot a documentary about Malala Yousafzai .
-  - Hayashi said that Mackey is `` sort of `` the original model for Tenchi .
-  - Mackey said that Hayashi is `` sort of `` the original model for Tenchi .
-- source_sentence: Much of the film was shot on location in Los Angeles and in nearby
-    Burbank and Glendale .
+  - Born on February 2 , 1984 , Abrar Khan is a professional Pakistani international
+    Kabaddi player .
+  - Together , the paired mylohyoid muscles form a muscular floor for the oral cavity
+    of the mouth .
+  - Abrar Khan born 2 February 1984 is a Pakistani professional international Kabaddi
+    player .
+- source_sentence: Certainly , `` Lucy was nothing like flat `` in physical form ,
+    social condition , and personality .
   sentences:
-  - Much of the film was shot on location in Los Angeles and in nearby Burbank and
-    Glendale .
-  - Much of the film was shot on site in Burbank and Glendale and in the nearby Los
-    Angeles .
-  - Traxxpad is a music application for the Sony PlayStation Portable developed by
-    the Definitive Studios and published by Eidos Interactive .
-- source_sentence: According to him , the earth is the carrier of his artistic work
-    , which is only integrated into the creative process by minimal changes .
+  - The real number is called the `` imaginary part `` of the real number ; the real
+    number is called the `` complex part `` of .
+  - From the Celebes lake , the captain Bullock observed the appearance of the corona
+    , while Gustav Fritsch accompanied an expedition to Aden .
+  - Certainly `` Lucy was , in physical form , social condition and personality ,
+    nothing like Shallow `` .
+- source_sentence: The trio has performed besides Gesaffelstein , Justice , Bob Moses
+    and Lee Foss .
   sentences:
-  - National players are Bold players .
-  - According to him , earth is the carrier of his artistic work being integrated
-    into the creative process only by minimal changes .
-  - According to him , earth is the carrier of his creative work being integrated
-    into the artistic process only by minimal changes .
+  - The trio has performed besides Gesaffelstein , Justice , Bob Moses and Lee Foss
+    .
+  - The suttas generally contain educational content , while other early Buddhist
+    texts deal with monastic discipline or vinaya .
+  - The trio has performed alongside Bob Moses , Justice , Gesaffelstein and Lee Foss
+    .
 datasets:
 - redis/langcache-sentencepairs-v2
 pipeline_tag: sentence-similarity
@@ -81,28 +80,28 @@ model-index:
       type: test
     metrics:
     - type: cosine_accuracy@1
-      value: 0.44081091729646477
+      value: 0.44070346359110285
       name: Cosine Accuracy@1
     - type: cosine_precision@1
-      value: 0.44081091729646477
+      value: 0.44070346359110285
       name: Cosine Precision@1
     - type: cosine_recall@1
-      value: 0.42663486382682986
+      value: 0.42648577181064024
       name: Cosine Recall@1
     - type: cosine_ndcg@10
-      value: 0.6274011007244752
+      value: 0.627438499402098
       name: Cosine Ndcg@10
     - type: cosine_mrr@1
-      value: 0.44081091729646477
+      value: 0.44070346359110285
       name: Cosine Mrr@1
     - type: cosine_map@100
-      value: 0.5749605963252064
+      value: 0.5750186225138979
       name: Cosine Map@100
     - type: cosine_auc_precision_cache_hit_ratio
-      value: 0.27130175854619276
+      value: 0.27246772094744054
       name: Cosine Auc Precision Cache Hit Ratio
     - type: cosine_auc_similarity_distribution
-      value: 0.40770905754259995
+      value: 0.40850809564840007
       name: Cosine Auc Similarity Distribution
 ---
 
@@ -156,9 +155,9 @@ from sentence_transformers import SentenceTransformer
 model = SentenceTransformer("redis/langcache-embed-experimental")
 # Run inference
 sentences = [
-    'According to him , the earth is the carrier of his artistic work , which is only integrated into the creative process by minimal changes .',
-    'According to him , earth is the carrier of his artistic work being integrated into the creative process only by minimal changes .',
-    'According to him , earth is the carrier of his creative work being integrated into the artistic process only by minimal changes .',
+    'The trio has performed besides Gesaffelstein , Justice , Bob Moses and Lee Foss .',
+    'The trio has performed besides Gesaffelstein , Justice , Bob Moses and Lee Foss .',
+    'The trio has performed alongside Bob Moses , Justice , Gesaffelstein and Lee Foss .',
 ]
 embeddings = model.encode(sentences)
 print(embeddings.shape)
@@ -167,9 +166,9 @@ print(embeddings.shape)
 # Get the similarity scores for the embeddings
 similarities = model.similarity(embeddings, embeddings)
 print(similarities)
-# tensor([[1.0000, 0.9844, 0.9844],
-#         [0.9844, 0.9961, 0.9922],
-#         [0.9844, 0.9922, 0.9961]], dtype=torch.bfloat16)
+# tensor([[0.9961, 0.9961, 0.9883],
+#         [0.9961, 0.9961, 0.9883],
+#         [0.9883, 0.9883, 1.0000]], dtype=torch.bfloat16)
 ```
 
 <!--
@@ -207,14 +206,14 @@ You can finetune this model on your own dataset.
 
 | Metric                               | Value      |
 |:-------------------------------------|:-----------|
-| cosine_accuracy@1                    | 0.4408     |
-| cosine_precision@1                   | 0.4408     |
-| cosine_recall@1                      | 0.4266     |
+| cosine_accuracy@1                    | 0.4407     |
+| cosine_precision@1                   | 0.4407     |
+| cosine_recall@1                      | 0.4265     |
 | **cosine_ndcg@10**                   | **0.6274** |
-| cosine_mrr@1                         | 0.4408     |
+| cosine_mrr@1                         | 0.4407     |
 | cosine_map@100                       | 0.575      |
-| cosine_auc_precision_cache_hit_ratio | 0.2713     |
-| cosine_auc_similarity_distribution   | 0.4077     |
+| cosine_auc_precision_cache_hit_ratio | 0.2725     |
+| cosine_auc_similarity_distribution   | 0.4085     |
 
 <!--
 ## Bias, Risks and Limitations
@@ -235,19 +234,19 @@ You can finetune this model on your own dataset.
 #### LangCache Sentence Pairs (all)
 
 * Dataset: [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v2)
-* Size: 126,938 training samples
+* Size: 1,922 training samples
 * Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
 * Approximate statistics based on the first 1000 samples:
   |         | anchor                                                                            | positive                                                                          | negative                                                                          |
   |:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
   | type    | string                                                                            | string                                                                            | string                                                                            |
-  | details | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 48 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 26.54 tokens</li><li>max: 61 tokens</li></ul> |
+  | details | <ul><li>min: 8 tokens</li><li>mean: 27.26 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 27.24 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 9 tokens</li><li>mean: 27.09 tokens</li><li>max: 49 tokens</li></ul> |
 * Samples:
-  | anchor                                                                                                                                      | positive                                                                                                                                      | negative                                                                                                                                      |
-  |:--------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|
-  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                           | <code>how can I get financial freedom as soon as possible?</code>                                                                             |
-  | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                          | <code>The older Punts are still very much in existence today and race in the same fleets as the newer boats .</code>                          |
-  | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , , was located at Turner Valley Bar N Ranch Airport , southwest of Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code> |
+  | anchor                                                                                                                                      | positive                                                                                                                                    | negative                                                                                                                                                   |
+  |:--------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>At that time , on June 22 , 1754 , Edward Bentham married Bentham Elizabeth Bates ( d . 1790 ) from Hampshire in the nearby county of Alton .</code> |
+  | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>In 2012 , Cornell 5th and Lehigh 8th , Cornell was also 4th in 2013 and 7th in 2014 .</code>                                                         |
+  | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code>              |
 * Loss: <code>losses.ArcFaceInBatchLoss</code> with these parameters:
   ```json
   {
@@ -262,19 +261,19 @@ You can finetune this model on your own dataset.
 #### LangCache Sentence Pairs (all)
 
 * Dataset: [LangCache Sentence Pairs (all)](https://huggingface.co/datasets/redis/langcache-sentencepairs-v2)
-* Size: 126,938 evaluation samples
+* Size: 1,922 evaluation samples
 * Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
 * Approximate statistics based on the first 1000 samples:
   |         | anchor                                                                            | positive                                                                          | negative                                                                          |
   |:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
   | type    | string                                                                            | string                                                                            | string                                                                            |
-  | details | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 27.27 tokens</li><li>max: 48 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 26.54 tokens</li><li>max: 61 tokens</li></ul> |
+  | details | <ul><li>min: 8 tokens</li><li>mean: 27.26 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 27.24 tokens</li><li>max: 49 tokens</li></ul> | <ul><li>min: 9 tokens</li><li>mean: 27.09 tokens</li><li>max: 49 tokens</li></ul> |
 * Samples:
-  | anchor                                                                                                                                      | positive                                                                                                                                      | negative                                                                                                                                      |
-  |:--------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|
-  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                           | <code>how can I get financial freedom as soon as possible?</code>                                                                             |
-  | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                          | <code>The older Punts are still very much in existence today and race in the same fleets as the newer boats .</code>                          |
-  | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , , was located at Turner Valley Bar N Ranch Airport , southwest of Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code> |
+  | anchor                                                                                                                                      | positive                                                                                                                                    | negative                                                                                                                                                   |
+  |:--------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>At that time , on June 22 , 1754 , Edward Bentham married Bentham Elizabeth Bates ( d . 1790 ) from Hampshire in the nearby county of Alton .</code> |
+  | <code>The newer punts are still very much in existence today and run in the same fleets as the older boats .</code>                         | <code>The newer Punts are still very much in existence today and race in the same fleets as the older boats .</code>                        | <code>In 2012 , Cornell 5th and Lehigh 8th , Cornell was also 4th in 2013 and 7th in 2014 .</code>                                                         |
+  | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley , was at the Turner Valley Bar N Ranch Airport , southwest of the Turner Valley Bar N Ranch , Alberta , Canada .</code> | <code>Turner Valley Bar N Ranch Airport , , was located at Turner Valley Bar N Ranch , southwest of Turner Valley , Alberta , Canada .</code>              |
 * Loss: <code>losses.ArcFaceInBatchLoss</code> with these parameters:
   ```json
   {

config.json

@@ -8,7 +8,7 @@
   "classifier_activation": "gelu",
   "classifier_bias": false,
   "classifier_dropout": 0.0,
-  "classifier_pooling": "mean",
+  "classifier_pooling": "cls",
   "cls_token_id": 50281,
   "decoder_bias": true,
   "deterministic_flash_attn": false,