Training and Finetuning Reranker Models with Sentence Transformers v4 (#2768)

* Add 'train-reranker' blogpost

* Add mxbai-rerank-{base,large}-v2

* Apply most suggestions from Daniel

Co-authored-by: Daniel van Strien <[email protected]>

* 13 base models instead of 11

* Avoid mermaid diagram, just use png instead

* Add info about reranker-ModernBERT-large-gooaq-bce

* Add script for reproducing evaluation results

* reach stronger performance than -> outperform

* </detais> -> </details>, fix typo that ate half of my blogpost

* Apply suggestions from Pedro

Co-authored-by: Pedro Cuenca <[email protected]>

* Link to docs some more

* Pull forward the release day by 1 day to today

* Use CrossEncoderCorrelationEvaluator; prior was incorrect

* Simplify imports

---------

Co-authored-by: Daniel van Strien <[email protected]>
Co-authored-by: Pedro Cuenca <[email protected]>

Author: 3 people

_blog.yml

@@ -5750,3 +5750,13 @@
     - open-source
     - guide
 
+- local: train-reranker
+  title: "Training and Finetuning Reranker Models with Sentence Transformers v4"
+  author: tomaarsen
+  thumbnail: /blog/assets/train-sentence-transformers/st-hf-thumbnail.png
+  date: March 26, 2024
+  tags:
+    - nlp
+    - guide
+    - community
+    - open-source