|
--- |
|
license: apache-2.0 |
|
pipeline_tag: text-ranking |
|
library_name: lightning-ir |
|
base_model: |
|
- google/electra-base-discriminator |
|
tags: |
|
- cross-encoder |
|
--- |
|
|
|
# Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders |
|
|
|
This model is presented in the paper [Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders](https://huggingface.co/papers/2404.06912). It's a cross-encoder architecture designed for efficient and permutation-invariant passage re-ranking. |
|
|
|
Code: https://github.com/webis-de/set-encoder |
|
|
|
We provide the following pre-trained models for general-purpose re-ranking. |
|
|
|
To reproduce the results, run the following command using the [Lightning IR](https://github.com/webis-de/lightning-ir) library and the configuration files from the repository repository linked above: |
|
|
|
```bash |
|
lightning-ir re_rank --config ./configs/re-rank.yaml --model.model_name_or_path <MODEL_NAME> |
|
``` |
|
|
|
(nDCG@10 on TREC DL 19 and TREC DL 20) |
|
|
|
| Model Name | TREC DL 19 (BM25) | TREC DL 20 (BM25) | TREC DL 19 (ColBERTv2) | TREC DL 20 (ColBERTv2) | |
|
| ---------------------------------------------------------------------------------------- | ----------------- | ----------------- | ---------------------- | ---------------------- | |
|
| [webis/set-encoder-base](https://huggingface.co/webis/set-encoder-base) | 0.746 | 0.704 | 0.781 | 0.768 | |
|
| [webis/set-encoder-large](https://huggingface.co/webis/set-encoder-large) | 0.750 | 0.722 | 0.789 | 0.791 | |
|
|
|
|
|
## Citation |
|
|
|
If you use this code or the models in your research, please cite our paper: |
|
|
|
```bibtex |
|
@InProceedings{schlatt:2025, |
|
address = {Berlin Heidelberg New York}, |
|
author = {Ferdinand Schlatt and Maik Fr{\"o}be and Harrisen Scells and Shengyao Zhuang and Bevan Koopman and Guido Zuccon and Benno Stein and Martin Potthast and Matthias Hagen}, |
|
booktitle = {Advances in Information Retrieval. 47th European Conference on IR Research (ECIR 2025)}, |
|
doi = {10.1007/978-3-031-88711-6_1}, |
|
month = apr, |
|
publisher = {Springer}, |
|
series = {Lecture Notes in Computer Science}, |
|
site = {Lucca, Italy}, |
|
title = {{Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders}}, |
|
year = 2025 |
|
} |
