vibe.rerank_providers.local

Local rerank provider using fastembed.

Runs reranking models locally using ONNX runtime. Supports GPU acceleration via OpenVINO when available.

LocalRerankProvider

Local rerank provider using fastembed (ONNX-based).

Uses jinaai/jina-reranker-v2-base-multilingual by default for broad language support including Swedish.

Configuration

model: Model preset or fastembed model ID Presets: jina-multilingual (default), ms-marco-minilm-6, ms-marco-minilm-12, jina-reranker-tiny, jina-reranker-turbo, bge-reranker-base

Example

Use default (multilingual)

provider = LocalRerankProvider()

Use fast English-only model

provider = LocalRerankProvider({"model": "ms-marco-minilm-6"})

rerank 

rerank(query: str, documents: list[str], top_n: int | None = None) -> list[RerankResult]

Rerank documents by relevance to query.

Parameters:
  • query (str) –

    Query to rank documents against.

  • documents (list[str]) –

    List of documents to rerank.

  • top_n (int | None, default: None ) –

    Number of top results to return.
Returns:
  • list[RerankResult] –

    List of RerankResult sorted by relevance_score descending.