-
Notifications
You must be signed in to change notification settings - Fork 608
Pull requests: embeddings-benchmark/mteb
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[MVEB] Add AV-SpeakerBench video-centric QA task
#4584
opened May 2, 2026 by
yaswanth169
Contributor
Loading…
update the ict_time_and_querit_models.py and adding ict_time_and_querit_embedding implementation
#4583
opened May 2, 2026 by
hengran
Contributor
Loading…
add diving48
new dataset
Issues related to adding a new task or dataset
video
video extension
#4582
opened May 1, 2026 by
Samoed
Member
Loading…
4 of 5 tasks
add penguin vl
image
The image extension of MTEB
new model
Questions related to adding a new model to the benchmark
#4581
opened May 1, 2026 by
Samoed
Member
Loading…
6 of 7 tasks
fix: use torch.long tensor in get_frames_at to handle empty frame lists
#4570
opened Apr 30, 2026 by
AdnanElAssadi56
Contributor
Loading…
model: Add LanguageBind video and audio model wrapper
new model
Questions related to adding a new model to the benchmark
video
video extension
#4557
opened Apr 29, 2026 by
myang333
Loading…
[MVEB] Added SomethingSomething zeroshot
new dataset
Issues related to adding a new task or dataset
video
video extension
#4542
opened Apr 28, 2026 by
x-tabdeveloping
Collaborator
•
Draft
5 of 7 tasks
ci: add .venv caching step to speed up dep install
#4516
opened Apr 26, 2026 by
isaac-chung
Collaborator
•
Draft
Adding prompts to voyage-4-large 2048d model
#4464
opened Apr 20, 2026 by
fzowl
Contributor
Loading…
5 of 7 tasks
Add model: TIPSv2 (google/tipsv2-b14/l14/so400m14/g14)
image
The image extension of MTEB
new model
Questions related to adding a new model to the benchmark
#4459
opened Apr 20, 2026 by
Rakshitha-Ireddi
Contributor
Loading…
Add model: llm-semantic-router/aegis-embed
new model
Questions related to adding a new model to the benchmark
#4458
opened Apr 20, 2026 by
Rakshitha-Ireddi
Contributor
Loading…
Track mteb_version per subset and allow cross-version merging
#4452
opened Apr 20, 2026 by
Rakshitha-Ireddi
Contributor
Loading…
Make corpus_chunk_size tunable via the public evaluate() API
#4451
opened Apr 19, 2026 by
Rakshitha-Ireddi
Contributor
Loading…
model: add multilingual BM25 model using HuggingFace subword tokenizer
#4405
opened Apr 16, 2026 by
fzoll
Contributor
Loading…
feat: add num_queries and num_documents to retrieval statistics
stale
#4403
opened Apr 16, 2026 by
fzoll
Contributor
Loading…
move mteb_version to individual subsets in result files
#4401
opened Apr 16, 2026 by
fzoll
Contributor
Loading…
dataset: downsample MIRACLReranking using MIRACLRetrievalHardNegatives
stale
#4380
opened Apr 15, 2026 by
fzoll
Contributor
Loading…
5 tasks done
dataset: Add SWEbenchCodeRetrieval task for RTEB
#4365
opened Apr 9, 2026 by
fzoll
Contributor
Loading…
2 of 3 tasks
Add model: BEATs pretrained audio models
new model
Questions related to adding a new model to the benchmark
#4352
opened Apr 5, 2026 by
isaac-chung
Collaborator
•
Draft
6 tasks done
dataset: Add INatSounds
audio
Audio extension
new dataset
Issues related to adding a new task or dataset
#4346
opened Apr 3, 2026 by
isaac-chung
Collaborator
•
Draft
4 of 8 tasks
Switch to brightv1.1 in leaderboard
leaderboard
issues related to the leaderboard
#4340
opened Apr 1, 2026 by
Samoed
Member
Loading…
model: add ModernVBERT models
new model
Questions related to adding a new model to the benchmark
#4337
opened Mar 31, 2026 by
paultltc
Contributor
Loading…
5 of 6 tasks
Previous Next
ProTip!
Filter pull requests by the default branch with base:main.