Skip to content

Issues: embeddings-benchmark/mteb

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

161 Open 534 Closed
161 Open 534 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

CQADupstack results are still missing for some models
#1900 opened Jan 29, 2025 by x-tabdeveloping
3
Old results cannot be loaded after being saved
#1899 opened Jan 29, 2025 by x-tabdeveloping
2
Run MSMARCO dev split on some models
#1898 opened Jan 29, 2025 by x-tabdeveloping
@Muennighoff
HindiDiscourseClassification, SentimentAnalysisHindi have only train splits
#1897 opened Jan 29, 2025 by Samoed
1
Add readme to all MTEB datasets
#1892 opened Jan 28, 2025 by KennethEnevoldsen
Model meta use_instructions change v2 Issues and PRs related to `v2` branch
#1891 opened Jan 28, 2025 by Samoed
1
[v2] Fill dataset Metadata v2 Issues and PRs related to `v2` branch
#1889 opened Jan 28, 2025 by Samoed
Missing Metadata for tasks in MTEB(eng, classic) leaderboard issues related to the leaderboard
#1886 opened Jan 28, 2025 by x-tabdeveloping
@KennethEnevoldsen
2
Add GenBench new benchmark Issues related to adding a new benchmark
#1883 opened Jan 27, 2025 by Samoed
[v2] Reupload Reranking datasets in old format v2 Issues and PRs related to `v2` branch
#1878 opened Jan 26, 2025 by Samoed
[v2] Reupload datasets with trust_remote_code v2 Issues and PRs related to `v2` branch
#1877 opened Jan 26, 2025 by Samoed
Overview: Leaderboard release leaderboard issues related to the leaderboard
#1867 opened Jan 24, 2025 by x-tabdeveloping
3 of 6 tasks
22
Only one label in one of cluster set from ArxivClusteringP2P
#1866 opened Jan 24, 2025 by Hypothesis-Z
Discrepencies in CoIR results replication question and issues related to replication
#1861 opened Jan 23, 2025 by bclavie
6
MMTEB is accepted by ICLR 2025
#1860 opened Jan 22, 2025 by gentaiscool
2
Missing models on leaderboards [WIP] leaderboard issues related to the leaderboard
#1848 opened Jan 21, 2025 by KennethEnevoldsen
2
Renaming the New Leaderboard Space leaderboard issues related to the leaderboard
#1847 opened Jan 21, 2025 by x-tabdeveloping
8
Support for MTEB-ES (Spanish Benchmark)
#1844 opened Jan 20, 2025 by elsatch
1
New leaderboard filtering cross-encoders leaderboard issues related to the leaderboard
#1841 opened Jan 20, 2025 by Muennighoff
6
Missing results on new leaderboard leaderboard issues related to the leaderboard
#1840 opened Jan 20, 2025 by Muennighoff
2
Add LOTTE new benchmark Issues related to adding a new benchmark
#1836 opened Jan 19, 2025 by Samoed
[Main & MIEB] potential issues for multi-label classification
#1835 opened Jan 19, 2025 by gowitheflow-1998
1
[v2] Remove MultilingualTask v2 Issues and PRs related to `v2` branch
#1832 opened Jan 18, 2025 by Samoed
1
Optimize the slowest test for better performance
#1831 opened Jan 17, 2025 by sam-hey
3
Remove embedding layers when calculating number of parameters enhancement New feature or request leaderboard issues related to the leaderboard
#1828 opened Jan 17, 2025 by KennethEnevoldsen
ProTip! Add no:assignee to see everything that’s not assigned.