You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We discovered with @Samoed that some models are completely missing evaluation results on MSMARCO's dev split, and they were included in the old leaderboard due to a bug #1867 . As such, if we want to have their results on the leaderboard, we will have to run them.
I have compiled a list of models that are only missing MSMARCO scores:
We discovered with @Samoed that some models are completely missing evaluation results on MSMARCO's dev split, and they were included in the old leaderboard due to a bug #1867 . As such, if we want to have their results on the leaderboard, we will have to run them.
I have compiled a list of models that are only missing MSMARCO scores:
Can we get a run on these @Muennighoff ?
The text was updated successfully, but these errors were encountered: