Warm start friendly leaderboard

  • A few submissions made extensive use of parameter names for “warm starting”.
  • For scientific purposes, we re-ran all submissions with full visibility into parameter names.
  • The alternate leaderboard is considered unofficial.
Leaderboard
TeamScorePrizePaperGitHub
AutoML.org & IOHprofiler, featuring the switching squirrel94.845$3,000linkrepo
DeepWisdom93.380
Huawei Noah's Ark Lab93.241linkrepo
dangnguyen93.082repo
NVIDIA RAPIDS.AI92.537linkrepo
JetBrains Research92.509linkrepo
Duxiaoman DI92.242linkrepo
Optuna Developers (Preferred Networks & CyberAgent)92.142linkrepo
Tiny, Shiny & Don92.108
KAIST OSI91.272link
jumpshot91.115
Ambitious Audemer90.999
Innovatrics90.757linkrepo
Jzkay90.525
Oxford BXL90.403
IBM AI RBFOpt90.370
Better call Bayes90.104linkrepo
Able Anteater90.036
Jim Liu89.972
IBM Research-China89.834
Honest Hyena89.206
a2i2team89.088
Optimizer from Wyoming89.017
Rousing Retriever88.968
ABO88.817
Fabrice Normandin88.753
Restful Rottweiler88.738
DFOTR88.558
Landvermesser88.431
AlexLekov88.413
Saulius Tautvaisas88.372
Quantum Leapers88.162
My score is bigger than yours88.161
AMIRAKU88.115
SequeL88.065
u1234x123487.974
afozk87.917
Bend it like Bayes87.781
No Name @@87.506
BBOPT Gerad86.909
Random Walk86.390
pancakes revenge85.731
Remarkable Reindeer85.612
Able Audemer85.505
HyperWolves85.310
UCBO82.714
FUEGO ALPHA82.607
A.S82.559
nonlinear90182.036
BOpt79.958
Hai Labs79.491
Jolly Jaguar76.518
Optimistic Ocelot76.337
Example Submissions76.114
Machine Learners75.836
Lucid Lynx75.834
A Squared75.781
Philaes Fogg75.670
John Doe69.942
Friendly Frigatebird66.827
TheRealRoman44.794