The following tables display results relative to the best result of 2009. They can be therefore more easily compared to the result tables from BBOB-2009.

• Comparison tables per function: noiseless testbed dimensions 2-40: pdf
• Comparison tables per function: noiseless testbed dimensions 2-40 (expensive setting): pdf

Run-length distributions for single functions and all functions in 20-D

• Expensive setting Gallery
• Standard setting Gallery

The following tables display results relative to the best result of 2009. They can be therefore more easily compared to the result tables from BBOB-2009.

Standard Setting

• Comparison tables per function: noiseless testbed 2-D: pdf
• Comparison tables per function: noiseless testbed 3-D: pdf
• Comparison tables per function: noiseless testbed 5-D: pdf
• Comparison tables per function: noiseless testbed 10-D: pdf
• Comparison tables per function: noiseless testbed 20-D: pdf
• Comparison tables per function: noiseless testbed 40-D: pdf
• there has been no submission for the noisy testbed in 2013

Expensive Setting

• Comparison tables per function: noiseless testbed 2-D (expensive setting): pdf
• Comparison tables per function: noiseless testbed 3-D (expensive setting): pdf
• Comparison tables per function: noiseless testbed 5-D (expensive setting): pdf
• Comparison tables per function: noiseless testbed 10-D (expensive setting): pdf
• Comparison tables per function: noiseless testbed 20-D (expensive setting): pdf
• Comparison tables per function: noiseless testbed 40-D (expensive setting): pdf
• there has been no submission for the noisy testbed in 2013

• overview page listing all 2013 algorithm data sets
• root data folder

• Ilya Loshchilov, Marc Schoenauer, and Michèle Sebag: BI-population CMA-ES Algorithms with Surrogate Models and Line Searches
• Thanh-Do Tran, Dimo Brockhoff, and Bilel Derbel: Multiobjectivization with NSGA-II on the Noiseless BBOB Testbed

• Costas Voglis: Adapt-MEMPSODE: A Memetic Algorithm with Adaptive Selection of Local Searches
• László Pál: Benchmarking a Hybrid Multi Level Single Linkage Algorithm on the BBOB Noiseless Testbed
• László Pál: Comparison of Multistart Global Optimization Algorithms on the BBOB Noiseless Testbed
• Tianjun Liao and Thomas Stützle: Bounding the population size of IPOP-CMA-ES on the Noiseless BBOB Testbed
• Tianjun Liao and Thomas Stützle: Testing the impact of parameter tuning on a variant of IPOP-CMA-ES with a bounded maximum population size on the Noiseless BBOB Testbed
• Ilya Loshchilov, Marc Schoenauer, and Michèle Sebag: BI-population CMA-ES Algorithms with Surrogate Models and Line Searches
• Tianjun Liao and Thomas Stützle: Expensive optimization scenario: IPOP-CMA-ES with a population bound mechanism for Noiseless Function Testbed
• B.A. Sawyerr, A.O. Adewumi, and M.M. Ali: Benchmarking Projection-Based Real Coded Genetic Algorithms on BBOB-2013 Noiseless Function Testbed
• Neal Holtschulte and Melanie Moses: Benchmarking Cellular Genetic Algorithms on the BBOB Noiseless Testbed
• Frank Hutter, Holger Hoos, and Kevin Leyton-Brown: An evaluation of sequential model-based optimization for expensive blackbox functions
• Thanh-Do Tran, Dimo Brockhoff, and Bilel Derbel: Multiobjectivization with NSGA-II on the Noiseless BBOB Testbed
• Anne Auger, Dimo Brockhoff, and Nikolaus Hansen: Benchmarking the Local Metamodel CMA-ES on the Noiseless BBOB’2013 Test Bed