This is the BBOB 2012 results page and here are the results from the workshop held at GECCO in July 2012.

Overview of results on noise-free testbed

The figures below show selected results from BBOB 2012. The empirical runtime distribution is shown for all (bottom right) and five subgroups of the BBOB functions. Click on the respective figures for more details.

 Results from BBOB-2012: separable functions   Results from BBOB-2012: moderate functions  Results from BBOB-2012: ill-conditioned functions

 Results from BBOB-2012: multimodal structured functions  Results from BBOB-2012: multimodal weakly structured functions  Results from BBOB-2012: all noise-free functions

Overview of results on noisy testbed

The figures below show selected results from BBOB 2012. The empirical runtime distribution is shown for all (bottom right) and three subgroups of the noisy BBOB functions. Click on the respective figures for more details.

 Results from BBOB-2012: functions with moderate noise  Results from BBOB-2012: multimodal functions with severe noise

 Results from BBOB-2012: functions with severe noise  Results from BBOB-2012: all noisy functions

Results for all algorithms

The following tables display (the same) results relative to the best result of 2009. They can be therefore more easily compared to the result tables from BBOB-2009.

  • Comparison tables per function: noiseless testbed dimensions 2-40: pdf
  • Comparison tables per function: noisy testbed dimensions 2-40: pdf
Single Function Tables

The following tables display (the same) results relative to the best result of 2009. They can be therefore more easily compared to the result tables from BBOB-2009.

  • Comparison tables per function: noiseless testbed 2-D: pdf
  • Comparison Tables per function: noiseless testbed 3-D: pdf
  • Comparison Tables per function: noiseless testbed 5-D: pdf
  • Comparison Tables per function: noiseless testbed 10-D: pdf
  • Comparison Tables per function: noiseless testbed 20-D: pdf
  • Comparison Tables per function: noiseless testbed 40-D: pdf
  • Comparison tables per function: noisy testbed 2-D: pdf
  • Comparison Tables per function: noisy testbed 3-D: pdf
  • Comparison Tables per function: noisy testbed 5-D: pdf
  • Comparison Tables per function: noisy testbed 10-D: pdf
  • Comparison Tables per function: noisy testbed 20-D: pdf
  • Comparison Tables per function: noisy testbed 40-D: pdf
Data
Resources: Source code
  • Ilya Loshchilov, Marc Schoenauer, and Michèle Sebag: Black-Box Optimization Benchmarking of IPOP-SaACM-ES and Bipop-SaACM-ES on the BBOB-2012 Noiseless Testbed BIPOPsaACM IPOPsaACM
  • Ilya Loshchilov, Marc Schoenauer, and Michèle Sebag: Black-box Optimization Benchmarking of NIPOP-aCMA-ES and NBIPOP-aCMA-ES on the BBOB-2012 Noiseless Testbed BIPOPaCMA NBIPOP and NBIPOPaCMA
  • Ilya Loshchilov, Marc Schoenauer, and Michèle Sebag: Black-box Optimization Benchmarking of IPOP-saACM-ES on the BBOB-2012 Noisy Testbed IPOPsaACMnoisy
  • Petr Pošík and Václav Klemš: Benchmarking the Differential Evolution with Adaptive Encoding on Noiseless Functions (DEAE, JADE, DE, CMAES)
  • Petr Pošík and Václav Klemš: JADE, an Adaptive Differential Evolution Algorithm, Benchmarked on the BBOB Noiseless Testbed (JADEctpb, JADEb, DEctpb, DEb)
Resources: Published papers
bbob-2012-results.txt · Last modified: 2017/05/01 16:22 by brockho
CC Attribution-Noncommercial-Share Alike 3.0 Unported
Valid CSS Driven by DokuWiki Recent changes RSS feed Valid XHTML 1.0