Differences

This shows you the differences between two versions of the page.

start [2018/10/09 15:52]
brockho
start [2019/03/06 15:06] (current)
brockho
Line 1: Line 1:
 [[ Higlighted results (all functions)|{{ http://coco.lri.fr/COCOdoc/_images/examplefigure_all_small.png?400| Results from BBOB-2009: all functions}}]] [[ Higlighted results (all functions)|{{ http://coco.lri.fr/COCOdoc/_images/examplefigure_all_small.png?400| Results from BBOB-2009: all functions}}]]
-COCO (COmparing Continuous Optimisers) is a platform for systematic and sound comparisons of real-parameter global optimisers. COCO provides benchmark function testbeds, experimentation templates which are easy to parallelize, and tools for processing and visualizing data generated by one or several optimizers. The COCO platform has been used for the Black-Box-Optimization-Benchmarking (BBOB) workshops that took place during the GECCO conference in 2009, 2010, 2012, 2013, and in 2015-2018. It was also used at the IEEE Congress on Evolutionary Computation (CEC'2015) in Sendai, Japan.+COCO (COmparing Continuous Optimisers) is a platform for systematic and sound comparisons of real-parameter global optimisers. COCO provides benchmark function testbeds, experimentation templates which are easy to parallelize, and tools for processing and visualizing data generated by one or several optimizers. The COCO platform has been used for the Black-Box-Optimization-Benchmarking (BBOB) workshops that took place during the GECCO conference in 2009, 2010, 2012, 2013, and in 2015-2018 (and that will take place again in 2019). It was also used at the IEEE Congress on Evolutionary Computation (CEC'2015) in Sendai, Japan.
  
 The COCO experiment source code has been rewritten in the years 2014-2015 and the current production code is available on our [[https://github.com/numbbo/coco|COCO github page]]. The old code is still available at the [[downloads]] page and shall be used for experiments on the noisy test suite until this test suite will be available in the new code as well. The COCO experiment source code has been rewritten in the years 2014-2015 and the current production code is available on our [[https://github.com/numbbo/coco|COCO github page]]. The old code is still available at the [[downloads]] page and shall be used for experiments on the noisy test suite until this test suite will be available in the new code as well.
  
 +  * [[http://numbbo.github.io/workshops/BBOB-2019/index.html|Black-Box Optimization Benchmarking (BBOB) 2019]]
   * [[http://numbbo.github.io/workshops/BBOB-2018/index.html|Black-Box Optimization Benchmarking (BBOB) 2018]]   * [[http://numbbo.github.io/workshops/BBOB-2018/index.html|Black-Box Optimization Benchmarking (BBOB) 2018]]
   * [[http://numbbo.github.io/workshops/BBOB-2017/index.html|Black-Box Optimization Benchmarking (BBOB) 2017]]   * [[http://numbbo.github.io/workshops/BBOB-2017/index.html|Black-Box Optimization Benchmarking (BBOB) 2017]]
Line 36: Line 37:
  
 ==== Current BBOB Functions ==== ==== Current BBOB Functions ====
 +
 **The current 24 noiseless test functions are** **The current 24 noiseless test functions are**
  
 ^ 1 Separable Functions          ^^ ^ 1 Separable Functions          ^^
-| f1    | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=5|Sphere Function]] | +| f1    | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=5|Sphere Function]] | 
-| f2    | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=9|Ellipsoidal Function]] | +| f2    | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=10|Ellipsoidal Function]] | 
-| f3    | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=13|Rastrigin Function]] | +| f3    | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=15|Rastrigin Function]] | 
-| f4    | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=17|Büche-Rastrigin Function]] | +| f4    | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=20|Büche-Rastrigin Function]] | 
-| f5    | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=21|Linear Slope]] |+| f5    | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=25|Linear Slope]] |
 ^ 2 Functions with low or moderate conditioning ^^ ^ 2 Functions with low or moderate conditioning ^^
-| f6    | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=25|Attractive Sector Function]] | +| f6    | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=30|Attractive Sector Function]] | 
-| f7    | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=29|Step Ellipsoidal Function]] | +| f7    | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=35|Step Ellipsoidal Function]] | 
-| f8    | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=33|Rosenbrock Function, original]] | +| f8    | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=40|Rosenbrock Function, original]] | 
-| f9    | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=37|Rosenbrock Function, rotated]] |+| f9    | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=45|Rosenbrock Function, rotated]] |
 ^ 3 Functions with high conditioning and unimodal ^^ ^ 3 Functions with high conditioning and unimodal ^^
-| f10   | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=41|Ellipsoidal Function]] | +| f10   | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=50|Ellipsoidal Function]] | 
-| f11   | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=45|Discus Function]] | +| f11   | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=55|Discus Function]] | 
-| f12   | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=49|Bent Cigar Function]] | +| f12   | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=60|Bent Cigar Function]] | 
-| f13   | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=53|Sharp Ridge Function]] | +| f13   | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=65|Sharp Ridge Function]] | 
-| f14   | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=57|Different Powers Function]] |+| f14   | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=70|Different Powers Function]] |
 ^ 4 Multi-modal functions with adequate global structure ^^ ^ 4 Multi-modal functions with adequate global structure ^^
-| f15   | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=61|Rastrigin Function]] | +| f15   | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=75|Rastrigin Function]] | 
-| f16   | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=65|Weierstrass Function]] | +| f16   | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=80|Weierstrass Function]] | 
-| f17   | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=69|Schaffers F7 Function]] | +| f17   | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=85|Schaffers F7 Function]] | 
-| f18   | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=73|Schaffers F7 Functions, moderately ill-conditioned]] | +| f18   | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=90|Schaffers F7 Functions, moderately ill-conditioned]] | 
-| f19   | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=77|Composite Griewank-Rosenbrock Function F8F2]] |+| f19   | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=95|Composite Griewank-Rosenbrock Function F8F2]] |
 ^ 5 Multi-modal functions with weak global structure ^^ ^ 5 Multi-modal functions with weak global structure ^^
-| f20   | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=81|Schwefel Function]] | +| f20   | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=100|Schwefel Function]] | 
-| f21   | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=85|Gallagher's Gaussian 101-me Peaks Function]] | +| f21   | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=105|Gallagher's Gaussian 101-me Peaks Function]] | 
-| f22   | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=89|Gallagher's Gaussian 21-hi Peaks Function]] | +| f22   | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=110|Gallagher's Gaussian 21-hi Peaks Function]] | 
-| f23   | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=93|Katsuura Function]] | +| f23   | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=115|Katsuura Function]] | 
-| f24   | [[http://coco.lri.fr/downloads/download15.01/bbobdocfunctions.pdf#page=97|Lunacek bi-Rastrigin Function]] |+| f24   | [[http://coco.gforge.inria.fr/downloads/download16.00/bbobdocfunctions.pdf#page=120|Lunacek bi-Rastrigin Function]] |
  
                
Line 72: Line 74:
 Only f1 and f5 are purely quadratic or linear respectively.  Only f1 and f5 are purely quadratic or linear respectively. 
  
-See also N. Hansen et al (2010): [[http://www.lri.fr/~hansen/ws1p34.pdf | Comparing Results of 31 Algorithms from the Black-Box Optimization Benchmarking BBOB-2009.]] Workshop Proceedings of the GECCO Genetic and Evolutionary Computation Conference 2010, ACM. +See also N. Hansen et al (2010): [[http://www.cmap.polytechnique.fr/~nikolaus.hansen/ws1p34.pdf | Comparing Results of 31 Algorithms from the Black-Box Optimization Benchmarking BBOB-2009.]] Workshop Proceedings of the GECCO Genetic and Evolutionary Computation Conference 2010, ACM. 
 ((This work was partially funded by FUI of System@tic Paris-Region ICT cluster through contract DGT 117 407 [[ http://www.systematic-paris-region.org/fr/projets/csdl | Complex Systems Design Lab (CSDL)]], and by the ANR-2010-COSI-002 grant (SIMINOLE) of the French National Research Agency.)) ((This work was partially funded by FUI of System@tic Paris-Region ICT cluster through contract DGT 117 407 [[ http://www.systematic-paris-region.org/fr/projets/csdl | Complex Systems Design Lab (CSDL)]], and by the ANR-2010-COSI-002 grant (SIMINOLE) of the French National Research Agency.))
  
Line 80: Line 82:
  
 ^ 1 Functions with moderate noise          ^^ ^ 1 Functions with moderate noise          ^^
-| 1.1 | f101 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=7|Sphere with moderate Gaussian noise]] | +| 1.1 | f101 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=7|Sphere with moderate Gaussian noise]] | 
-|     | f102 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=11|Sphere with moderate uniform noise]] | +|     | f102 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=12|Sphere with moderate uniform noise]] | 
-|     | f103 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=15|Sphere with moderate seldom Cauchy noise]] | +|     | f103 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=17|Sphere with moderate seldom Cauchy noise]] | 
-| 1.2 | f104 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=19|Rosenbrock with moderate Gaussian noise]] | +| 1.2 | f104 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=22|Rosenbrock with moderate Gaussian noise]] | 
-|     | f105 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=24|Rosenbrock with moderate uniform noise]] | +|     | f105 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=28|Rosenbrock with moderate uniform noise]] | 
-|     | f106 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=28|Rosenbrock with moderate seldom Cauchy noise]] |+|     | f106 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=33|Rosenbrock with moderate seldom Cauchy noise]] |
 ^ 2 Functions with severe noise           ^^ ^ 2 Functions with severe noise           ^^
-| 2.1 | f107 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=32|Sphere with Gaussian noise]] | +| 2.1 | f107 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=38|Sphere with Gaussian noise]] | 
-|     | f108 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=36|Sphere with uniform noise]] | +|     | f108 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=43|Sphere with uniform noise]] | 
-|     | f109 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=40|Sphere with seldom Cauchy noise]] | +|     | f109 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=48|Sphere with seldom Cauchy noise]] | 
-| 2.2 | f110 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=44|Rosenbrock with Gaussian noise]] | +| 2.2 | f110 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=53|Rosenbrock with Gaussian noise]] | 
-|     | f111 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=48|Rosenbrock with uniform noise]] | +|     | f111 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=58|Rosenbrock with uniform noise]] | 
-|     | f112 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=52|Rosenbrock with seldom Cauchy noise]] | +|     | f112 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=63|Rosenbrock with seldom Cauchy noise]] | 
-| 2.3 | f113 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=56|Step ellipsoid with Gaussian noise]] | +| 2.3 | f113 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=68|Step ellipsoid with Gaussian noise]] | 
-|     | f114 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=60|Step ellipsoid with uniform noise]] | +|     | f114 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=73|Step ellipsoid with uniform noise]] | 
-|     | f115 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=64|Step ellipsoid with seldom Cauchy noise]] | +|     | f115 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=78|Step ellipsoid with seldom Cauchy noise]] | 
-| 2.4 | f116 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=68|Ellipsoid with Gaussian noise]] | +| 2.4 | f116 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=83|Ellipsoid with Gaussian noise]] | 
-|     | f117 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=72|Ellipsoid with uniform noise]] | +|     | f117 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=88|Ellipsoid with uniform noise]] | 
-|     | f118 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=76|Ellipsoid with seldom Cauchy noise]] | +|     | f118 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=93|Ellipsoid with seldom Cauchy noise]] | 
-| 2.5 | f119 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=80|Different Powers with Gaussian noise]] | +| 2.5 | f119 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=98|Different Powers with Gaussian noise]] | 
-|     | f120 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=84|Different Powers with uniform noise]] | +|     | f120 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=102|Different Powers with uniform noise]] | 
-|     | f121 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=88|Different Powers with seldom Cauchy noise]] |+|     | f121 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=106|Different Powers with seldom Cauchy noise]] |
 ^ 3 Highly multi-modal functions with severe noise           ^^ ^ 3 Highly multi-modal functions with severe noise           ^^
-| 3.1 | f122 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=92|Schaffer's F7 with Gaussian noise]] | +| 3.1 | f122 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=110|Schaffer's F7 with Gaussian noise]] | 
-|     | f123 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=96|Schaffer's F7 with uniform noise]] | +|     | f123 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=115|Schaffer's F7 with uniform noise]] | 
-|     | f124 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=100|Schaffer's F7 with seldom Cauchy noise]] | +|     | f124 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=120|Schaffer's F7 with seldom Cauchy noise]] | 
-| 3.2 | f125 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=104|Composite Griewank-Rosenbrock with Gaussian noise]] | +| 3.2 | f125 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=125|Composite Griewank-Rosenbrock with Gaussian noise]] | 
-|     | f126 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=108|Composite Griewank-Rosenbrock with uniform noise]] | +|     | f126 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=129|Composite Griewank-Rosenbrock with uniform noise]] | 
-|     | f127 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=112|Composite Griewank-Rosenbrock with seldom Cauchy noise]] | +|     | f127 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=133|Composite Griewank-Rosenbrock with seldom Cauchy noise]] | 
-| 3.3 | f128 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=116|Gallagher's Gaussian Peaks 101-me with Gaussian noise]] | +| 3.3 | f128 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=137|Gallagher's Gaussian Peaks 101-me with Gaussian noise]] | 
-|     | f129 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=121|Gallagher's Gaussian Peaks 101-me with uniform noise]] | +|     | f129 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=143|Gallagher's Gaussian Peaks 101-me with uniform noise]] | 
-|     | f130 [[http://coco.lri.fr/downloads/download15.01/bbobdocnoisyfunctions.pdf#page=125|Gallagher's Gaussian Peaks 101-me with seldom Cauchy noise]] |+|     | f130 [[http://coco.lri.fr/downloads/download15.03/bbobdocnoisyfunctions.pdf#page=148|Gallagher's Gaussian Peaks 101-me with seldom Cauchy noise]] |
  
  
  
-((Work on Coco has been funded to a great extend via the ANR project [[http://numbbo.gforge.inria.fr|NumBBO]].))+((Work on Coco has been funded to a great extend via the ANR project [[http://numbbo.gforge.inria.fr|NumBBO]] and in the context of the PGMO project [[http://aesop.gforge.inria.fr|AESOP]]. We also acknowledge support via Inria's ADT funding.))
start.1539093137.txt.gz · Last modified: 2018/10/09 15:52 by brockho
CC Attribution-Noncommercial-Share Alike 3.0 Unported
Valid CSS Driven by DokuWiki Recent changes RSS feed Valid XHTML 1.0