This is an old revision of the document!


The following table lists all algorithm data sets related to the noiseless bbob test suite as collected during the BBOB workshops and special sessions in the years 2009 till 2017. In order to sort the table according to some columns, please click on the corresponding table header. If available, the source codes of the algorithms can be downloaded by clicking on the link with the corresponding algorithm name in the second column.

NoAlgorithmYearAuthor(s)Data Noiselessrelated PDFs and Remarks
1ALPS2009HornbynoiselessDataPDF
2AMALGAM2009Bosman et al.noiselessDataPDFnoiseless PDFnoisy
3BAYEDA2009GallaghernoiselessDataPDFnoiseless PDFnoisy
4BFGS2009RosnoiselessDataPDFnoiseless PDFnoisy
5BIPOP-CMA-ES2009HansennoiselessDataPDFnoiseless PDFnoisy
6Cauchy-EDA2009PošíknoiselessDataPDF
7CMA-ESPLUSSEL2009Auger and HansennoiselessDataPDFnoiseless PDFnoisy
8DASA2009Korošec and ŠilcnoiselessDataPDFnoiseless PDFnoisy
9DE-PSO2009García-Nieto et al.noiselessDataPDFnoiseless PDFnoisy
10DIRECT2009PošíknoiselessDataPDF
algorithm is deterministic and thus, only run on each instance once
11EDA-PSO2009El-Abd and KamelnoiselessDataPDF
12FULLNEWUOA2009RosnoiselessDataoriginal 2009 noiseless paper
original 2009 noisy paper
2010 comparison noiseless
2010 comparison noisy
13G3PCX2009PošíknoiselessDataPDF
14GA2009NicolaunoiselessDataPDF
15GLOBAL2009Pál et al.noiselessDataBBOB-2009 paper not available online
corresponding ECJ Paper
16iAMALGAM2009Bosman et al.noiselessDataPDFnoiseless PDFnoisy
17IPOP-SEP-CMA-ES2009RosnoiselessDataPDFnoiseless PDFnoisy
18LSfminbnd2009PošíknoiselessDataPDF
19LSstep2009PošíknoiselessDataPDF
20MA-LS-CHAIN2009Molina et al.noiselessDataPDFnoiseless PDFnoisy
21MCS2009Huyer and NeumaiernoiselessDataPDFNoiseless PDFnoisy
22NELDERDOERR2009Doerr et al.noiselessDataPDF
23NELDER2009HansennoiselessDataPDF
24NEWUOA2009RosnoiselessDataoriginal 2009 noiseless paper
original 2009 noisy paper
2010 comparison with BIPOP-CMA-ES noiseless
2010 comparison noiseless
2010 comparison noisy
noisy data under #59 (2010)
25ONEFIFTH2009AugernoiselessDataPDFnoiseless PDFnoisy
26POEMS2009KubalíknoiselessDataPDF
27PSO2009El-Abd and KamelnoiselessDataPDF
28PSO_Bounds2009El-Abd and KamelnoiselessDataPDF
29RANDOMSEARCH2009Auger and RosnoiselessDataPDFnoiseless PDFnoisy
30Rosenbrock2009PošíknoiselessDataPDF
31VNS2009García-Martínez and LozanonoiselessDataPDFnoiseless PDFnoisy
321komma22010Auger et al.noiselessDatacmp1komma2mirAnd1komma2mirser doi
cmp1komma2mirAnd1komma2mirserNoisy cmp1komma2ser cmp1komma2serNoisy
331komma2mir2010Auger et al.noiselessDatacmp1komma2And1komma2mirser doi
cmp1komma2And1komma2mirserNoisy
341komma2mirser2010Auger et al.noiselessDatacmp1komma2And1komma2mir doi
cmp1komma2And1komma2mirNoisy
351komma2ser2010Auger et al.noiselessDatacmp1komma2 cmp1komma2Noisy
361komma42010Auger et al.noiselessDatacmp1komma4serNoisy doi
the other three papers are not linked to at the moment
371komma4mir2010Auger et al.noiselessDatacmp1komma4And1komma4mirser cmp1komma4And1komma4mirserNoisy
381komma4mirser2010Auger et al.noiselessDataPDFnoiseless PDFnoisy cmp1komma4And1komma4mir cmp1komma4And1komma4mirNoisy
391komma4ser2010Auger et al.noiselessDatacmp1komma4 cmp1komma4Noisy doi
401plus12010Auger et al.noiselessDatacmp1plus2mirser
411plus2mirser2010Auger et al.noiselessDatacmp1plus1
42ABC2010El-AbdnoiselessDatadoi
43AVGNEWUOA
:!: algname still NEWUOA :!:
2010RosnoiselessData mentioned in 2009 paper, data set submitted in 2009, but data presented only in 2010
cmpNEWUOAFULLNEWUOnoiseless
44CMAEGS2010Finck and BeyernoiselessDataPDFnoiseless DOInoisy
45DE-F-AUC2010Fialho et al.noiselessDatacmpPM-AdapSS-DE
46DEuniform2010Fialho et al.noiselessDatacmpPM-AdapSS-DE
47IPOP-ACTCMA-ES2010Hansen and RosnoiselessDatacmpIPOP-CMA-ESNoiseless
cmpIPOP-CMA-ESNoisy
48IPOP-CMA-ES2010Hansen and RosnoiselessDatacmpIPOP-ACTCMA-ESNoiseless
cmpIPOP-ACTCMA-ESNoisy
cmpBIPOP-CMA-ESNoiseless
cmpBIPOP-CMA-ESNoisy
49MOS2010LaTorre et al.noiselessDataPDFnoiseless PDFnoisy
50NBC-CMA2010PreussnoiselessDatadoi
51PM-AdapSS-DE2010Fialho et al.noiselessDatacmpUniformDE cmpDE-F-AUC
52RCGA2010Tran and JinnoiselessDatadoi noiseless doi noisy
53SPSA2010Finck and BeyernoiselessDataPDFnoiseless PDFnoisy
54oPOEMS2010KubalíknoiselessDatadoi cmppPOEMS
55pPOEMS2010KubalíknoiselessDatadoi cmpoPOEMS
56ACOR2012Liao et alnoiselessDataPDF
57BIPOPaCMA2012Loshchilov et al.noiselessDatacmpNIPOPaCMA-BIPOPaCMA-NBIPOPaCM-IPOPaCMA
58BIPOPsaACM2012Loshchilov et al.noiselessDatacmpIPOPsaACM
59CMA2012Brockhoff et al.noiselessDatacmpCMAaAndCMAm
60CMAa2012Brockhoff et al.noiselessDatacmpCMAmaAndIPOP-ACTCMA-ES
cmpCMAandCMAm
61CMAm2012Brockhoff et al.noiselessDatacmpCMAandCMAa
62CMAma2012Brockhoff et al.noiselessDatacmpCMAaAndIPOP-ACTCMA-ES
cmpCMAmah
63CMAmah2012Brockhoff et al.noiselessDatacmpCMAma cmpCMAmh
64CMAmh2012Brockhoff et al.noiselessDatacmpCMAmah
65CMAES2012Pošík and KlemšnoiselessDatacmpDEandDEAEandJADE
66DBRCGA2012Chuang and ChennoiselessDataPDF
67DE2012Pošík and KlemšnoiselessDatacmpDEAEandJADEandCMAES
68DEAE2012Pošík and KlemšnoiselessDatacmpDEandJADEandCMAES
69DEb2012Pošík and KlemšnoiselessDatacmpDEctpbAndDE-F-AUCAndJADEbANDJADEctpb
70DEctpb2012Pošík and KlemšnoiselessDatacmpDEbAndDE-F-AUCAndJADEbANDJADEctpb
71DE-AUTO2012Voglis et al.noiselessDataPDF
72DE-BFGS2012Voglis et al.noiselessDataPDF cmpPSO-BFGS
73DE-ROLL2012Voglis et al.noiselessDataPDF
74DE-SIMPLEX2012Voglis et al.noiselessDataPDF
75IPOPsaACM2012Loshchilov et al.noiselessDatacmpBIPOPsaACM
cmpIPOP-ACTCMA-ESNoisy
76JADE2012Pošík and KlemšnoiselessDatacmpDEandDEAEandCMAES
77JADEb2012Pošík and KlemšnoiselessDatacmpDEbAndDEctpbAndDE-F-AUCAndJADEctpb
78JADEctpb2012Pošík and KlemšnoiselessDatacmpDEbAndDEctpbAndDE-F-AUCAndJADEb
79MVDE2012Veloso de MelonoiselessDataPDF
80NBIPOPaCMA2012Loshchilov et al.noiselessDatacmpNIPOPaCMA
81NIPOPaCMA2012Loshchilov et al.noiselessDatacmpNBIPOPaCMA
82PSO-BFGS2012Voglis et al.noiselessDatacmpDE-BFGS
83SNES2012SchaulnoiselessDataPDF
84xNES2012SchaulnoiselessDataPDF cmpxNESas
85xNESas2012SchaulnoiselessDataPDF cmpxNES
cmpBIPOP-CMA-ES
86BIPOP-saACM-k2013Loshchilov et al.noiselessData
:!: BBOB2010 instances
cmpLoshchilov
87BIPOP-aCMA-STEP2013Loshchilov et al.noiselessData
:!: BBOB2010 instances
cmpLoshchilov
88CGA-grid162013Holtschulte and MosesnoiselessDatacmpHoltschulte
89CGA-grid1002013Holtschulte and MosesnoiselessDatacmpHoltschulte
90CGA-ring162013Holtschulte and MosesnoiselessDatacmpHoltschulte
91CGA-ring1002013Holtschulte and MosesnoiselessDatacmpHoltschulte
92CMAES_Hutter2013Hutter et al.noiselessDatacmpHutter
93DE_Pal2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalBenchmarking
94fmincon2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalComparison
95fminunc2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalComparison
96GA-1002013Holtschulte and MosesnoiselessDatacmpHoltschulte
97HCMA2013Loshchilov et al.noiselessData
:!: BBOB2010 instances
cmpLoshchilov
98HILL2013Holtschulte and MosesnoiselessDatacmpHoltschulte
99HMLSL2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalBenchmarking
100IP2013Liao and StützlenoiselessData
:!: BBOB2010 instances
cmpLiaoTesting cmpLiaoBounding
101IP-10DDr2013Liao and StützlenoiselessData
:!: BBOB2010 instances
cmpLiaoBounding
102IP-5002013Liao and StützlenoiselessData
:!: BBOB2010 instances
cmpLiaoBounding
103IPOP400D2013Auger et al.noiselessDataAuger
104lmm-CMA-ES2013Auger et al.noiselessDataAuger
105MEMPSODE2013VoglisnoiselessDataVoglis
106MLSL2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalBenchmarking
107OQNLP2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalComparison
108P-DCN2013Tran et al.noiselessDatacmpTran
109P-zero2013Tran et al.noiselessDatacmpTran
110PRCGA2013Sawyerr et al.noiselessDataSawyerr
111simplex2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalComparison
112SMAC-BBOB2013Hutter et al.noiselessDatacmpHutter
113tany2013Liao and StützlenoiselessData
:!: BBOB2010 instances
cmpLiaoTesting
114texp2013Liao and StützlenoiselessData
:!: BBOB2010 instances
cmpLiaoTesting
115U-DCN2013Tran et al.noiselessDatacmpTran
116U-zero2013Tran et al.noiselessDatacmpTran
117BFGS-scipy2014BaudišnoiselessDataarXiv paper
118CG-Fletcher-Reeves-scipy2014BaudišnoiselessDataarXiv paper
119CMA-ES-python2014BaudišnoiselessDataarXiv paper
120EG50-cocopf2014BaudišnoiselessDataarXiv paper
121L-BFGS-B-scipy2014BaudišnoiselessDataarXiv paper
122Nelder-Mead-scipy2014BaudišnoiselessDataarXiv paper
123Powell-scipy2014BaudišnoiselessDataarXiv paper
124SLSQP-scipy2014BaudišnoiselessDataarXiv paper
125UNIF-cocopf2014BaudišnoiselessDataarXiv paper
126 MATSuMoToDefault-50D2015BrockhoffnoiselessDataCEC paper
127 R-DE-10e2 2015Tanabe and FukunaganoiselessDataCEC paper
128 R-DE-10e5 2015Tanabe and FukunaganoiselessDataCEC paper
129 R-SHADE-10e2 2015Tanabe and FukunaganoiselessDataCEC paper
130 R-SHADE-10e5 2015Tanabe and FukunaganoiselessDataCEC paper
131 RL-SHADE-10e2 2015Tanabe and FukunaganoiselessDataCEC paper
132 RL-SHADE-10e5 2015Tanabe and FukunaganoiselessDataCEC paper
133 SOO 2015Derbel and PreuxnoiselessDataCEC paper
134 BrentSTEPif 2015Pošík and BaudišnoiselessDataGECCO paper
135 BrentSTEPifeg 2015Pošík and BaudišnoiselessDataGECCO paper
136 BrentSTEPqi 2015Pošík and BaudišnoiselessDataGECCO paper
137 BrentSTEPrr 2015Pošík and BaudišnoiselessDataGECCO paper
138 CMA-CSA 2015AtamnanoiselessDataGECCO paper
139 CMA-MSR 2015AtamnanoiselessDataGECCO paper
140 CMA-TPA 2015AtamnanoiselessDataGECCO paper
141
142
GP1-CMAES 2015Bajer et al.noiselessData 2013instancesdoi slides
Thanks to the authors, two data sets are available with the 2015 and the 2013 instances
143
144
GP5-CMAES 2015Bajer et al.noiselessData 2013instancesdoi slides
Thanks to the authors, two data sets are available with the 2015 and the 2013 instances
145
146
IPOPCMAv3p61 2015Bajer et al.noiselessData 2013instancesdoi slides
Thanks to the authors, two data sets are available with the 2015 and the 2013 instances
147 LHD-10xDefault-MATSuMoTo2015Brockhoff et al.noiselessDataGECCO paper
148 LHD-2xDefault-MATSuMoTo 2015Brockhoff et al.noiselessDataGECCO paper
149 RAND-2xDefault-MATSuMoTo2015Brockhoff et al.noiselessDataGECCO paper
150
151
RF1-CMAES 2015Bajer et al.noiselessData 2013instancesdoi slides
Thanks to the authors, two data sets are available with the 2015 and the 2013 instances
152
153
RF5-CMAES 2015Bajer et al.noiselessData 2013instancesdoi slides
Thanks to the authors, two data sets are available with the 2015 and the 2013 instances
154 STEPif 2015Pošík and BaudišnoiselessDataGECCO paper
155 STEPifeg 2015Pošík and BaudišnoiselessDataGECCO paper
156 STEPrr 2015Pošík and BaudišnoiselessDataGECCO paper
157 PSAaLmC-CMA-ES 2016Nishida and AkimotonoiselessDataGECCO paper
158 PSAaLmD-CMA-ES 2016Nishida and AkimotonoiselessDataGECCO paper
159 PSAaSmC-CMA-ES 2016Nishida and AkimotonoiselessDataGECCO paper
160 PSAaSmD-CMA-ES 2016Nishida and AkimotonoiselessDataGECCO paper
161 CMAES-APOP 2017Nguyen and HansennoiselessDatadoi
162 DTS-CMA-ES 2017Pitra et al.noiselessDatadoi slides
163 EvoSpace-PSO-GA 2017García-Valdez and MerelonoiselessDatadoi
164 KL-BIPOP-CMA-ES 2017Yamaguchi and AkimotonoiselessDataGECCO paper
165 KL-IPOP-CMA-ES 2017Yamaguchi and AkimotonoiselessDataGECCO paper
166 KL-Restart-CMA-ES 2017Yamaguchi and AkimotonoiselessDataGECCO paper
167 Ord-H-DTS-CMA-ES 2017Pitra et al.noiselessDatadoi slides
168 Ord-N-DTS-CMA-ES 2017Pitra et al.noiselessDatadoi slides
169 Ord-Q-DTS-CMA-ES 2017Pitra et al.noiselessDatadoi slides
170 SSEABC 2017Aydin and YavuznoiselessDatasoon (GECCO)
171 RANDOMSEARCH-4 2017BrockhoffnoiselessDatano relation to BBOB
172 RANDOMSEARCH-4p5 2017BrockhoffnoiselessDatano relation to BBOB
173 RANDOMSEARCH-5 2017BrockhoffnoiselessDatano relation to BBOB
algorithms-bbob.1506806356.txt.gz · Last modified: 2017/09/30 23:19 by brockho
CC Attribution-Noncommercial-Share Alike 3.0 Unported
Valid CSS Driven by DokuWiki Recent changes RSS feed Valid XHTML 1.0