The following table lists all algorithm data sets related to the noiseless bbob test suite as collected during the BBOB workshops and special sessions in the years 2009 till 2017. In order to sort the table according to some columns, please click on the corresponding table header. If available, the source codes of the algorithms can be downloaded by clicking on the link with the corresponding algorithm name in the second column.

NoAlgorithmYearAuthor(s)Data Noiselessrelated PDFs and Remarks
0ALPS2009HornbynoiselessDataPDF
1AMALGAM2009Bosman et al.noiselessDataPDFnoiseless PDFnoisy
2BAYEDA2009GallaghernoiselessDataPDFnoiseless PDFnoisy
3BFGS2009RosnoiselessDataPDFnoiseless PDFnoisy
4BIPOP-CMA-ES2009HansennoiselessDataPDFnoiseless PDFnoisy
5Cauchy-EDA2009PošíknoiselessDataPDF
6CMA-ESPLUSSEL2009Auger and HansennoiselessDataPDFnoiseless PDFnoisy
7DASA2009Korošec and ŠilcnoiselessDataPDFnoiseless PDFnoisy
8DE-PSO2009García-Nieto et al.noiselessDataPDFnoiseless PDFnoisy
9DIRECT2009PošíknoiselessDataPDF
algorithm is deterministic and thus, only run on each instance once
10EDA-PSO2009El-Abd and KamelnoiselessDataPDF
11FULLNEWUOA2009RosnoiselessDataoriginal 2009 noiseless paper
original 2009 noisy paper
2010 comparison noiseless
2010 comparison noisy
12G3PCX2009PošíknoiselessDataPDF
13GA2009NicolaunoiselessDataPDF
14GLOBAL2009Pál et al.noiselessDataBBOB-2009 paper not available online
corresponding ECJ Paper
15iAMALGAM2009Bosman et al.noiselessDataPDFnoiseless PDFnoisy
16IPOP-SEP-CMA-ES2009RosnoiselessDataPDFnoiseless PDFnoisy
17LSfminbnd2009PošíknoiselessDataPDF
18LSstep2009PošíknoiselessDataPDF
19MA-LS-CHAIN2009Molina et al.noiselessDataPDFnoiseless PDFnoisy
20MCS2009Huyer and NeumaiernoiselessDataPDFNoiseless PDFnoisy
21NELDERDOERR2009Doerr et al.noiselessDataPDF
22NELDER2009HansennoiselessDataPDF
23NEWUOA2009RosnoiselessDataoriginal 2009 noiseless paper
original 2009 noisy paper
2010 comparison with BIPOP-CMA-ES noiseless
2010 comparison noiseless
2010 comparison noisy
noisy data under #59 (2010)
24ONEFIFTH2009AugernoiselessDataPDFnoiseless PDFnoisy
25POEMS2009KubalíknoiselessDataPDF
26PSO2009El-Abd and KamelnoiselessDataPDF
27PSO_Bounds2009El-Abd and KamelnoiselessDataPDF
28RANDOMSEARCH2009Auger and RosnoiselessDataPDFnoiseless PDFnoisy
29Rosenbrock2009PošíknoiselessDataPDF
30VNS2009García-Martínez and LozanonoiselessDataPDFnoiseless PDFnoisy
311komma22010Auger et al.noiselessDatacmp1komma2mirAnd1komma2mirser doi
cmp1komma2mirAnd1komma2mirserNoisy cmp1komma2ser cmp1komma2serNoisy
321komma2mir2010Auger et al.noiselessDatacmp1komma2And1komma2mirser doi
cmp1komma2And1komma2mirserNoisy
331komma2mirser2010Auger et al.noiselessDatacmp1komma2And1komma2mir doi
cmp1komma2And1komma2mirNoisy
341komma2ser2010Auger et al.noiselessDatacmp1komma2 cmp1komma2Noisy
351komma42010Auger et al.noiselessDatacmp1komma4serNoisy doi
the other three papers are not linked to at the moment
361komma4mir2010Auger et al.noiselessDatacmp1komma4And1komma4mirser cmp1komma4And1komma4mirserNoisy
371komma4mirser2010Auger et al.noiselessDataPDFnoiseless PDFnoisy cmp1komma4And1komma4mir cmp1komma4And1komma4mirNoisy
381komma4ser2010Auger et al.noiselessDatacmp1komma4 cmp1komma4Noisy doi
391plus12010Auger et al.noiselessDatacmp1plus2mirser
401plus2mirser2010Auger et al.noiselessDatacmp1plus1
41ABC2010El-AbdnoiselessDatadoi
42AVGNEWUOA
:!: algname still NEWUOA :!:
2010RosnoiselessData mentioned in 2009 paper, data set submitted in 2009, but data presented only in 2010
cmpNEWUOAFULLNEWUOnoiseless
43CMAEGS2010Finck and BeyernoiselessDataPDFnoiseless DOInoisy
44DE-F-AUC2010Fialho et al.noiselessDatacmpPM-AdapSS-DE
45DEuniform2010Fialho et al.noiselessDatacmpPM-AdapSS-DE
46IPOP-ACTCMA-ES2010Hansen and RosnoiselessDatacmpIPOP-CMA-ESNoiseless
cmpIPOP-CMA-ESNoisy
47IPOP-CMA-ES2010Hansen and RosnoiselessDatacmpIPOP-ACTCMA-ESNoiseless
cmpIPOP-ACTCMA-ESNoisy
cmpBIPOP-CMA-ESNoiseless
cmpBIPOP-CMA-ESNoisy
48MOS2010LaTorre et al.noiselessDataPDFnoiseless PDFnoisy
49NBC-CMA2010PreussnoiselessDatadoi
50PM-AdapSS-DE2010Fialho et al.noiselessDatacmpUniformDE cmpDE-F-AUC
51RCGA2010Tran and JinnoiselessDatadoi noiseless doi noisy
52SPSA2010Finck and BeyernoiselessDataPDFnoiseless PDFnoisy
53oPOEMS2010KubalíknoiselessDatadoi cmppPOEMS
54pPOEMS2010KubalíknoiselessDatadoi cmpoPOEMS
55ACOR2012Liao et alnoiselessDataPDF
56BIPOPaCMA2012Loshchilov et al.noiselessDatacmpNIPOPaCMA-BIPOPaCMA-NBIPOPaCM-IPOPaCMA
57BIPOPsaACM2012Loshchilov et al.noiselessDatacmpIPOPsaACM
58CMA2012Brockhoff et al.noiselessDatacmpCMAaAndCMAm
59CMAa2012Brockhoff et al.noiselessDatacmpCMAmaAndIPOP-ACTCMA-ES
cmpCMAandCMAm
60CMAm2012Brockhoff et al.noiselessDatacmpCMAandCMAa
61CMAma2012Brockhoff et al.noiselessDatacmpCMAaAndIPOP-ACTCMA-ES
cmpCMAmah
62CMAmah2012Brockhoff et al.noiselessDatacmpCMAma cmpCMAmh
63CMAmh2012Brockhoff et al.noiselessDatacmpCMAmah
64CMAES2012Pošík and KlemšnoiselessDatacmpDEandDEAEandJADE
65DBRCGA2012Chuang and ChennoiselessDataPDF
66DE2012Pošík and KlemšnoiselessDatacmpDEAEandJADEandCMAES
67DEAE2012Pošík and KlemšnoiselessDatacmpDEandJADEandCMAES
68DEb2012Pošík and KlemšnoiselessDatacmpDEctpbAndDE-F-AUCAndJADEbANDJADEctpb
69DEctpb2012Pošík and KlemšnoiselessDatacmpDEbAndDE-F-AUCAndJADEbANDJADEctpb
70DE-AUTO2012Voglis et al.noiselessDataPDF
71DE-BFGS2012Voglis et al.noiselessDataPDF cmpPSO-BFGS
72DE-ROLL2012Voglis et al.noiselessDataPDF
73DE-SIMPLEX2012Voglis et al.noiselessDataPDF
74IPOPsaACM2012Loshchilov et al.noiselessDatacmpBIPOPsaACM
cmpIPOP-ACTCMA-ESNoisy
75JADE2012Pošík and KlemšnoiselessDatacmpDEandDEAEandCMAES
76JADEb2012Pošík and KlemšnoiselessDatacmpDEbAndDEctpbAndDE-F-AUCAndJADEctpb
77JADEctpb2012Pošík and KlemšnoiselessDatacmpDEbAndDEctpbAndDE-F-AUCAndJADEb
78MVDE2012Veloso de MelonoiselessDataPDF
79NBIPOPaCMA2012Loshchilov et al.noiselessDatacmpNIPOPaCMA
80NIPOPaCMA2012Loshchilov et al.noiselessDatacmpNBIPOPaCMA
81PSO-BFGS2012Voglis et al.noiselessDatacmpDE-BFGS
82SNES2012SchaulnoiselessDataPDF
83xNES2012SchaulnoiselessDataPDF cmpxNESas
84xNESas2012SchaulnoiselessDataPDF cmpxNES
cmpBIPOP-CMA-ES
85BIPOP-saACM-k2013Loshchilov et al.noiselessData
:!: BBOB2010 instances
cmpLoshchilov
86BIPOP-aCMA-STEP2013Loshchilov et al.noiselessData
:!: BBOB2010 instances
cmpLoshchilov
87CGA-grid162013Holtschulte and MosesnoiselessDatacmpHoltschulte
88CGA-grid1002013Holtschulte and MosesnoiselessDatacmpHoltschulte
89CGA-ring162013Holtschulte and MosesnoiselessDatacmpHoltschulte
90CGA-ring1002013Holtschulte and MosesnoiselessDatacmpHoltschulte
91CMAES_Hutter2013Hutter et al.noiselessDatacmpHutter
92DE_Pal2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalBenchmarking
93fmincon2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalComparison
94fminunc2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalComparison
95GA-1002013Holtschulte and MosesnoiselessDatacmpHoltschulte
96HCMA2013Loshchilov et al.noiselessData
:!: BBOB2010 instances
cmpLoshchilov
97HILL2013Holtschulte and MosesnoiselessDatacmpHoltschulte
98HMLSL2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalBenchmarking
99IP2013Liao and StützlenoiselessData
:!: BBOB2010 instances
cmpLiaoTesting cmpLiaoBounding
100IP-10DDr2013Liao and StützlenoiselessData
:!: BBOB2010 instances
cmpLiaoBounding
101IP-5002013Liao and StützlenoiselessData
:!: BBOB2010 instances
cmpLiaoBounding
102IPOP400D2013Auger et al.noiselessDataAuger
103lmm-CMA-ES2013Auger et al.noiselessDataAuger
104MEMPSODE2013VoglisnoiselessDataVoglis
105MLSL2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalBenchmarking
106OQNLP2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalComparison
107P-DCN2013Tran et al.noiselessDatacmpTran
108P-zero2013Tran et al.noiselessDatacmpTran
109PRCGA2013Sawyerr et al.noiselessDataSawyerr
110simplex2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalComparison
111SMAC-BBOB2013Hutter et al.noiselessDatacmpHutter
112tany2013Liao and StützlenoiselessData
:!: BBOB2010 instances
cmpLiaoTesting
113texp2013Liao and StützlenoiselessData
:!: BBOB2010 instances
cmpLiaoTesting
114U-DCN2013Tran et al.noiselessDatacmpTran
115U-zero2013Tran et al.noiselessDatacmpTran
116BFGS-scipy2014BaudišnoiselessDataarXiv paper
117CG-Fletcher-Reeves-scipy2014BaudišnoiselessDataarXiv paper
118CMA-ES-python2014BaudišnoiselessDataarXiv paper
119EG50-cocopf2014BaudišnoiselessDataarXiv paper
120L-BFGS-B-scipy2014BaudišnoiselessDataarXiv paper
121Nelder-Mead-scipy2014BaudišnoiselessDataarXiv paper
122Powell-scipy2014BaudišnoiselessDataarXiv paper
123SLSQP-scipy2014BaudišnoiselessDataarXiv paper
124UNIF-cocopf2014BaudišnoiselessDataarXiv paper
125 MATSuMoToDefault-50D2015BrockhoffnoiselessDataCEC paper
126 R-DE-10e2 2015Tanabe and FukunaganoiselessDataCEC paper
127 R-DE-10e5 2015Tanabe and FukunaganoiselessDataCEC paper
128 R-SHADE-10e2 2015Tanabe and FukunaganoiselessDataCEC paper
129 R-SHADE-10e5 2015Tanabe and FukunaganoiselessDataCEC paper
130 RL-SHADE-10e2 2015Tanabe and FukunaganoiselessDataCEC paper
131 RL-SHADE-10e5 2015Tanabe and FukunaganoiselessDataCEC paper
132 SOO 2015Derbel and PreuxnoiselessDataCEC paper
133 BrentSTEPif 2015Pošík and BaudišnoiselessDataGECCO paper
134 BrentSTEPifeg 2015Pošík and BaudišnoiselessDataGECCO paper
135 BrentSTEPqi 2015Pošík and BaudišnoiselessDataGECCO paper
136 BrentSTEPrr 2015Pošík and BaudišnoiselessDataGECCO paper
137 CMA-CSA 2015AtamnanoiselessDataGECCO paper
138 CMA-MSR 2015AtamnanoiselessDataGECCO paper
139 CMA-TPA 2015AtamnanoiselessDataGECCO paper
140
141
GP1-CMAES 2015Bajer et al.noiselessData 2013instancesdoi slides
Thanks to the authors, two data sets are available with the 2015 and the 2013 instances
142
143
GP5-CMAES 2015Bajer et al.noiselessData 2013instancesdoi slides
Thanks to the authors, two data sets are available with the 2015 and the 2013 instances
144
145
IPOPCMAv3p61 2015Bajer et al.noiselessData 2013instancesdoi slides
Thanks to the authors, two data sets are available with the 2015 and the 2013 instances
146 LHD-10xDefault-MATSuMoTo2015Brockhoff et al.noiselessDataGECCO paper
147 LHD-2xDefault-MATSuMoTo 2015Brockhoff et al.noiselessDataGECCO paper
148 RAND-2xDefault-MATSuMoTo2015Brockhoff et al.noiselessDataGECCO paper
149
150
RF1-CMAES 2015Bajer et al.noiselessData 2013instancesdoi slides
Thanks to the authors, two data sets are available with the 2015 and the 2013 instances
151
152
RF5-CMAES 2015Bajer et al.noiselessData 2013instancesdoi slides
Thanks to the authors, two data sets are available with the 2015 and the 2013 instances
153 STEPif 2015Pošík and BaudišnoiselessDataGECCO paper
154 STEPifeg 2015Pošík and BaudišnoiselessDataGECCO paper
155 STEPrr 2015Pošík and BaudišnoiselessDataGECCO paper
156 PSAaLmC-CMA-ES 2016Nishida and AkimotonoiselessDataGECCO paper
157 PSAaLmD-CMA-ES 2016Nishida and AkimotonoiselessDataGECCO paper
158 PSAaSmC-CMA-ES 2016Nishida and AkimotonoiselessDataGECCO paper
159 PSAaSmD-CMA-ES 2016Nishida and AkimotonoiselessDataGECCO paper
160 CMAES-APOP 2017Nguyen and HansennoiselessDatadoi
161 DTS-CMA-ES 2017Pitra et al.noiselessDatadoi slides
162 EvoSpace-PSO-GA 2017García-Valdez and MerelonoiselessDatadoi
163 KL-BIPOP-CMA-ES 2017Yamaguchi and AkimotonoiselessDataGECCO paper slides
164 KL-IPOP-CMA-ES 2017Yamaguchi and AkimotonoiselessDataGECCO paper slides
165 KL-Restart-CMA-ES 2017Yamaguchi and AkimotonoiselessDataGECCO paper slides
166 Ord-H-DTS-CMA-ES 2017Pitra et al.noiselessDatadoi slides
167 Ord-N-DTS-CMA-ES 2017Pitra et al.noiselessDatadoi slides
168 Ord-Q-DTS-CMA-ES 2017Pitra et al.noiselessDatadoi slides
169 SSEABC 2017Aydin and YavuznoiselessDatadoi slides
170 RANDOMSEARCH-4 2017BrockhoffnoiselessDataCOCO baseline data without BBOB paper
171 RANDOMSEARCH-4p5 2017BrockhoffnoiselessDataCOCO baseline data without BBOB paper
172 RANDOMSEARCH-5 2017BrockhoffnoiselessDataCOCO baseline data without BBOB paper
algorithms-bbob.txt · Last modified: 2017/10/14 15:26 by brockho
CC Attribution-Noncommercial-Share Alike 3.0 Unported
Valid CSS Driven by DokuWiki Recent changes RSS feed Valid XHTML 1.0