This is an old revision of the document!


The following table lists all algorithm data sets related to the noiseless bbob test suite as collected during the BBOB workshops and special sessions in the years 2009 till 2017. In order to sort the table according to some columns, please click on the corresponding table header. If available, the source codes of the algorithms can be downloaded by clicking on the link with the corresponding algorithm name in the second column.

NoAlgorithmYearAuthor(s)Data Noiselessrelated PDFs and Remarks
1ALPS2009HornbynoiselessDataPDF
2AMALGAM2009Bosman et al.noiselessDataPDFnoiseless PDFnoisy
3BAYEDA2009GallaghernoiselessDataPDFnoiseless PDFnoisy
4BFGS2009RosnoiselessDataPDFnoiseless PDFnoisy
5BIPOP-CMA-ES2009HansennoiselessDataPDFnoiseless PDFnoisy
6Cauchy-EDA2009PošíknoiselessDataPDF
7CMA-ESPLUSSEL2009Auger and HansennoiselessDataPDFnoiseless PDFnoisy
8DASA2009Korošec and ŠilcnoiselessDataPDFnoiseless PDFnoisy
9DE-PSO2009García-Nieto et al.noiselessDataPDFnoiseless PDFnoisy
10DIRECT2009PošíknoiselessDataPDF
algorithm is deterministic and thus, only run on each instance once
11EDA-PSO2009El-Abd and KamelnoiselessDataPDF
12FULLNEWUOA2009RosnoiselessDataoriginal 2009 noiseless paper
original 2009 noisy paper
2010 comparison noiseless
2010 comparison noisy
13G3PCX2009PošíknoiselessDataPDF
14GA2009NicolaunoiselessDataPDF
15GLOBAL2009Pál et al.noiselessDataBBOB-2009 paper not available online
corresponding ECJ Paper
16iAMALGAM2009Bosman et al.noiselessDataPDFnoiseless PDFnoisy
17IPOP-SEP-CMA-ES2009RosnoiselessDataPDFnoiseless PDFnoisy
18LSfminbnd2009PošíknoiselessDataPDF
19LSstep2009PošíknoiselessDataPDF
20MA-LS-CHAIN2009Molina et al.noiselessDataPDFnoiseless PDFnoisy
21MCS2009Huyer and NeumaiernoiselessDataPDFNoiseless PDFnoisy
22NELDERDOERR2009Doerr et al.noiselessDataPDF
23NELDER2009HansennoiselessDataPDF
24NEWUOA2009RosnoiselessDataoriginal 2009 noiseless paper
original 2009 noisy paper
2010 comparison with BIPOP-CMA-ES noiseless
2010 comparison noiseless
2010 comparison noisy
noisy data under #59 (2010)
25ONEFIFTH2009AugernoiselessDataPDFnoiseless PDFnoisy
26POEMS2009KubalíknoiselessDataPDF
27PSO2009El-Abd and KamelnoiselessDataPDF
28PSO_Bounds2009El-Abd and KamelnoiselessDataPDF
29RANDOMSEARCH2009Auger and RosnoiselessDataPDFnoiseless PDFnoisy
30Rosenbrock2009PošíknoiselessDataPDF
31VNS2009García-Martínez and LozanonoiselessDataPDFnoiseless PDFnoisy
321komma22010Auger et al.noiselessDatacmp1komma2mirAnd1komma2mirser doi
cmp1komma2mirAnd1komma2mirserNoisy cmp1komma2ser cmp1komma2serNoisy
331komma2mir2010Auger et al.noiselessDatacmp1komma2And1komma2mirser doi
cmp1komma2And1komma2mirserNoisy
341komma2mirser2010Auger et al.noiselessDatacmp1komma2And1komma2mir doi
cmp1komma2And1komma2mirNoisy
351komma2ser2010Auger et al.noiselessDatacmp1komma2 cmp1komma2Noisy
361komma42010Auger et al.noiselessDatacmp1komma4serNoisy doi
the other three papers are not linked to at the moment
371komma4mir2010Auger et al.noiselessDatacmp1komma4And1komma4mirser cmp1komma4And1komma4mirserNoisy
381komma4mirser2010Auger et al.noiselessDataPDFnoiseless PDFnoisy cmp1komma4And1komma4mir cmp1komma4And1komma4mirNoisy
391komma4ser2010Auger et al.noiselessDatacmp1komma4 cmp1komma4Noisy doi
401plus12010Auger et al.noiselessDatacmp1plus2mirser
411plus2mirser2010Auger et al.noiselessDatacmp1plus1
42ABC2010El-AbdnoiselessDatadoi
43AVGNEWUOA
:!: algname still NEWUOA :!:
2010RosnoiselessData mentioned in 2009 paper, data set submitted in 2009, but data presented only in 2010
cmpNEWUOAFULLNEWUOnoiseless
44CMAEGS2010Finck and BeyernoiselessDataPDFnoiseless DOInoisy
45DE-AUC2010Fialho et al.:?:data only
46DE-F-AUC2010Fialho et al.noiselessDatacmpPM-AdapSS-DE
47DE-F-SUM2010Fialho et al.:?:data only
48DE-SUM2010Fialho et al.:?:data only
49DEstRand1Bin2010Fialho et al.:?:data only
50DEstRand2Bin2010Fialho et al.:?:data only
51DEstRandToBest2Bin2010Fialho et al.:?:data only
52DEstTargetToRand1Bin2010Fialho et al.:?:data only
53DEuniform2010Fialho et al.noiselessDatacmpPM-AdapSS-DE
54IPOP-ACTCMA-ES2010Hansen and RosnoiselessDatacmpIPOP-CMA-ESNoiseless
cmpIPOP-CMA-ESNoisy
55IPOP-CMA-ES2010Hansen and RosnoiselessDatacmpIPOP-ACTCMA-ESNoiseless
cmpIPOP-ACTCMA-ESNoisy
cmpBIPOP-CMA-ESNoiseless
cmpBIPOP-CMA-ESNoisy
56MOS2010LaTorre et al.noiselessDataPDFnoiseless PDFnoisy
57NBC-CMA2010PreussnoiselessDatadoi
58PM-AdapSS-DE2010Fialho et al.noiselessDatacmpUniformDE cmpDE-F-AUC
59RCGA2010Tran and JinnoiselessDatadoi noiseless doi noisy
60SPSA2010Finck and BeyernoiselessDataPDFnoiseless PDFnoisy
61oPOEMS2010KubalíknoiselessDatadoi cmppPOEMS
62pPOEMS2010KubalíknoiselessDatadoi cmpoPOEMS
63ACOR2012Liao et alnoiselessDataPDF
64BIPOPaCMA2012Loshchilov et al.noiselessDatacmpNIPOPaCMA-BIPOPaCMA-NBIPOPaCM-IPOPaCMA
65BIPOPsaACM2012Loshchilov et al.noiselessDatacmpIPOPsaACM
66CMA2012Brockhoff et al.noiselessDatacmpCMAaAndCMAm
67CMAa2012Brockhoff et al.noiselessDatacmpCMAmaAndIPOP-ACTCMA-ES
cmpCMAandCMAm
68CMAm2012Brockhoff et al.noiselessDatacmpCMAandCMAa
69CMAma2012Brockhoff et al.noiselessDatacmpCMAaAndIPOP-ACTCMA-ES
cmpCMAmah
70CMAmah2012Brockhoff et al.noiselessDatacmpCMAma cmpCMAmh
71CMAmh2012Brockhoff et al.noiselessDatacmpCMAmah
72CMAES2012Pošík and KlemšnoiselessDatacmpDEandDEAEandJADE
73DBRCGA2012Chuang and ChennoiselessDataPDF
74DE2012Pošík and KlemšnoiselessDatacmpDEAEandJADEandCMAES
75DEAE2012Pošík and KlemšnoiselessDatacmpDEandJADEandCMAES
76DEb2012Pošík and KlemšnoiselessDatacmpDEctpbAndDE-F-AUCAndJADEbANDJADEctpb
77DEctpb2012Pošík and KlemšnoiselessDatacmpDEbAndDE-F-AUCAndJADEbANDJADEctpb
78DE-AUTO2012Voglis et al.noiselessDataPDF
79DE-BFGS2012Voglis et al.noiselessDataPDF cmpPSO-BFGS
80DE-ROLL2012Voglis et al.noiselessDataPDF
81DE-SIMPLEX2012Voglis et al.noiselessDataPDF
82IPOPsaACM2012Loshchilov et al.noiselessDatacmpBIPOPsaACM
cmpIPOP-ACTCMA-ESNoisy
83JADE2012Pošík and KlemšnoiselessDatacmpDEandDEAEandCMAES
84JADEb2012Pošík and KlemšnoiselessDatacmpDEbAndDEctpbAndDE-F-AUCAndJADEctpb
85JADEctpb2012Pošík and KlemšnoiselessDatacmpDEbAndDEctpbAndDE-F-AUCAndJADEb
86MVDE2012Veloso de MelonoiselessDataPDF
87NBIPOPaCMA2012Loshchilov et al.noiselessDatacmpNIPOPaCMA
88NIPOPaCMA2012Loshchilov et al.noiselessDatacmpNBIPOPaCMA
89PSO-BFGS2012Voglis et al.noiselessDatacmpDE-BFGS
90SNES2012SchaulnoiselessDataPDF
91xNES2012SchaulnoiselessDataPDF cmpxNESas
92xNESas2012SchaulnoiselessDataPDF cmpxNES
cmpBIPOP-CMA-ES
93BIPOP-saACM-k2013Loshchilov et al.noiselessData
:!: BBOB2010 instances
cmpLoshchilov
94BIPOP-aCMA-STEP2013Loshchilov et al.noiselessData
:!: BBOB2010 instances
cmpLoshchilov
95CGA-grid162013Holtschulte and MosesnoiselessDatacmpHoltschulte
96CGA-grid1002013Holtschulte and MosesnoiselessDatacmpHoltschulte
97CGA-ring162013Holtschulte and MosesnoiselessDatacmpHoltschulte
98CGA-ring1002013Holtschulte and MosesnoiselessDatacmpHoltschulte
99CMAES_Hutter2013Hutter et al.noiselessDatacmpHutter
100DE_Pal2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalBenchmarking
101fmincon2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalComparison
102fminunc2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalComparison
103GA-1002013Holtschulte and MosesnoiselessDatacmpHoltschulte
104HCMA2013Loshchilov et al.noiselessData
:!: BBOB2010 instances
cmpLoshchilov
105HILL2013Holtschulte and MosesnoiselessDatacmpHoltschulte
106HMLSL2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalBenchmarking
107IP2013Liao and StützlenoiselessData
:!: BBOB2010 instances
cmpLiaoTesting cmpLiaoBounding
108IP-10DDr2013Liao and StützlenoiselessData
:!: BBOB2010 instances
cmpLiaoBounding
109IP-5002013Liao and StützlenoiselessData
:!: BBOB2010 instances
cmpLiaoBounding
110IPOP400D2013Auger et al.noiselessDataAuger
111lmm-CMA-ES2013Auger et al.noiselessDataAuger
112MEMPSODE2013VoglisnoiselessDataVoglis
113MLSL2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalBenchmarking
114OQNLP2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalComparison
115P-DCN2013Tran et al.noiselessDatacmpTran
116P-zero2013Tran et al.noiselessDatacmpTran
117PRCGA2013Sawyerr et al.noiselessDataSawyerr
118simplex2013PàlnoiselessData
:!: BBOB2010 instances
cmpPalComparison
119SMAC-BBOB2013Hutter et al.noiselessDatacmpHutter
120tany2013Liao and StützlenoiselessData
:!: BBOB2010 instances
cmpLiaoTesting
121texp2013Liao and StützlenoiselessData
:!: BBOB2010 instances
cmpLiaoTesting
122U-DCN2013Tran et al.noiselessDatacmpTran
123U-zero2013Tran et al.noiselessDatacmpTran
124 MATSuMoToDefault-50D2015BrockhoffnoiselessDataCEC paper
125 R-DE-10e2 2015Tanabe and FukunaganoiselessDataCEC paper
126 R-DE-10e5 2015Tanabe and FukunaganoiselessDataCEC paper
127 R-SHADE-10e2 2015Tanabe and FukunaganoiselessDataCEC paper
128 R-SHADE-10e5 2015Tanabe and FukunaganoiselessDataCEC paper
129 RL-SHADE-10e2 2015Tanabe and FukunaganoiselessDataCEC paper
130 RL-SHADE-10e5 2015Tanabe and FukunaganoiselessDataCEC paper
131 SOO 2015Derbel and PreuxnoiselessDataCEC paper
132 BSif 2015Pošík and BaudišnoiselessDataGECCO paper
133 BSifeg 2015Pošík and BaudišnoiselessDataGECCO paper
134 BSqi 2015Pošík and BaudišnoiselessData
135 BSrr 2015Pošík and BaudišnoiselessDataGECCO paper
136 CMA-CSA 2015AtamnanoiselessDataGECCO paper
137 CMA-MSR 2015AtamnanoiselessDataGECCO paper
138 CMA-TPA 2015AtamnanoiselessDataGECCO paper
139 GP1-CMAES 2015Bajer et al.noiselessData 2013instancesdoi slides
Thanks to the authors, two data sets are available with the 2015 and the 2013 instances
140 GP5-CMAES 2015Bajer et al.noiselessData 2013instancesdoi slides
Thanks to the authors, two data sets are available with the 2015 and the 2013 instances
141 IPOPCMAv3p61 2015Bajer et al.noiselessData 2013instancesdoi slides
Thanks to the authors, two data sets are available with the 2015 and the 2013 instances
142 LHD-10xDefault-MATSuMoTo2015Brockhoff et al.noiselessDataGECCO paper
143 LHD-2xDefault-MATSuMoTo 2015Brockhoff et al.noiselessDataGECCO paper
144 RAND-2xDefault-MATSuMoTo2015Brockhoff et al.noiselessDataGECCO paper
145 RF1-CMAES 2015Bajer et al.noiselessData 2013instancesdoi slides
Thanks to the authors, two data sets are available with the 2015 and the 2013 instances
146 RF5-CMAES 2015Bajer et al.noiselessData 2013instancesdoi slides
Thanks to the authors, two data sets are available with the 2015 and the 2013 instances
147 Sif 2015Pošík and BaudišnoiselessDataGECCO paper
148 Sifeg 2015Pošík and BaudišnoiselessDataGECCO paper
149 Srr 2015Pošík and BaudišnoiselessDataGECCO paper
150 PSAaLmC 2016Nishida and AkimotonoiselessDataGECCO paper
151 PSAaLmD 2016Nishida and AkimotonoiselessDataGECCO paper
152 PSAaSmC 2016Nishida and AkimotonoiselessDataGECCO paper
153 PSAaSmD 2016Nishida and AkimotonoiselessDataGECCO paper
154 CMAES-APOP 2017Nguyen and HansennoiselessDatasoon (GECCO)
155 DTS-CMA-ES 2017Pitra et al.noiselessDatasoon (GECCO)
156 EvoSpace-PSO 2017García-Valdez and MerelonoiselessDatasoon (GECCO)
157 KL-BIPOP 2017Yamaguchi and AkimotonoiselessDatasoon (GECCO)
158 KL-IPOP 2017Yamaguchi and AkimotonoiselessDatasoon (GECCO)
159 KL-Restart 2017Yamaguchi and AkimotonoiselessDatasoon (GECCO)
160 Ord-H-DTS 2017Pitra et al.soonsoon (GECCO), 20-D not yet available
161 Ord-N-DTS 2017Pitra et al.soonsoon (GECCO), 20-D not yet available
162 Ord-Q-DTS 2017Pitra et al.noiselessDatasoon (GECCO)
163 SSEABC 2017Aydin and YavuznoiselessDatasoon (GECCO)
164 RANDOMSEARCH-4 2017BrockhoffnoiselessDatano relation to BBOB
165 RANDOMSEARCH-4p5 2017BrockhoffnoiselessDatano relation to BBOB
166 RANDOMSEARCH-5 2017BrockhoffnoiselessDatano relation to BBOB
algorithms.1506421829.txt.gz · Last modified: 2017/09/26 12:30 by brockho
CC Attribution-Noncommercial-Share Alike 3.0 Unported
Valid CSS Driven by DokuWiki Recent changes RSS feed Valid XHTML 1.0