
The Library
Racing with a fixed budget and a self-adaptive significance level
Tools
Branke, Jürgen and Elomari, Jawad Asem (2013) Racing with a fixed budget and a self-adaptive significance level. In: Nicosia , Giuseppe and Pardalos, Panos , (eds.) Learning and Intelligent Optimization. Lecture Notes in Computer Science, Volume 7997 . Berlin Heidelberg: Springer Berlin Heidelberg, pp. 272-280. ISBN 9783642449727
Research output not available from this repository.
Request-a-Copy directly from author or use local Library Get it For Me service.
Official URL: http://dx.doi.org/10.1007/978-3-642-44973-4_29
Abstract
F-Race is an offline parameter tuning method which efficiently allocates samples in order to identify the parameter setting with the best expected performance, out of a given set of parameter settings. Using non parametric statistical tests, F-Race discards parameter settings which perform significantly worse than the current best, allowing the surviving parameter settings to be tested on more instances and hence obtaining better estimates for their performance. The statistical tests require setting significance levels which directly affect the algorithm’s ability of detecting the best parameter setting, and the total runtime. In this paper, we show that it is not straightforward to set the significance level and propose a simple modification to automatically adapt the significance level such that the failure rate is minimized. This is tested empirically using data drawn from probability distributions with pre-defined characteristics. Results indicate that, under a strict computational budget, F-Race with online adaptation performs significantly better than its counterpart with even the best fixed value.
Item Type: | Book Item | ||||
---|---|---|---|---|---|
Divisions: | Faculty of Social Sciences > Warwick Business School | ||||
Series Name: | Lecture Notes in Computer Science | ||||
Publisher: | Springer Berlin Heidelberg | ||||
Place of Publication: | Berlin Heidelberg | ||||
ISBN: | 9783642449727 | ||||
ISSN: | 0302-9743 | ||||
Book Title: | Learning and Intelligent Optimization | ||||
Editor: | Nicosia , Giuseppe and Pardalos, Panos | ||||
Official Date: | 2013 | ||||
Dates: |
|
||||
Volume: | Volume 7997 | ||||
Page Range: | pp. 272-280 | ||||
DOI: | 10.1007/978-3-642-44973-4_29 | ||||
Status: | Peer Reviewed | ||||
Publication Status: | Published | ||||
Access rights to Published version: | Restricted or Subscription Access | ||||
Conference Paper Type: | Paper | ||||
Title of Event: | 7th International Conference, LION 7 | ||||
Type of Event: | Conference | ||||
Location of Event: | Catania, Italy | ||||
Date(s) of Event: | 7-11 Jan 2013 |
Request changes or add full text files to a record
Repository staff actions (login required)
![]() |
View Item |