UCL Discovery Stage
UCL home » Library Services » Electronic resources » UCL Discovery Stage

Evolving Through the Looking Glass: Learning Improved Search Spaces with Variational Autoencoders

Bentley, PJ; Lim, SL; Gaier, A; Tran, L; (2022) Evolving Through the Looking Glass: Learning Improved Search Spaces with Variational Autoencoders. In: Parallel Problem Solving from Nature – PPSN XVII. (pp. pp. 371-384). Springer Nature: Cham, Switzerland. Green open access

[thumbnail of 978-3-031-14714-2_26.pdf]
Preview
Text
978-3-031-14714-2_26.pdf - Published Version

Download (2MB) | Preview

Abstract

Nature has spent billions of years perfecting our genetic representations, making them evolvable and expressive. Generative machine learning offers a shortcut: learn an evolvable latent space with implicit biases towards better solutions. We present SOLVE: Search space Optimization with Latent Variable Evolution, which creates a dataset of solutions that satisfy extra problem criteria or heuristics, generates a new latent search space, and uses a genetic algorithm to search within this new space to find solutions that meet the overall objective. We investigate SOLVE on five sets of criteria designed to detrimentally affect the search space and explain how this approach can be easily extended as the problems become more complex. We show that, compared to an identical GA using a standard representation, SOLVE with its learned latent representation can meet extra criteria and find solutions with distance to optimal up to two orders of magnitude closer. We demonstrate that SOLVE achieves its results by creating better search spaces that focus on desirable regions, reduce discontinuities, and enable improved search by the genetic algorithm. Fig. 1.Search space Optimization with Latent Variable Evolution (SOLVE). An optimizer produces a dataset of random solutions satisfying an extra criterion (e.g., constraint or secondary objective). A variational autoencoder learns this dataset and produces a learned latent representation biased towards the desired region of the search space. This learned representation is then used by a genetic algorithm to find solutions that meet the objective and extra criterion together.

Type: Proceedings paper
Title: Evolving Through the Looking Glass: Learning Improved Search Spaces with Variational Autoencoders
Event: International Conference on Parallel Problem Solving from Nature
ISBN-13: 978-3-031-14713-5
Open access status: An open access version is available from UCL Discovery
DOI: 10.1007/978-3-031-14714-2_26
Publisher version: https://doi.org/10.1007/978-3-031-14714-2_26
Language: English
Additional information: © 2022 The Author(s). This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).
UCL classification: UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL
URI: https://discovery-pp.ucl.ac.uk/id/eprint/10155516
Downloads since deposit
Loading...
1,804Downloads
Download activity - last month
Loading...
Download activity - last 12 months
Loading...
Downloads by country - last 12 months
Loading...

Archive Staff Only

View Item View Item