Chancellor, N;
Szoke, S;
Vinci, W;
Aeppli, G;
Warburton, PA;
(2016)
Maximum-Entropy Inference with a Programmable Annealer.
Scientific Reports
, 6
, Article 22318. 10.1038/srep22318.
Text
Maximum-Entropy Inference with a Programmable Annealer.pdf - Published Version Download (1MB) |
Abstract
Optimisation problems typically involve finding the ground state (i.e. the minimum energy configuration) of a cost function with respect to many variables. If the variables are corrupted by noise then this maximises the likelihood that the solution is correct. The maximum entropy solution on the other hand takes the form of a Boltzmann distribution over the ground and excited states of the cost function to correct for noise. Here we use a programmable annealer for the information decoding problem which we simulate as a random Ising model in a field. We show experimentally that finite temperature maximum entropy decoding can give slightly better bit-error-rates than the maximum likelihood approach, confirming that useful information can be extracted from the excited states of the annealer. Furthermore we introduce a bit-by-bit analytical method which is agnostic to the specific application and use it to show that the annealer samples from a highly Boltzmann-like distribution. Machines of this kind are therefore candidates for use in a variety of machine learning applications which exploit maximum entropy inference, including language processing and image recognition.
Type: | Article |
---|---|
Title: | Maximum-Entropy Inference with a Programmable Annealer |
Location: | England |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1038/srep22318 |
Publisher version: | http://dx.doi.org/10.1038/srep22318 |
Language: | English |
Additional information: | This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > London Centre for Nanotechnology |
URI: | https://discovery-pp.ucl.ac.uk/id/eprint/1493700 |
Archive Staff Only
View Item |