Treloar, NJ;
Fedorec, AJH;
Ingalls, B;
Barnes, CP;
(2020)
Deep reinforcement learning for the control of microbial co-cultures in bioreactors.
PLoS Computational Biology
, 16
(4)
, Article e1007783. 10.1371/journal.pcbi.1007783.
(In press).
Preview |
Text
journal.pcbi.1007783.pdf - Published Version Download (3MB) | Preview |
Abstract
Multi-species microbial communities are widespread in natural ecosystems. When employed for biomanufacturing, engineered synthetic communities have shown increased productivity in comparison with monocultures and allow for the reduction of metabolic load by compartmentalising bioprocesses between multiple sub-populations. Despite these benefits, co-cultures are rarely used in practice because control over the constituent species of an assembled community has proven challenging. Here we demonstrate, in silico, the efficacy of an approach from artificial intelligence-reinforcement learning-for the control of co-cultures within continuous bioreactors. We confirm that feedback via a trained reinforcement learning agent can be used to maintain populations at target levels, and that model-free performance with bang-bang control can outperform a traditional proportional integral controller with continuous control, when faced with infrequent sampling. Further, we demonstrate that a satisfactory control policy can be learned in one twenty-four hour experiment by running five bioreactors in parallel. Finally, we show that reinforcement learning can directly optimise the output of a co-culture bioprocess. Overall, reinforcement learning is a promising technique for the control of microbial communities.
Type: | Article |
---|---|
Title: | Deep reinforcement learning for the control of microbial co-cultures in bioreactors |
Location: | United States |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1371/journal.pcbi.1007783 |
Publisher version: | http://dx.doi.org/10.1371/journal.pcbi.1007783 |
Language: | English |
Additional information: | © 2020 Treloar et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences > Div of Biosciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences > Div of Biosciences > Cell and Developmental Biology |
URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10095299 |
Archive Staff Only
View Item |