UCL Discovery Stage
UCL home » Library Services » Electronic resources » UCL Discovery Stage

Cali-sketch: Stroke calibration and completion for high-quality face image generation from human-like sketches

Xia, W; Yang, Y; Xue, J-H; (2021) Cali-sketch: Stroke calibration and completion for high-quality face image generation from human-like sketches. Neurocomputing , 460 pp. 256-265. 10.1016/j.neucom.2021.07.029. Green open access

[thumbnail of WeihaoXia-NEUCOM-accepted.pdf]
Preview
Text
WeihaoXia-NEUCOM-accepted.pdf - Accepted Version

Download (6MB) | Preview

Abstract

Image generation has received increasing attention because of its wide application in security and entertainment. Sketch-based face generation brings more fun and better quality of image generation due to supervised interaction. However, when a sketch poorly aligned with the true face is given as input, existing supervised image-to-image translation methods often cannot generate acceptable photo-realistic face images. To address this problem, in this paper we propose Cali-Sketch, a human-like-sketch to photo-realistic-image generation method. Cali-Sketch explicitly models stroke calibration and image generation using two constituent networks: a Stroke Calibration Network (SCN), which calibrates strokes of facial features and enriches facial details while preserving the original intent features; and an Image Synthesis Network (ISN), which translates the calibrated and enriched sketches to photo-realistic face images. In this way, we manage to decouple a difficult cross-domain translation problem into two easier steps. Extensive experiments verify that the face photos generated by Cali-Sketch are both photo-realistic and faithful to the input sketches, compared with state-of-the-art methods.

Type: Article
Title: Cali-sketch: Stroke calibration and completion for high-quality face image generation from human-like sketches
Open access status: An open access version is available from UCL Discovery
DOI: 10.1016/j.neucom.2021.07.029
Publisher version: https://doi.org/10.1016/j.neucom.2021.07.029
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Face sketch-to-photo synthesis, Image translation, Neural network, Generative adversarial network
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science
URI: https://discovery-pp.ucl.ac.uk/id/eprint/10131341
Downloads since deposit
2,584Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item