Yao, Y; Ren, J; Xie, X; Liu, W; Liu, Y-J; Wang, J; (2020) Attention-aware Multi-stroke Style Transfer. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). (pp. pp. 1467-1475). IEEE: Long Beach, CA, USA.

Preview

Text Yao_Attention-Aware_Multi-Stroke_Style_Transfer_CVPR_2019_paper.pdf - Accepted Version Download (5MB) | Preview

Abstract

Neural style transfer has drawn considerable attention from both academic and industrial field. Although visual effect and efficiency have been significantly improved, existing methods are unable to coordinate spatial distribution of visual attention between the content image and stylized image, or render diverse level of detail via different brush strokes. In this paper, we tackle these limitations by developing an attention-aware multi-stroke style transfer model. We first propose to assemble self-attention mechanism into a style-agnostic reconstruction autoencoder framework, from which the attention map of a content image can be derived. By performing multi-scale style swap on content features and style features, we produce multiple feature maps reflecting different stroke patterns. A flexible fusion strategy is further presented to incorporate the salient characteristics from the attention map, which allows integrating multiple stroke patterns into different spatial regions of the output image harmoniously. We demonstrate the effectiveness of our method, as well as generate comparable stylized images with multiple stroke patterns against the state-of-the-art methods.

Download activity - last month

Export as CSVXMLJSON

Download activity - last 12 months

Export as CSVXMLJSON

Downloads by country - last 12 months

Export as JSONXMLCSV

Archive Staff Only

View Item