Multi-view Panoramic Image Style Tranfer Network with Multi-scale Attention and Global Feature Sharing

Weiyu Wang, Chunmei Qing, Junpeng Tan and Xiangmin Xu

Style transfer for panoramic images is a challenging task, due to the problems associated with its unique structure, including edge discontinuities, pole distortion, fuzzy details, and memory limitation. In this paper, we propose a novel Multi-view Transformation network for Panorama Style Transfer (MuTPST). Firstly, this architecture has a multi-view panoramic transformation mechanism, which includes a multi-view cubic projection and a multi-view equirectangular re-projection of panoramic images. This can address pole distortion and edge discontinuity by skillfully applying multiple types of projections and transformations. To capture different levels of context and structure in the stylization stage, we carefully design a multi-scale attention content encoder, which can coordinate the distribution of visual attention across space and channels. Besides, by the sharing of global style features in thumbnails and patches, MuTPST can process ultra-high resolution panoramic images (e.g., 10,000*5,000 pixels) with limited GPU memory. Extensive experiments illustrate that the proposed method outperforms the state-of-the-art with a discernible improvement in panoramic image style transfer.

😊It is recommended to use the Chrome browser to interact with the panoramic image below.↓↓↓↓

👉 Click to quickly jump to Supplementary Material.

Content images
URST + AdaIN
URST + WCT
URST + Linear
URST+Collaborative-Distillation
MicroAST
Ours
Fig. 12. An ultra-high resolution stylized panoramic image (10,000×5000 pixels).
Supplementary Material
2D Image Stylization Results
Supplementary Material ---- 2D Image Stylization Results Part - 1
2D Image Stylization Results
Supplementary Material ---- 2D Image Stylization Results Part - 2
Supplementary Material ---- Panoramic Images
Supplementary Material ---- Stylized Panoramic Images