FL-GAN: Feature Learning Generative Adversarial Network for High-Quality Face Sketch Synthesis

Lin CAO; Kaixuan LI; Kangning DU; Yanan GUO; Peiran SONG; Tao WANG; Chong FU

doi:10.1587/transfun.2020EAP1114

FL-GAN: Feature Learning Generative Adversarial Network for High-Quality Face Sketch Synthesis

Lin CAO, Kaixuan LI, Kangning DU, Yanan GUO, Peiran SONG, Tao WANG, Chong FU

Full Text Views

1

Cite this

Summary :

Face sketch synthesis refers to transform facial photos into sketches. Recent research on face sketch synthesis has achieved great success due to the development of Generative Adversarial Networks (GAN). However, these generative methods prone to neglect detailed information and thus lose some individual specific features, such as glasses and headdresses. In this paper, we propose a novel method called Feature Learning Generative Adversarial Network (FL-GAN) to synthesize detail-preserving high-quality sketches. Precisely, the proposed FL-GAN consists of one Feature Learning (FL) module and one Adversarial Learning (AL) module. The FL module aims to learn the detailed information of the image in a latent space, and guide the AL module to synthesize detail-preserving sketch. The AL Module aims to learn the structure and texture of sketch and improve the quality of synthetic sketch by adversarial learning strategy. Quantitative and qualitative comparisons with seven state-of-the-art methods such as the LLE, the MRF, the MWF, the RSLCR, the RL, the FCN and the GAN on four facial sketch datasets demonstrate the superiority of this method.

Publication: IEICE TRANSACTIONS on Fundamentals Vol.E104-A No.10 pp.1389-1402

Publication Date: 2021/10/01

Publicized: 2021/04/05

Online ISSN: 1745-1337

DOI: 10.1587/transfun.2020EAP1114

Type of Manuscript: PAPER

Category: Image

Authors

Lin CAO
  Beijing Information Science and Technology University
Kaixuan LI
  Beijing Information Science and Technology University
Kangning DU
  Beijing Information Science and Technology University
Yanan GUO
  Beijing Information Science and Technology University
Peiran SONG
  Beijing Information Science and Technology University
Tao WANG
  Beijing Information Science and Technology University
Chong FU
  Northeastern University

Keyword

face sketch synthesis, adversarial learning, generative adversarial networks, feature learning

Cite this

Copy

Lin CAO, Kaixuan LI, Kangning DU, Yanan GUO, Peiran SONG, Tao WANG, Chong FU, "FL-GAN: Feature Learning Generative Adversarial Network for High-Quality Face Sketch Synthesis" in IEICE TRANSACTIONS on Fundamentals, vol. E104-A, no. 10, pp. 1389-1402, October 2021, doi: 10.1587/transfun.2020EAP1114.
Abstract: Face sketch synthesis refers to transform facial photos into sketches. Recent research on face sketch synthesis has achieved great success due to the development of Generative Adversarial Networks (GAN). However, these generative methods prone to neglect detailed information and thus lose some individual specific features, such as glasses and headdresses. In this paper, we propose a novel method called Feature Learning Generative Adversarial Network (FL-GAN) to synthesize detail-preserving high-quality sketches. Precisely, the proposed FL-GAN consists of one Feature Learning (FL) module and one Adversarial Learning (AL) module. The FL module aims to learn the detailed information of the image in a latent space, and guide the AL module to synthesize detail-preserving sketch. The AL Module aims to learn the structure and texture of sketch and improve the quality of synthetic sketch by adversarial learning strategy. Quantitative and qualitative comparisons with seven state-of-the-art methods such as the LLE, the MRF, the MWF, the RSLCR, the RL, the FCN and the GAN on four facial sketch datasets demonstrate the superiority of this method.
URL: https://global.ieice.org/en_transactions/fundamentals/10.1587/transfun.2020EAP1114/_p

Copy

@ARTICLE{e104-a_10_1389,
author={Lin CAO, Kaixuan LI, Kangning DU, Yanan GUO, Peiran SONG, Tao WANG, Chong FU, },
journal={IEICE TRANSACTIONS on Fundamentals},
title={FL-GAN: Feature Learning Generative Adversarial Network for High-Quality Face Sketch Synthesis},
year={2021},
volume={E104-A},
number={10},
pages={1389-1402},
abstract={Face sketch synthesis refers to transform facial photos into sketches. Recent research on face sketch synthesis has achieved great success due to the development of Generative Adversarial Networks (GAN). However, these generative methods prone to neglect detailed information and thus lose some individual specific features, such as glasses and headdresses. In this paper, we propose a novel method called Feature Learning Generative Adversarial Network (FL-GAN) to synthesize detail-preserving high-quality sketches. Precisely, the proposed FL-GAN consists of one Feature Learning (FL) module and one Adversarial Learning (AL) module. The FL module aims to learn the detailed information of the image in a latent space, and guide the AL module to synthesize detail-preserving sketch. The AL Module aims to learn the structure and texture of sketch and improve the quality of synthetic sketch by adversarial learning strategy. Quantitative and qualitative comparisons with seven state-of-the-art methods such as the LLE, the MRF, the MWF, the RSLCR, the RL, the FCN and the GAN on four facial sketch datasets demonstrate the superiority of this method.},
keywords={},
doi={10.1587/transfun.2020EAP1114},
ISSN={1745-1337},
month={October},}

Copy

TY - JOUR
TI - FL-GAN: Feature Learning Generative Adversarial Network for High-Quality Face Sketch Synthesis
T2 - IEICE TRANSACTIONS on Fundamentals
SP - 1389
EP - 1402
AU - Lin CAO
AU - Kaixuan LI
AU - Kangning DU
AU - Yanan GUO
AU - Peiran SONG
AU - Tao WANG
AU - Chong FU
PY - 2021
DO - 10.1587/transfun.2020EAP1114
JO - IEICE TRANSACTIONS on Fundamentals
SN - 1745-1337
VL - E104-A
IS - 10
JA - IEICE TRANSACTIONS on Fundamentals
Y1 - October 2021
AB - Face sketch synthesis refers to transform facial photos into sketches. Recent research on face sketch synthesis has achieved great success due to the development of Generative Adversarial Networks (GAN). However, these generative methods prone to neglect detailed information and thus lose some individual specific features, such as glasses and headdresses. In this paper, we propose a novel method called Feature Learning Generative Adversarial Network (FL-GAN) to synthesize detail-preserving high-quality sketches. Precisely, the proposed FL-GAN consists of one Feature Learning (FL) module and one Adversarial Learning (AL) module. The FL module aims to learn the detailed information of the image in a latent space, and guide the AL module to synthesize detail-preserving sketch. The AL Module aims to learn the structure and texture of sketch and improve the quality of synthetic sketch by adversarial learning strategy. Quantitative and qualitative comparisons with seven state-of-the-art methods such as the LLE, the MRF, the MWF, the RSLCR, the RL, the FCN and the GAN on four facial sketch datasets demonstrate the superiority of this method.
ER -