To read this content please select one of the options below:

DO-VTON: a details-oriented virtual try-on network

Weihao Luo (College of Textiles, Donghua University, Shanghai, China)
Yueqi Zhong (College of Textiles, Donghua University, Shanghai, China) (Key Lab of Textile Science and Technology, Donghua University, Shanghai, China)

International Journal of Clothing Science and Technology

ISSN: 0955-6222

Article publication date: 6 January 2023

Issue publication date: 10 July 2023

192

Abstract

Purpose

The paper aims to transfer the item image of a given clothing product to a corresponding area of the user image. Existing classical methods suffer from unconstrained deformation of clothing and occlusion caused by hair or poses, which leads to loss of details in the try-on results. In this paper, the authors present a details-oriented virtual try-on network (DO-VTON), which allows synthesizing high-fidelity try-on images with preserved characteristics of target clothing.

Design/methodology/approach

The proposed try-on network consists of three modules. The fashion parsing module (FPM) is designed to generate the parsing map of a reference person image. The geometric matching module (GMM) warps the input clothing and matches it with the torso area of the reference person guided by the parsing map. The try-on module (TOM) generates the final try-on image. In both FPM and TOM, attention mechanism is introduced to obtain sufficient features, which enhances the performance of characteristics preservation. In GMM, a two-stage coarse-to-fine training strategy with a grid regularization loss (GR loss) is employed to optimize the clothing warping.

Findings

In this paper, the authors propose a three-stage image-based virtual try-on network, DO-VTON, that aims to generate realistic try-on images with extensive characteristics preserved.

Research limitations/implications

The authors’ proposed algorithm can provide a promising tool for image based virtual try-on.

Practical implications

The authors’ proposed method is a technology for consumers to purchase favored clothes online and to reduce the return rate in e-commerce.

Originality/value

Therefore, the authors’ proposed algorithm can provide a promising tool for image based virtual try-on.

Keywords

Citation

Luo, W. and Zhong, Y. (2023), "DO-VTON: a details-oriented virtual try-on network", International Journal of Clothing Science and Technology, Vol. 35 No. 4, pp. 565-580. https://doi.org/10.1108/IJCST-02-2022-0017

Publisher

:

Emerald Publishing Limited

Copyright © 2022, Emerald Publishing Limited

Related articles