Overview

We offer a benchmark suite together with an evaluation server, such that authors can upload their results and get a ranking. We offer a Image-based Multi-pose Virtual Try On Dataset. The ground-truth of train set are offered. If you would like to submit your results on test set, please register, login, and follow the instructions on our submission page.

Note: We only display the highest submission of each person.

Multi-pose Try On Track

Metrics

SSIM (Structural SIMilarity index).

AMT (Amazon Mechanical Turk).

Note:

Stage One, (March 1, 2019 -- May 1, 2019). We measure the SSIM score between the generated images and ground truth images. The person of each pair is wearing same clothes. The TOP 10 users will be invited to attend the Stage Two.

Stage Two, (May 1 -- May 15, 2019). We conduct A/B tests deployed on AMT platform for user study. The person of each pair is wearing different clothes. We will pick the TOP 10 users of stage one to participate in the AMT evaluation. We will replace the instructions of the testset, the TOP 10 users must upload the new results for AMT evaluation before May 15, 2019. We will announce the AMT scores in May 30, 2019.

Method SSIM Details Abbreviation Submit Time
test5 58.50 Details Abbreviation 2019-03-11 11:37:37
Swap-Inpaint 85.71 Details Abbreviation 2019-03-12 09:07:22