Overview

Extend to May 30, 2019, 11:59 PM GMT

The evaluation file of stageII:
Google Driver: https://drive.google.com/open?id=1XLJskWYqr-9K14zqpUiIq591N3zs0tk8
Baidu Driver:
https://pan.baidu.com/s/1JbRv7dnqtOlu-z9Wb3BHbg
extract code: xsxq

Please send me the results of StageII before May 30, 2019.

We offer a benchmark suite together with an evaluation server, such that authors can upload their results and get a ranking. We offer a Image-based Multi-pose Virtual Try On Dataset. The ground-truth of train set are offered. If you would like to submit your results on test set, please register, login, and follow the instructions on our submission page.

Note: We only display the highest submission of each person.

Multi-pose Try On Track

Metrics

SSIM (Structural SIMilarity index).

AMT (Amazon Mechanical Turk).

Note:

Stage One, (March 1, 2019 -- May 1, 2019). We measure the SSIM score between the generated images and ground truth images. The person of each pair is wearing same clothes. The TOP 10 users will be invited to attend the Stage Two.

Stage Two, (May 1 -- May 15, 2019). We conduct A/B tests deployed on AMT platform for user study. The person of each pair is wearing different clothes. We will pick the TOP 10 users of stage one to participate in the AMT evaluation. We will replace the instructions of the testset, the TOP 10 users must upload the new results for AMT evaluation before May 15, 2019. We will announce the AMT scores in May 30, 2019.

Method

SSIM

Details

Abbreviation

Submit Time

dhy

71.37

Details

Abbreviation

2019-04-29 09:13:55

Multi-pose LA-VITON v1

71.73

Details

Abbreviation

2019-04-29 22:03:24

Template

58.50

Details

Abbreviation

2019-05-09 07:18:58

74.17

Details

Abbreviation

2019-06-03 03:43:23