Overview

We offer a benchmark suite together with an evaluation server, such that authors can upload their results and get a ranking. We offer a Video Multi-Person Human Parsing Dataset that contains 404 video sequences, including 304 sequences for training set, 50 sequences for validation set and 50 sequences for test set. The ground-truth of train set are offered. If you would like to submit your results on test set, please register, login, and follow the instructions on our submission page.

Note: We only display the highest submission of each person.

Video Multi-Person Human Parsing Track

Metrics

For this task, We adopt standard intersection over union (IoU) criterion for evaluation of global human parsing. Following Mask-RCNN, we used the mean value of several mean Average Precision(mAp) with IOU thresholds from 0.5 to 0.95 in increments of 0.05 for evaluation of human instance segmentation, referred as APrh. Similarly, the mean of the mAp scores for overlap thresholds varying from 0.1 to 0.9 in increments of 0.1, noted as APr is used to evaluate instance-level human parsing. The details show APrh and APr at various IoU thresholds.

User Id Method Mean IoU Mean APrh Mean APr Details Abbreviation Submit Time
336 12101108test 37.91 59.87 24.08 Details Abbreviation 2018-12-10 03:10:34
341 ft_mix_encoder_3way_sni 36.83 59.87 24.08 Details Abbreviation 2019-03-12 16:49:14
377 04241528 37.91 59.87 24.08 Details Abbreviation 2019-04-24 07:34:06
361 20190520a_epoch038 39.14 63.77 26.43 Details Abbreviation 2019-05-30 08:49:50
425 gothic_6_2_results1 55.77 77.41 48.72 Details Abbreviation 2019-6-2 11:00:00
41 fhs_5_7_results 55.77 76.33 48.72 Details Abbreviation 2019-5-7 12:00:00
236 58.44 77.15 41.96 Details Abbreviation 2019-05-31 12:44:10
450 2 55.60 70.87 48.14 Details Abbreviation 2019-05-29 06:24:08
451 38.05 70.87 30.23 Details Abbreviation 2019-05-29 06:29:27
452 mm 41.02 76.33 33.85 Details Abbreviation 2019-05-29 06:49:45
454 44.54 65.08 33.76 Details Abbreviation 2019-05-30 09:48:44
394 BAIDU-UTS 60.14 76.52 52.97 Details Abbreviation 2019-5-21 12:00:00