Overview
We offer a benchmark suite together with an evaluation server, such that authors can upload their results and get a ranking. We offer a Video Multi-Person Human Parsing Dataset that contains 404 video sequences, including 304 sequences for training set, 50 sequences for validation set and 50 sequences for test set. The ground-truth of train set are offered. If you would like to submit your results on test set, please register, login, and follow the instructions on our submission page.
Note: We only display the highest submission of each person.
Video Multi-Person Human Parsing Track
Metrics
For this task, We adopt standard intersection over union (IoU) criterion for evaluation of global human parsing. Following Mask-RCNN, we used the mean value of several mean Average Precision(mAp) with IOU thresholds from 0.5 to 0.95 in increments of 0.05 for evaluation of human instance segmentation, referred as APrh. Similarly, the mean of the mAp scores for overlap thresholds varying from 0.1 to 0.9 in increments of 0.1, noted as APr is used to evaluate instance-level human parsing. The details show APrh and APr at various IoU thresholds.
User Id | Method | Mean IoU | Mean APrh | Mean APr | Details | Abbreviation | Submit Time |
---|---|---|---|---|---|---|---|
341 | ft_mix_encoder_3way_sni | 36.83 | 59.87 | 24.08 | Details | Abbreviation | 2019-03-12 16:49:14 |
377 | 04241528 | 37.91 | 59.87 | 24.08 | Details | Abbreviation | 2019-04-24 07:34:06 |
361 | 20190520a_epoch038 | 39.14 | 63.77 | 26.43 | Details | Abbreviation | 2019-05-30 08:49:50 |
425 | gothic_6_2_results1 | 55.77 | 77.41 | 48.72 | Details | Abbreviation | 2019-6-2 11:00:00 |
41 | fhs_5_7_results | 55.77 | 76.33 | 48.72 | Details | Abbreviation | 2019-5-7 12:00:00 |
236 | 58.44 | 77.15 | 41.96 | Details | Abbreviation | 2019-05-31 12:44:10 | |
450 | 2 | 55.60 | 70.87 | 48.14 | Details | Abbreviation | 2019-05-29 06:24:08 |
451 | 38.05 | 70.87 | 30.23 | Details | Abbreviation | 2019-05-29 06:29:27 | |
452 | mm | 41.02 | 76.33 | 33.85 | Details | Abbreviation | 2019-05-29 06:49:45 |
454 | 44.54 | 65.08 | 33.76 | Details | Abbreviation | 2019-05-30 09:48:44 | |
394 | BAIDU-UTS | 60.14 | 76.52 | 52.97 | Details | Abbreviation | 2019-5-21 12:00:00 |