Overview
We offer a benchmark suite together with an evaluation server, such that authors can upload their results and get a ranking. We offer a Dataset that contains 38280 pictures, including 28280 images for training set, 5000 images for validation set and 5000 images for test set. If you would like to submit your results, please register, login, and follow the instructions on our submission page.
Note: We only display the highest submission of each person.
Multi-Person Human Parsing Task
Metrics
For this task, we use two metrics for multi-human parsing evaluation. Mean IoU(%) for semantic part segmentation, reported by the FCN paper. And APr for instance-level human parsing, first introduced in Simultaneous Detection and Segmentation. The details show APr at various IoU thresholds.
User Id |
Method |
Mean IoU |
Mean APr |
Details |
Abbreviation |
Submit Time |
277 |
DMNet |
61.51 |
41.50 |
Details
IoU Threshhold |
0.1 |
0.2 |
0.3 |
0.4 |
0.5 |
0.6 |
0.7 |
0.8 |
0.9 |
APr |
62.47 |
58.86 |
55.34 |
51.14 |
46.12 |
40.16 |
32.15 |
20.89 |
6.38 |
|
Abbreviation
Contributors |
Description |
Tianrui Hui(IIE,CAS)*, Chen Gao(IIE, CAS)*. ( * means equal contribution) |
For semantic parsing, we employ recursive deeplabv3+ model which conducts two iterations through deeplab network for each input image, and we also embed feature pyramid pooling module from PSPNet into the deeplabv3+ model. At test time, we carry out multi-scale testing and double the resolution of the output feature of deeplabv3+ model. For instance parsing, we employ Mask RCNN to creat persong masks with some test-time augmentation. Finally, we combined the results of the above two models and generated part instance segmentation. Ref: [1]Pyramid Scene Parsing Network. CVPR 2016 [2]Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. arXiv:1802.02611v1 [3] Mask R-CNN. ICCV 2017
|
|
2018-06-10 13:29:01 |
39 |
sspv1 |
61.21 |
27.88 |
Details
IoU Threshhold |
0.1 |
0.2 |
0.3 |
0.4 |
0.5 |
0.6 |
0.7 |
0.8 |
0.9 |
APr |
52.67 |
45.51 |
39.63 |
34.20 |
28.63 |
23.03 |
16.56 |
9.01 |
1.72 |
|
Abbreviation
Contributors |
Description |
|
SSPV1-ResNet101 single model without any test-time augmentation
|
|
2018-05-28 16:21:23 |
287 |
test_51 |
37.74 |
27.88 |
Details
IoU Threshhold |
0.1 |
0.2 |
0.3 |
0.4 |
0.5 |
0.6 |
0.7 |
0.8 |
0.9 |
APr |
52.67 |
45.51 |
39.63 |
34.20 |
28.63 |
23.03 |
16.56 |
9.01 |
1.72 |
|
Abbreviation
|
2018-06-06 05:30:21 |
270 |
BJTU_UIUC |
63.77 |
45.31 |
Details
IoU Threshhold |
0.1 |
0.2 |
0.3 |
0.4 |
0.5 |
0.6 |
0.7 |
0.8 |
0.9 |
APr |
68.63 |
64.88 |
61.12 |
56.66 |
50.93 |
44.07 |
34.73 |
21.53 |
5.28 |
|
Abbreviation
|
2018-06-09 05:35:24 |