GMOT-40 Evaluation Instruction


Please check and follow instructions below for fair usage.

  • Evaluation on GMOT-40: to compare with the baseline methods, please take the whole GMOT-40 dataset as the test set for consistency.
    You may split the whole set to training/test set if needed for some reason.
  • One-shot detector: you are supposed to use the baseline one-shot detector provided by GMOT-40 for public track (public detector).
    You may also use your own one-shot detector for private track (private detector). You would need to indicate this when submission.

Submission Guideline


Coming soon.

Leaderboard


Methods MOTA(%) IDF1(%) IDP(%) IDR(%) Rcll(%) Prcn(%) MT PT ML↓ FP↓ FN↓ IDs↓ FM↓ Date
MDP (Baseline) 19.80 31.30 61.80 21.00 27.20 80.20 142 621 1161 17260 186580 1779 2748 2021-04-05
DeepSORT (Baseline) 14.50 24.40 67.50 14.90 18.50 84.10 72 509 1363 9000 208818 1315 2233 2021-04-05
IOU tracker (Baseline) 11.80 20.30 64.60 12.00 15.40 82.60 56 397 1491 8299 216921 754 1668 2021-04-05
FAMNet (Baseline) 18.00 28.30 54.80 19.10 26.80 76.80 166 581 1197 20741 187730 1660 1878 2021-04-05