Skip to content

[ACCV 2024 (Oral, Best Application Paper)] Official Implementation of NT-VOT211: A Large-Scale Benchmark for Night-time Visual Object Tracking

Notifications You must be signed in to change notification settings

LiuYuML/NT-VOT211

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 

Repository files navigation

NT-VOT211 Static Badge Static Badge

The official implementation for the ACCV 2024 paper [NT-VOT211: A Large-Scale Benchmark for Night-time Visual Object Tracking] introc-1

Yu Liu, Arif Mahmood, Muhammad Haris Khan

News(last update 2024-12-14)

🔥🔥🔥 We will regularly update the links to the top three trackers right here ⬇️

Tracker AUC Tracker Precision
ProContEXT 40.10 ODTrack 55.80
KeepTrack 39.60 KeepTrack 55.50
ODTrack 39.60 ProContEXT 54.50

🔥🔥🔥 We will regularly update the links to the top three trackers right here ⬆️

We maintain two complete leaderboards: one is featured on Papers with Code, and the other is on EvalAI. To submit a record on EvalAI, please adhere to the following instructions.

Abstract

Many current visual object tracking benchmarks such as OTB100, NfS, UAV123, LaSOT, and GOT-10K, predominantly contain day-time scenarios while the challenges posed by the night-time has been less investigated. It is primarily because of the lack of a large-scale, well-annotated night-time benchmark for rigorously evaluating tracking algorithms. To this end, this paper presents NT-VOT211, a new benchmark tailored for evaluating visual object tracking algorithms in the challenging night-time conditions. NT-VOT211 consists of 211 diverse videos, offering 211,000 well-annotated frames with 8 attributes including camera motion, deformation, fast motion, motion blur, tiny target, distractors, occlusion and out-of-view.

About this new dataset

More challenging

image benchlimit

Large in scale

comparision_to_SOTAs

Unified frame-wise attribution

image

More baselines

image

How to benchmark:

Download the dataset

You can download our dataset here.

Run on our dataset

Please follow these step-by-step instructions to evaluate your algorithm.

Evaluation on server

Challenge Phases: Please note that our challenge is divided into two phases: the public phase and the private phase.

  • In the private phase, you are allowed to submit a maximum of 100 submissions per day.
  • In the public phase, you are limited to a maximum of 1 submission per month.

We have implemented these limits to maintain a clean and readable leaderboard. We encourage all challengers to submit only their most competitive results on the public leaderboard. To evaluate your results, please follow this tutorial.

Annotation tool and meta information

Annotation tool and meta information can be found here.

Citation

If you find our work valuable, we kindly ask you to consider citing our paper and starring ⭐ our repository. Our implementation includes dataset and useful tools and we hope it make life easier for the VOT research community.

@inproceedings{liu2024ntvot,
  title={NT-VOT211: A Large-Scale Benchmark for Night-time Visual Object Tracking},
  author={Yu Liu and Arif Mahmood and Muhammad Haris Khan},
  booktitle={Proceedings of the Asian Conference on Computer Vision (ACCV)},
  pages={to be announced},
  year={2024},
  organization={Springer}
}

Acknowledgments

The dataloader code borrows heavily from PyTracking.

Maintenance

Please open a GitHub issue for any help. If you have any questions regarding the technical details, feel free to contact us.

License

MIT License

About

[ACCV 2024 (Oral, Best Application Paper)] Official Implementation of NT-VOT211: A Large-Scale Benchmark for Night-time Visual Object Tracking

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published