Video Tracking runs one video through the detector and the tracker, then lets you inspect every frame: its tracks, their state and match cost, and what happened in that frame. It is also where the tracker settings are best tuned, because a changed setting is applied to the whole video in seconds with Re-track.
Open it with Video Tracking on the start screen, or Go → Video Tracking.
Video — press Browse and choose the video (.mp4, .avi, .mov, .mkv, .wmv, .m4v, .mpg, .mpeg).
The status line shows the number of frames, the size and the frame rate. If the file states no frame rate, YORU Tracker measures it from the frames’ timestamps, or, without those, assumes 30 fps; the status line says which.
Detector model — press Browse and choose a model trained in YORU (.pt, .pth or .onnx).
Backend — leave it at auto to let YORU pick the detector backend from the model, or choose one from the list.
Conf. — the detector’s confidence threshold (default 0.25). Detections below it are never passed to the tracker.
Flip vertical / Flip horizontal — if the video has to be flipped. Changing a flip reopens the video and clears any results, since they no longer match the frames.
Settings… — check the tracker settings. The line beside the button shows the mode, max_age and max_distance in use. If you know how many animals are in view, set Number of animals now.
Press Run tracking.
The view follows the run, and the status line shows the progress and the detector and tracker time per frame. Any frame already processed can be inspected while the run goes on. Stop ends the run early; the frames tracked so far can still be inspected and exported.
| Control | Key | Action |
|---|---|---|
| Slider | Go to any frame. | |
|< / >| |
Home / End | First / last frame. |
< / > |
← / → | One frame back / forward. |
| Play / Pause | Space | Play at the video’s frame rate. |
The line beside the buttons shows the frame number, its time, and the number of active and lost tracks. On a frame the detector never ran on (for example in a real-time recording loaded with Load detections CSV), it shows the tracks of the latest frame before it, marked (not detected; tracks of frame N).
| Overlay | Default | Draws |
|---|---|---|
| Track boxes | on | Each track’s box, in the track’s own colour. |
| IDs | on | The track ID. |
| Trails | on | The track’s last 30 positions. |
| Detections | off | The detector’s raw boxes, before tracking. |
| Predicted (lost) | off | Where a lost track is predicted to be. With it off, trails run only through where the animals were seen. |
| Velocity | off | An arrow for each track’s velocity. |
| Confidence | off | Each track’s confidence, next to its ID. |
The overlays change only the display, and what Render video draws. They do not change the tracks.
One row per track in the shown frame, in the track’s colour (grey when it is only predicted):
| Column | Meaning |
|---|---|
| ID | Track ID. |
| state | active, or lost (not detected in this frame). |
| class | Class of the latest detection matched to the track. |
| conf | Track confidence: the detector’s confidence smoothed over time, lowered while the track is unseen. |
| hits | How many times the track has been detected. |
| missed | Frames since it was last detected. |
| vx, vy | Velocity, in pixels per frame. |
| cost | Cost of this frame’s match (lower is a better match). Empty for new or predicted tracks. |
What happened to tracks in the shown frame: created (a track got its ID), lost, recovered (a lost track was found again), retired (lost for longer than max_age; its ID is not used again).
Look for frames where an ID is created while another is lost: that is where identities may have been swapped or split. The Lite tracker page explains why that happens and the Tracker Settings page what to change.
Detection is the slow part; tracking takes a fraction of a millisecond per frame. YORU Tracker keeps the detections of the run, so:
Open Settings…, change the settings, and press Apply.
A note appears: Tracker settings changed: press Re-track to apply them to this video.
Press Re-track. The stored detections are tracked again with the new settings, without running the model. The status line shows the number of track IDs and the tracking time.
Repeat until the IDs are right, then export. Save… in the settings window keeps the settings as a YAML file for Batch Tracking or the command line.
Load detections CSV… tracks detections saved earlier, laid over the open video, without running a model. Open the video they belong to first. Three kinds of file are read:
| File | Written by |
|---|---|
<video>_detections.csv |
YORU Tracker (Export CSV with Save detections, or the command line). |
| YORU’s video-analysis CSV | YORU’s video analysis. Frames missing from the table are frames with no detections. |
<name>_detect.csv |
YORU’s real-time process. Its <name>_log.csv must be in the same folder: only the log says which video frame each detection belongs to. |
In a real-time recording, the detector did not run on every video frame. Frames it skipped are stepped over by the tracker, not counted as frames in which every animal was missed.
A file with detections beyond the last frame of the open video is refused: it belongs to another video.
Press Export CSV. For movie.mp4 it writes:
| File | Content |
|---|---|
movie_tracks.csv |
One row per track per frame. |
movie_tracks.json |
Everything needed to reproduce the CSV. |
movie_detections.csv |
The detector’s output, if Save detections is on. |
movie_tracked.mp4: the video with the overlays that are switched on now, and the same flips.Existing files of the same name are overwritten. The columns are described in Output Files.
While a run, a re-track or an export is going on, another video cannot be opened and the flips cannot be changed. Wait for it to finish, or press Stop.