Facial Tracking and Smart Markers

Facial Tracking and Smart Markers

Highlight Studio can detect your facial expressions during camera recording and automatically place smart markers on the timeline based on what it detects.

Face Detection

When camera recording is enabled, Highlight Studio uses Apple's Vision framework to track:

  • Face landmarks — Key points on your face (eyes, nose, mouth, jawline).
  • Eye tracking — Gaze direction and pupil position.
  • Face pose — Head rotation (pitch, yaw, roll).
  • Multiple faces — Tracks more than one person if visible.

Smart Markers

Based on the detected facial data, Highlight Studio can automatically place markers on the timeline at key moments. These markers appear on a dedicated Facial Markers Track and help you quickly identify:

  • Expression changes (smiles, surprise, emphasis)
  • Head movement patterns
  • Key moments worth highlighting

Facial Markers Track

The facial markers track appears in the timeline alongside your other tracks. Each marker can be:

  • Clicked to jump to that moment in the video.
  • Used as reference points when adding zoom effects or annotations.
  • Hidden if you do not need them.

Configuring Facial Tracking

Facial tracking settings can be configured in the recording options. An FPS indicator shows the tracking quality — higher FPS means more accurate expression detection.