โ† AR & VR Development learning path
AR & VR Development ยท Module 2 of 10

XR hardware and tracking

How headsets and phones understand space.

๐Ÿ“– Key ideas

  1. Headsets have displays, lenses, sensors and controllers.
  2. Inside-out tracking uses cameras on the headset.
  3. 3DoF tracks rotation; 6DoF adds movement.
  4. Hand tracking and eye tracking enable natural input.
  5. Phones use cameras and IMUs for AR tracking (SLAM).
๐Ÿ’ก Real-life example: Tracking is the headset's sense of balance, always knowing where your head is and where it's looking.
Inside-out trackingCameras on the device track movement
IMUInertial Measurement Unit
SLAMSimultaneous Localisation and Mapping
Hand trackingUsing hands as input