โ AR & VR Development learning pathAR & VR Development ยท Module 2 of 10
XR hardware and tracking
How headsets and phones understand space.
๐ Key ideas
- Headsets have displays, lenses, sensors and controllers.
- Inside-out tracking uses cameras on the headset.
- 3DoF tracks rotation; 6DoF adds movement.
- Hand tracking and eye tracking enable natural input.
- Phones use cameras and IMUs for AR tracking (SLAM).
๐ก Real-life example: Tracking is the headset's sense of balance, always knowing where your head is and where it's looking.
Inside-out trackingCameras on the device track movement
IMUInertial Measurement Unit
SLAMSimultaneous Localisation and Mapping
Hand trackingUsing hands as input