AUGMENTED REALITY PASSENGER EXPERIENCE

Systems and methods for providing content to passengers within a passenger compartment of a vehicle based on pose estimation and/or gaze detection. The system can obtain sensor data, such as image data, representing a passenger within a vehicle. The system can then analyze the sensor data using pose estimation to determine a pose of the passenger within the vehicle, and analyze the sensor data using gaze detection to determine a point of gaze of the passenger. Based on the pose and the point of gaze, the system can determine a surface within the vehicle for providing content. Additionally, the system can identify the content to provide, wherein the content can include general content or location-based content. After identifying the surface and the content, the system can provide the content to the passenger via the surface. In some examples, providing the content includes augmenting the outside environment with the content.