RETROFIT LIGHT DETECTION AND RANGING (LIDAR)-BASED VEHICLE SYSTEM TO OPERATE WITH VISION-BASED SENSOR DATA

Systems and methods for retrofitting a light detection and ranging (LIDAR)-based vehicle computing system to operate with vision-based sensor data are provided. For example, a method implemented by a vehicle may include receiving, from one or more sensors of a first sensing modality at the vehicle, first sensor data associated with a surrounding environment of the vehicle; and retrofitting a vehicle controller of the vehicle that is based on a second sensing modality different from the first sensing modality to operate on the first sensor data, where the retrofitting includes generating second sensor data from the first sensor data based on the second sensing modality; and determining, by the vehicle controller, an action for the vehicle based at least in part on the generated second sensor data.