The institute says the system will be able to send an audio alert to the pedestrian’s headphones if a hazard appears nearby. The headset will also include a low-power data pipeline to process sounds near the pedestrian. This pipeline will also contain a custom integrated circuit that extracts relevant features from the sounds while using little battery power, the institute adds. Machine learning models on the user’s smartphone will classify acoustic cues from city streets and nearby vehicles to warn users of danger.
