iOSPointMapper: RealTime Pedestrian and Accessibility Mapping with Mobile AI
By: Himanshu Naidu , Yuxiang Zhang , Sachin Mehta and more
Potential Business Impact:
Maps sidewalks and street features using your phone.
Accurate, up-to-date sidewalk data is essential for building accessible and inclusive pedestrian infrastructure, yet current approaches to data collection are often costly, fragmented, and difficult to scale. We introduce iOSPointMapper, a mobile application that enables real-time, privacy-conscious sidewalk mapping on the ground, using recent-generation iPhones and iPads. The system leverages on-device semantic segmentation, LiDAR-based depth estimation, and fused GPS/IMU data to detect and localize sidewalk-relevant features such as traffic signs, traffic lights and poles. To ensure transparency and improve data quality, iOSPointMapper incorporates a user-guided annotation interface for validating system outputs before submission. Collected data is anonymized and transmitted to the Transportation Data Exchange Initiative (TDEI), where it integrates seamlessly with broader multimodal transportation datasets. Detailed evaluations of the system's feature detection and spatial mapping performance reveal the application's potential for enhanced pedestrian mapping. Together, these capabilities offer a scalable and user-centered approach to closing critical data gaps in pedestrian
Similar Papers
RoadSens-4M: A Multimodal Smartphone & Camera Dataset for Holistic Road-way Analysis
Robotics
Finds road bumps and holes using phone sensors.
Map as a By-product: Collective Landmark Mapping from IMU Data and User-provided Texts in Situated Tasks
Human-Computer Interaction
Builds maps from people's notes and phone movement.
MapAnything: Mapping Urban Assets using Single Street-View Images
CV and Pattern Recognition
Finds city objects and problems from pictures.