Abstract
This study presents an smart vehicle infotainment system designed to enhance driving safety through real-time object detection, depth estimation, and motion tracking. The system utilizes a pre-trained YOLOv9 deep learning model, specifically customized to identify objects such as pedestrians, motorcyclists, and vehicles in the Indian road context. The model is deployed on a Raspberry Pi, enabling low-cost, on-device inference without the need for high-end computing hardware. To determine the object proximity, a stereo vision-based depth estimation technique is implemented, allowing the system to calculate the distance of detected objects from the vehicle. Motion detection algorithms are integrated to track the movement of objects across frames, thereby improving detection accuracy and reliability in dynamic environments. The system also features a real-time voice alert module, which notifies the driver when an object is detected within a one-meter range. These alerts can be activated or deactivated based on user preference. A key capability of the system is blind spot detection, which helps the vehicles to identify the areas that are not directly visible to the driver, thereby reducing the risk of side collisions. Overall, the proposed solution demonstrates the feasibility and effectiveness of combining deep learning, embedded vision, and smart alert systems on affordable edge devices for safer driving and potential applications in AI-based autonomous vehicles.
References
Khan, Sajjad Ahmad, Hyun Jun Lee, and Huhnkuk Lim. "Enhancing object detection in self-driving cars using a hybrid approach." Electronics 12, no. 13 (2023): 2768.
Prakash, M., M. Janarthanan, and D. Devi. "Multiple Objects Identification for Autonomous Car using YOLO and CNN." In 2023 7th International Conference on Intelligent Computing and Control Systems (ICICCS), pp. 597-601. IEEE, 2023..
Pujara, Abhijeet, and Mamta Bhamare. "DeepSORT: real Time & multi-object detection and tracking with YOLO and TensorFlow." In 2022 International conference on augmented intelligence and sustainable systems (ICAISS), pp. 456-460. IEEE, 2022.
Leibe, Bastian, Konrad Schindler, Nico Cornelis, and Luc Van Gool. "Coupled object detection and tracking from static cameras and moving vehicles." IEEE transactions on pattern analysis and machine intelligence 30, no. 10 (2008): 1683-1698.
A. R. Kondelwar et al., "Enhancing road traffic safety with YOLO V7 object detection," Int. J. Novel Res. Dev. (IJNRD), vol. 9, no. 4, pp. a434–a438, Apr. 2024.
Cao, Danyang, Zhixin Chen, and Lei Gao. "An improved object detection algorithm based on multi-scaled and deformable convolutional neural networks." Human-centric Computing and Information Sciences 10, no. 1 (2020): 14.
Singh, Pooja, Pinki Nayak, Arpita Datta, Depanshu Sani, Garima Raghav, and Rahul Tejpal. "Voice control device using raspberry pi." In 2019 Amity International Conference on Artificial Intelligence (AICAI), pp. 723-728. IEEE, 2019.
A. Y. Mahmoud, J. M. Smith, and R. K. Patel, "Using YOLOv9 deep learning model for automatic detection and classification of VHF signals," IEEE Trans. Signal Process., vol. 71, no. 4, pp. 567–578, 2024.
Vashistha, Piyush, Juginder Pal Singh, Pranav Jain, and Jitendra Kumar. "Raspberry Pi based voice-operated personal assistant (Neobot)." In 2019 3rd International conference on Electronics, Communication and Aerospace Technology (ICECA), pp. 974-978. IEEE, 2019.
Maharaja, Amrita, and Namrata Ansari. "Voice controlled automation using raspberry pi." In 2nd International Conference on Advances in Science & Technology (ICAST). 2019.
Buda, Andreea Maria, Delia Bianca Deaconescu, David Vatamanu, and Simona Miclaus. "Using YOLOv9 Deep Learning Model for Automatic Detection and Classification of VHF Signals." In 2024 International Symposium on Electronics and Telecommunications (ISETC), pp. 1-5. IEEE, 2024.
https://www.moonstone.co.za/new-driving-demerit-system-what-will-the-impact-be-on-insurance/