Abstract
Object detection under adverse weather remains a major challenge for autonomous driving systems. Cameras do not work well during rain, fog, and darkness, while mmWave radar works accurately in all of these conditions, regardless of illumination and precipitation. In this paper, we propose UGBCF-Net – the Uncertainty-Guided Bird's-Eye-View Cross-Attention Fusion Network, which incorporates radar confidence estimation based on physical laws and adaptive multimodal fusion. Our proposed architecture estimates radar confidence from radar cross-section measurements, maintains the Doppler channel by means of four-channel BEV representation, and uses uncertainty-guided weighting with a lightweight pooled cross-attention network for efficient feature fusion. Experimental results on the nuScenes v1.0-trainval dataset have shown that our UGBCF-Net reaches 0.683 mAP with 8.9 M parameters, operating at 56 FPS on a single NVIDIA RTX 3050 GPU. UGBCF-Net has achieved an accuracy similar to large-fusion networks and showed great robustness, reaching night recall equal to 0.884 with recall rates of 93.1%, 95.9% and 97.4% for vehicles, pedestrians, and cyclists, respectively.References
- Cui, Yaodong, Ren Chen, Wenbo Chu, Long Chen, Daxin Tian, Ying Li, and Dongpu Cao. "Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Review." IEEE Transactions on Intelligent Transportation Systems 23, no. 2 (2021): 722-739.
- Caesar, Holger, Varun Bankiti, Alex H. Lang, Sourabh Vora, Venice Erin Liong, Qiang Xu, Anush Krishnan, Yu Pan, Giancarlo Baldan, and Oscar Beijbom. "nuscenes: A Multimodal Dataset for Autonomous Driving." In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, 11621-11631.
- Bijelic, Mario, Tobias Gruber, Fahim Mannan, Florian Kraus, Werner Ritter, Klaus Dietmayer, and Felix Heide. "Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather." In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, 11682-11692.
- Palffy, Andras, Jiaao Dong, Julian FP Kooij, and Dariu M. Gavrila. "CNN Based Road User Detection Using the 3D Radar Cube." IEEE Robotics and Automation Letters 5, no. 2 (2020): 1263-1270.
- Nabati, Ramin, and Hairong Qi. "Centerfusion: Center-Based Radar and Camera Fusion for 3d Object Detection." In Proceedings of the IEEE/CVF winter conference on applications of computer vision, 2021, 1527-1536.
- Kim, Youngseok, Juyeb Shin, Sanmin Kim, In-Jae Lee, Jun Won Choi, and Dongsuk Kum. "Crn: Camera Radar Net for Accurate, Robust, Efficient 3D Perception." In Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, 17615-17626.
- Zheng, Lianqing and Li, Sen and Tan, Bin and Yang, Long and Chen, Sihan and Huang, Libo and Bai, Jie and Zhu, Xichan and Ma, Zhixiong. "RCFusion: Fusing 4-D Radar and Camera with Bird’s-Eye View Features for 3-D Object Detection," in IEEE Transactions on Instrumentation and Measurement, vol. 72, 2023, 1-14.
- Meyer, Michael, and Georg Kuschk. "Automotive Radar Dataset for Deep Learning Based 3D Object Detection." In 2019 16th european radar conference (EuRAD), Piscataway, NJ: IEEE, 2019, 129-132.
- Bai, Xuyang, Zeyu Hu, Xinge Zhu, Qingqiu Huang, Yilun Chen, Hongbo Fu, and Chiew-Lan Tai. "Transfusion: Robust Lidar-Camera Fusion for 3D Object Detection with Transformers." In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, 1090-1099.
- Yin, Tianwei, Xingyi Zhou, and Philipp Krahenbuhl. "Center-Based 3D Object Detection and Tracking." In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, 11784-11793.
- Li, Z., W. Wang, H. Li, E. Xie, C. Sima, T. Lu, Y. Qiao, and J. Dai. "January 23-27). Bevformer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel." (2022).
- Ester, Martin, Hans-Peter Kriegel, Jörg Sander, and Xiaowei Xu. "A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise." In kdd, vol. 96, no. 34, 1996, 226-231.
- Lang, Alex H., Sourabh Vora, Holger Caesar, Lubing Zhou, Jiong Yang, and Oscar Beijbom. "Pointpillars: Fast Encoders for Object Detection from Point Clouds." In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, 12697-12705.
- Chen, Xuanyao, Tianyuan Zhang, Yue Wang, Yilun Wang, and Hang Zhao. "Futr3d: A Unified Sensor Fusion Framework for 3D Detection." In proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023, 172-181.
- Philion, Jonah, and Sanja Fidler. "Lift, Splat, Shoot: Encoding Images from Arbitrary Camera Rigs by Implicitly Unprojecting To 3d." In European conference on computer vision, Cham: Springer International Publishing, 2020, 194-210.
- Liu, Zhijian, Haotian Tang, Alexander Amini, Xinyu Yang, Huizi Mao, Daniela L. Rus, and Song Han. "Bevfusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation." In 2023 IEEE international conference on robotics and automation (ICRA), ieee, 2023, 2774-2781.
- Wolters, Philipp, Johannes Gilg, Torben Teepe, Fabian Herzog, Anouar Laouichi, Martin Hofmann, and Gerhard Rigoll. "Unleashing Hydra: Hybrid Fusion, Depth Consistency and Radar for Unified 3d Perception." In 2025 IEEE International Conference on Robotics and Automation (ICRA), IEEE, 2025, 7467-7474.
- Rohling, Hermann. "Radar CFAR Thresholding in Clutter and Multiple Target Situations." IEEE transactions on aerospace and electronic systems 4 (1983): 608-621.
- Kendall, Alex, and Yarin Gal. "What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?." Advances in neural information processing systems 30 (2017).
- Sensoy, Murat, Lance Kaplan, and Melih Kandemir. "Evidential Deep Learning to Quantify Classification Uncertainty." Advances in neural information processing systems 31 (2018).
- Feng, Di, Christian Haase-Schütz, Lars Rosenbaum, Heinz Hertlein, Claudius Glaeser, Fabian Timm, Werner Wiesbeck, and Klaus Dietmayer. "Deep Multi-Modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, And Challenges." IEEE Transactions on Intelligent Transportation Systems 22, no. 3 (2020): 1341-1360.
- He, Kaiming, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. "Deep Residual Learning for Image Recognition." In Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, 770-778.
- Loshchilov, Ilya, and Frank Hutter. "Decoupled weight decay regularization." arXiv preprint arXiv:1711.05101 (2017).
- Loshchilov, Ilya, and Frank Hutter. "Sgdr: Stochastic Gradient Descent with Warm Restarts." arXiv preprint arXiv:1608.03983 (2016).
- Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Lawrence Erlbaum Associates.

Journal of Trends in Computer Science and Smart Technology