--关注、星标、回复“自主泊车”--

摘要

介绍

不利天气数据

真实世界数据集

天气增强

点云处理与去噪

传感器相关天气鲁棒性

传感器退化估计和天气分类

点云去噪

鲁棒的激光雷达感知

利用传感器融合应对恶劣天气

通过数据增强增强训练

鲁棒感知算法

讨论和结论

参考

[1] R. Roriz, J. Cabral, and T. Gomes, “Automotive lidar technology: A survey,” inIEEE Transactions on Intelligent Transportation Systems (T-ITS), 2022.

[2] A. Geiger, P. Lenz, and R. Urtasun, “Are we ready for autonomous driving? the kitti vision benchmark suite,” inIEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2012.

[3] M. Hahner,et al., “Fog simulation on real lidar point clouds for 3d object detection in adverse weather,” inIEEE/CVF International Conference on Computer Vision (ICCV), 2021.

[4] ——, “Lidar snowfall simulation for robust 3d object detection,” inIEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.

[5] M. Kutila,et al., “Benchmarking automotive lidar performance in arc- tic conditions,” inIEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), 2020.

【资料图】

[6] M. Jokela,et al., “Lidar performance review in arctic conditions,” inIEEE 15th International Conference on Intelligent Computer Commu- nication and Processing (ICCP), 2019.

[7] K. Montalban,et al., “A quantitative analysis of point clouds from automotive lidars exposed to artificial rain and fog,”Atmosphere, 2021. [8] R. K. Heinzler, “Lidar-based weather detection: Automotive lidar sensors in adverse weather conditions,” Ph.D. dissertation, KarlsruherInstitut fu ̈r Technologie (KIT), 2022.

[9] M. Bijelic, T. Gruber, and W. Ritter, “A benchmark for lidar sensorsin fog: Is detection breaking down?” inIEEE Intelligent VehiclesSymposium (IV), 2018.

[10] R. Heinzler,et al., “Weather influence and classification with auto-motive lidar sensors,” inIEEE Intelligent Vehicles Symposium (IV),2019.

[11] F. Piewak,et al., “Boosting lidar-based semantic labeling by cross-modal training data generation,” inIEEE European Conference onComputer Vision (ECCV) Workshops, 2019.

[12] K. Yoneda,et al., “Automated driving recognition technologies foradverse weather conditions,”IATSS Research, 2019.

[13] J. Abdo, S. Hamblin, and G. Chen, “Effective Range Assessment of Lidar Imaging Systems for Autonomous Vehicles Under Adverse Weather Conditions With Stationary Vehicles,”ASCE-ASME J Riskand Uncert in Engrg Sys Part B Mech Engrg, 2021.

[14] C. Linnhoff,et al., “Measuring the influence of environmental condi-tions on automotive lidar sensors,”Sensors, 2022.

[15] D. M. Neumeister and D. B. Pape, “Automated vehicles and adverseweather,” U.S. Department of Transportation, Tech. Rep., 2019.

[16] A. S. Mohammed,et al., “The perception system of intelligent ground vehicles in all weather conditions: A systematic literature review,”Sensors, 2020.

[17] Y. Zhang,et al., “Autonomous driving in adverse weather conditions:A survey,”arXiv, 2021.

[18] M. Cordts,et al., “The cityscapes dataset for semantic urban sceneunderstanding,” inIEEE Conference on Computer Vision and PatternRecognition (CVPR), 2016.

[19] P. Sun,et al., “Scalability in perception for autonomous driving:Waymo open dataset,” inIEEE/CVF Conference on Computer Visionand Pattern Recognition (CVPR), 2019.

[20] H. Caesar,et al., “nuscenes: A multimodal dataset for autonomousdriving,” inIEEE/CVF Conference on Computer Vision and PatternRecognition (CVPR), 2020.

[21] M. Bijelic,et al., “Seeing through fog without seeing fog: Deep mul-timodal sensor fusion in unseen adverse weather,” inIEEE Conferenceon Computer Vision and Pattern Recognition (CVPR), 2020.

[22] W. Ritter,et al., “Dense: Environment perception in bad weather— first results,”Electronic Components and Systems for AutomotiveApplications, 2019.

[23]M.Pitropov,etal.,“Canadianadversedrivingconditionsdataset,”The International Journal of Robotics Research, 2020.

[24] A. Pfeuffer,et al., “The aduulm-dataset - a semantic segmentationdataset for sensor fusion,” inBritish Machine Vision Conference(BMVC), 2020.

[25] J. Bos,et al., “Autonomy at the end of the earth: Inclement weatherautonomous driving data set,” inAutonomous Systems: Sensors, Pro-cessing and Security for Vehicles & Infrastructure 2020, 2020.

[26] A. Kurup and J. P. Bos, “Dsor: A scalable statistical filter for removing falling snow from lidar point clouds in severe winter weather,”ArXiv,2021.

[27] A.Carballo,etal.,“Libre:Themultiple3dlidardataset,”arXiv,2020. [28] W. Maddern,et al., “1 Year, 1000km: The Oxford RobotCar Dataset,”The International Journal of Robotics Research (IJRR), 2017.

[29] D. Barnes,et al., “The oxford radar robotcar dataset: A radar extension to the oxford robotcar dataset,” inIEEE International Conference onRobotics and Automation (ICRA), 2020.

[30] M. Sheeny,et al., “Radiate: A radar dataset for automotive perception,”arXiv, 2020.

[31] A. Dosovitskiy,et al., “CARLA: An open urban driving simulator,”inConference on Robot Learning (CoRL), 2017.

[32] R. H. Rasshofer, M. Spies, and H. Spies, “Influences of weatherphenomena on automotive laser radar systems,”Advances in Radio Science, 2011.

[33] C. Goodin,et al., “Predicting the influence of rain on lidar in adas,”Electronics, 2019.

[34] S. Hasirlioglu and A. Riener, “A model-based approach to simulate rain effects on automotive surround sensor data,” in2018 21st In- ternational Conference on Intelligent Transportation Systems (ITSC), 2018.

[35] S. Teufel,et al., “Simulating realistic rain, snow, and fog variations for comprehensive performance characterization of lidar perception,” inIEEE Vehicular Technology Conference (VTC), 2022.

[36] V. Kilic,et al., “Lidar light scattering augmentation (lisa): Physics- based simulation of adverse weather conditions for 3d object detec- tion,”arXiv, 2021.

[37] Y. Liu,et al., “Parallel lidars meet the foggy weather,”IEEE Journal of Radio Frequency Identification, 2022.

[38] C. Linnhoff,et al., “Simulating road spray effects in automotive lidar sensor models,” 2022.

[39] Y.-C. Shih,et al., “Reconstruction and synthesis of lidar point clouds of spray,”IEEE Robotics and Automation Letters, 2022.

[40] J. R. Vargas Rivero,et al., “Data augmentation of automotive lidar point clouds under adverse weather situations,”Sensors, 2021.

[41] J. Lee,et al., “Gan-based lidar translation between sunny and adverseweather for autonomous driving and driving simulation.”Sensors,2022.

[42] I. Fursa,et al., “Worsening perception: Real-time degradation ofautonomous vehicle perception performance for simulation of adverseweather conditions,”ArXiv, 2021.

[43] A. Filgueira,et al., “Quantifying the influence of rain in lidar perfor-mance,”Measurement, 2017.

[44] M. Kutila,et al., “Automotive lidar performance verification in fogand rain,” inInternational Conference on Intelligent TransportationSystems (ITSC), 2018.

[45] M. E. Warren, “Automotive lidar technology,” inSymposium on VLSICircuits, 2019.

[46] A. M. Wallace, A. Halimi, and G. S. Buller, “Full waveform lidarfor adverse weather conditions,”IEEE Transactions on VehicularTechnology, 2020.

[47] C. Zhang,et al., “Lidar degradation quantification for autonomousdriving in rain,” inIEEE/RSJ International Conference on IntelligentRobots and Systems (IROS), 2021.

[48] H. Delecki,et al., “How do we fail? stress testing perception inautonomous vehicles,” in2022 IEEE/RSJ International Conference onIntelligent Robots and Systems (IROS), 2022.

[49] J.R.VargasRivero,etal.,“Weatherclassificationusinganautomotivelidar sensor based on detections on asphalt and atmosphere,”Sensors,2020.

[50] G.Sebastian,etal.,“Rangeweathernetforlidar-onlyweatherandroadcondition classification,” inIEEE Intelligent Vehicles Symposium (IV),2021.

[53] M. H. Prio, S. Patel, and G. Koley, “Implementation of dynamicradius outlier removal (dror) algorithm on lidar point cloud data with arbitrary white noise addition,” inIEEE Vehicular Technology Conference (VTC2022), 2022.

[54] H. Balta,et al., “Fast statistical outlier removal based method for large 3d point clouds of outdoor environments,” inIFAC Symposium on Robot Control (SYROCO), 2018.

[55] W. Wang,et al., “A scalable and accurate de-snowing algorithm for lidar point clouds in winter,”Remote Sensing, 2022.

[56] J.-I. Park, J. Park, and K.-S. Kim, “Fast and accurate desnowing algorithm for lidar point clouds,”IEEE Access, 2020.

[57] J. Wu,et al., “Vehicle detection under adverse weather from roadside lidar data,”Sensors, 2020.

[58] P. Sun,et al., “Objects detection with 3-d roadside lidar under snowy weather,”IEEE Sensors Journal, 2022.

[59] R. Heinzler,et al., “Cnn-based lidar point cloud de-noising in adverse weather,”IEEE Robotics and Automation Letters (RA-L), 2020.

[60] J. Bergius and J. Holmblad, “Lidar point cloud de-noising for adverseweather,” Master’s thesis, Halmstad University, School of Information Technology, 2022.

[61] M.-Y. Yu, R. Vasudevan, and M. Johnson-Roberson, “Lisnownet: Real- time snow removal for lidar point cloud,”IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022.

[62] A. Seppa ̈nen, R. Ojala, and K. Tammi, “4denoisenet: Adverse weather denoising from adjacent point clouds,”IEEE Robotics and Automation Letters (RA-L), vol. 8, 2023.

[63] L. T. Triess,et al., “Quantifying point cloud realism through adversari- ally learned latent representations,” inProc. of the German Conference on Pattern Recognition (GCPR), 2021.

[64] P. Radecki, M. E. Campbell, and K. Matzen, “All weather perception: Joint data association, tracking, and classification for autonomous ground vehicles,”ArXiv, 2016.

[65]P.Fritsche,etal.,“Fusinglidarandradardatatoperformslaminharsh environments,” inInternational Conference on Informatics in Control, Automation and Robotics (ICINCO), K. Madani, D. Peaucelle, and O. Gusikhin, Eds., 2018.

[66]A.PfeufferandK.Dietmayer,“Optimalsensordatafusionarchitecture for object detection in adverse weather conditions,” inInternational Conference on Information Fusion (FUSION), 2018.

[67] A. Pfeuffer and K. C. J. Dietmayer, “Robust semantic segmentation in adverse weather conditions by means of sensor data fusion,”International Conference on Information Fusion (FUSION), 2019.

[68] N. A. Rawashdeh, J. P. Bos, and N. J. Abu-Alrub, “Camera–Lidar sensor fusion for drivable area detection in winter weather using convolutional neural networks,”Optical Engineering, SPIE, 2022.

[69] G. Xie,et al., “Obstacle detection based on depth fusion of lidar and radar in challenging conditions,”Industrial Robot: the international journal of robotics research and application, 2021.

[70] M. J. Mirza,et al., “Robustness of object detectors in degrading weather conditions,” inIEEE International Intelligent Transportation Systems Conference (ITSC), 2021.

[71] Y.-J. Li,et al., “Modality-agnostic learning for radar-lidar fusion in vehicle detection,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.

[72] K.Qian,etal.,“Robustmultimodalvehicledetectioninfoggyweather using complementary lidar and radar signals,” inIEEE/CVF Confer- ence on Computer Vision and Pattern Recognition (CVPR), 2021.

[73] S. S. Chaturvedi, L. Zhang, and X. Yuan, “Pay ”attention” to adverse weather: Weather-aware attention-based object detection,” inInterna- tional Conference on Pattern Recognition (ICPR), 2022.

[74] Z. Elmassik, M. Sabry, and A. El Mougy, “Understanding the scene: Identifying the proper sensor mix in different weather conditions,” inInternational Conference on Agents and Artificial Intelligence (ICAART), 2022.

[75] T. Vattem, G. Sebastian, and L. Lukic, “Rethinking lidar object detection in adverse weather conditions,” inInternational Conference on Robotics and Automation (ICRA), 2022.

[76] T.Sun,etal.,“SHIFT:asyntheticdrivingdatasetforcontinuousmulti- task domain adaptation,” inComputer Vision and Pattern Recognition, 2022.

[77] L.T.Triess,etal.,“ASurveyonDeepDomainAdaptationforLiDAR Perception,” inIEEE Intelligent Vehicles Symposium (IV) Workshops, 2021.

[78] B. Caine,et al., “Pseudo-labeling for scalable 3d object detection,”arXiv, 2021.

[79] J. Lin,et al., “Improved 3d object detector under snowfall weather condition based on lidar point cloud,”IEEE Sensors Journal, 2022.

[80] G. Eskandar,et al., “An unsupervised domain adaptive approach for multimodal 2d object detection in adverse weather conditions,”arXiv, 2022.

转载自自动驾驶之心，文中观点仅供分享交流，不代表本公众号立场，如涉及版权等问题，请您告知，我们将及时处理。

-- END --