COMPARATIVE ANALYSIS OF 2D AND 3D LIDAR-BASED OBJECT DETECTION FOR MARITIME NAVIGATION

Authors

DOI:

https://doi.org/10.35631/JISTM.1144019

Keywords:

LiDAR, Marine Object Detection, Point Cloud, Sensor Fusion, Maritime Navigation, YOLOv8

Abstract

Maritime navigation safety relies on the timely and accurate detection of obstacles such as vessels, buoys, and floating debris. Conventional sensing technologies, including radar and optical cameras, are limited by low resolution, reduced performance in adverse weather, and susceptibility to sea clutter. Light Detection and Ranging (LiDAR), with its high-resolution three-dimensional sensing capability, offers a promising alternative; however, its application in maritime environments remains relatively underexplored compared to autonomous road vehicles. This study presents a LiDAR-based object detection framework for maritime navigation and evaluates the performance of two-dimensional (2D) and three-dimensional (3D) detection approaches using a calibration/projection-based LiDAR-camera fusion scheme, in which 2D detections are associated with LiDAR points to obtain 3D object localisation. A Velodyne mechanical LiDAR and a ZED stereo camera were mounted on a marine vessel operating in the waters of Klang, Malaysia. Training data were obtained from the Singapore Maritime Dataset, the SeaShips Dataset, and a custom-collected maritime dataset annotated using Roboflow for 2D images and labelCloud for 3D point clouds. A YOLOv8-based model was developed for 2D object detection, while a parallel pipeline generated point clouds from depth imagery for 3D bounding-box estimation. Performance was evaluated using precision, recall, F1-score, Intersection-over-Union (IoU), and, for the 2D pipeline, mean Average Precision (mAP50 and mAP50-95). The 2D detection model achieved strong performance, with a precision of 0.94, recall between 0.84 and 0.86, and an F1-score of approximately 0.89. In contrast, the 3D detection pipeline achieved precision, recall, and F1-score of approximately 0.25 each, a gap attributed jointly to the limited availability of annotated 3D maritime data and to the geometric, non-learned nature of the 3D bounding-box generation step, which takes the axis-aligned extent of the associated LiDAR/depth point cloud without a mechanism to reject noise or clutter points. Comparative analysis also showed that the Velodyne LiDAR produced denser and more accurate point clouds than the ZED stereo camera, particularly for distant objects where stereo depth estimation degraded. The proposed framework demonstrates the effectiveness of LiDAR-camera fusion for maritime 2D object detection while highlighting current challenges in 3D maritime perception. It provides an end-to-end baseline for future sensor-fusion research supporting safer autonomous and assisted maritime navigation.

 

Downloads

Download data is not yet available.

References

Aijazi, A., Laurent, M., Trassoudaine, L., & Checchin, P. (2020). Systematic evaluation and characterization of 3D solid state LiDAR sensors for autonomous ground vehicles. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLIII-B1-2020, 199–203. https://doi.org/10.5194/isprs-archives-xliii-b1-2020-199-2020

Chen, X., Wan, J., Li, B., & Xia, T. (2017). Multi-view 3D object detection network for autonomous driving. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). https://doi.org/10.1109/cvpr.2017.691

Danzer, A., Griebel, T., Bach, M., & Dietmayer, K. (2019). 2D car detection in radar data with PointNets. Proceedings of the IEEE Intelligent Transportation Systems Conference (ITSC), 61–66. https://doi.org/10.1109/ITSC.2019.8917000

Er, M. J., Chen, J., Zhang, Y., & Gao, W. (2023). Research challenges, recent advances, and popular datasets in deep learning-based underwater marine object detection: A review. Sensors, 23(4), 1990. https://doi.org/10.3390/s23041990

Er, S., Zhang, L., & Wang, Y. (2023). Deep learning-based 3D object detection in marine environments using LiDAR. IEEE Journal of Oceanic Engineering, 48(2), 367–378.

Fu, J., Huang, Q., Wang, S., Zheng, G., Qi, T., & Zhang, P. (2023). Application of 3D imaging LiDAR technology on helicopter platform. https://doi.org/10.1117/12.2666576

Glaviano, F., Esposito, R., Cosmo, A., Esposito, F., Gerevini, L., Ria, A., et al. (2022). Management and sustainable exploitation of marine environments through smart monitoring and automation. Journal of Marine Science and Engineering, 10(2), 297. https://doi.org/10.3390/jmse10020297

Gräfe, M., Pettas, V., Gottschall, J., & Cheng, P. (2023). Correction of motion influence for nacelle-based LiDAR systems on floating wind turbines. https://doi.org/10.5194/wes-2023-11

Guobao, X., Shi, Y., Sun, X., & Shen, W. (2019). Internet of Things in marine environment monitoring: A review. Sensors, 19(7), 1711. https://doi.org/10.3390/s19071711

Ku, J., Mozifian, M., Lee, J., Harakeh, A., & Waslander, S. (2018). Joint 3D proposal generation and object detection from view aggregation. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). https://doi.org/10.1109/iros.2018.8594049

Lang, A., Vora, S., Caesar, H., Zhou, L., Yang, J., & Beijbom, O. (2019). PointPillars: Fast encoders for object detection from point clouds. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). https://doi.org/10.1109/cvpr.2019.01298

Li, Z., Du, Y., Zhu, M., Zhou, S., & Zhang, L. (2021). A survey of 3D object detection algorithms for intelligent vehicles development. Artificial Life and Robotics, 27(1), 115–122. https://doi.org/10.1007/s10015-021-00711-0

Liu, Y., Aleksandrov, M., Zlatanova, S., Zhang, J., Mo, F., & Chen, X. (2019). Classification of power facility point clouds from unmanned aerial vehicles based on AdaBoost and topological constraints. Sensors, 19(21), 4717. https://doi.org/10.3390/s19214717

Minh, N., Khoudour, L., Crouzil, A., & Velastin, S. (2021). Sparse LiDAR and stereo fusion (SLS-Fusion) for depth estimation and 3D object detection. https://doi.org/10.1049/icp.2021.1442

Nijland, W., Booij, N., & Holthuijsen, L. H. (2017). Coastal morphology and shore zone classification using airborne LiDAR. Coastal Engineering, 120, 1–11.

Prasad, S., Fisher, R., & Halvorsen, K. (2017). Real-time marine object detection and tracking using LiDAR. IEEE Transactions on Intelligent Transportation Systems, 18(12), 3432–3445.

Sekar, A., van Dooren, M., Rott, A., & Kühn, M. (2021). Modelling the wind turbine inflow with a reduced order model based on spinner LiDAR measurements. https://doi.org/10.5194/wes-2021-16

Weng, X., & Kitani, K. (2019). Monocular 3D object detection with pseudo-LiDAR point cloud. Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops (ICCVW). https://doi.org/10.1109/iccvw.2019.00114

Weon, I., Lee, S., & Ryu, J. (2020). Object recognition-based interpolation with 3D LiDAR and vision for autonomous driving of an intelligent vehicle. IEEE Access, 8, 65599–65608. https://doi.org/10.1109/access.2020.2982681

Yan, Y., Mao, Y., & Li, B. (2018). SECOND: Sparsely embedded convolutional detection. Sensors, 18(10), 3337. https://doi.org/10.3390/s18103337

You, Y. (2019). Pseudo-LiDAR++: Accurate depth for 3D object detection in autonomous driving. https://doi.org/10.48550/arxiv.1906.06310

Zhang, H., Li, X., & Chen, Y. (2023). Integration of LiDAR and deep learning for marine object detection and classification. Remote Sensing, 15(8), 1473–1485.

Zhang, R., Li, S., Ji, G., Zhao, X., Li, J., & Pan, M. (2021). Survey on deep learning-based marine object detection. Journal of Advanced Transportation, 2021, 1–18. https://doi.org/10.1155/2021/5808206

Zhong, Y., Huang, F., Zhang, J., Wen, W., & Hsu, L. (2022). Low-cost solid-state LiDAR/inertial-based localization with prior map for autonomous systems in urban scenarios. IET Intelligent Transport Systems, 17(3), 474–486. https://doi.org/10.1049/itr2.12273

Zhou, Y., & Tuzel, O. (2018). VoxelNet: End-to-end learning for point cloud based 3D object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). https://doi.org/10.1109/cvpr.2018.00472

Downloads

Published

2026-09-17

How to Cite

Norazaruddin, A., & Abidin, Z. Z. (2026). COMPARATIVE ANALYSIS OF 2D AND 3D LIDAR-BASED OBJECT DETECTION FOR MARITIME NAVIGATION. JOURNAL INFORMATION AND TECHNOLOGY MANAGEMENT (JISTM), 11(44), 316–339. https://doi.org/10.35631/JISTM.1144019