矿井环境下视觉特征点算法的适用性研究

Research on the applicability of image keypoints in underground mine environments

  • 摘要: 基于深度学习的特征点算法作为机器视觉底层核心算法之一,可服务于多种矿井应用,已成为矿山新型装备视觉感知能力的底层核心技术。光照变化、多粉尘、环境纹理缺失和纹理结构重复等矿井环境特点对特征点算法提出更高的挑战。为有效评估特征点算法在矿井环境中的适用性,构建2类数据集:矿井煤壁图像测试数据集包含20组具有挑战性的煤壁或巷道壁图像序列;巷道巡检图像数据集包含轮式机器人巡检过程中的589帧图像数据。通过对比试验评估多种特征点算法,包括尺度不变特征变换(SIFT)、ORB、加速稳健特征(SURF)、AKAZE、L2-Net、HardNet、GeoDesc、SuperPoint、R2D2和DISK。结果表明:特征点算法整体表现优异,特别是R2D2优势显著。此外,还评估特征点算法在低功耗边缘计算平台上的运行效率,进一步验证其在实际应用中的可行性。

     

    Abstract: The keypoint algorithm, as a fundamental algorithm in machine vision, plays a crucial role in enhancing the visual perception capabilities of new mining equipment. The keypoint algorithm can be applied across various mining tasks. The unique characteristics of the mine environment, such as lighting variations, dust interference, lack of environmental texture, and repetitive texture structures, present significant challenges for keypoint algorithms. To effectively evaluate the applicability of keypoints in underground mine environments, this paper constructed two types of datasets. The first dataset was the mine coal wall image test dataset, containing 20 sets of challenging coal wall or tunnel wall image sequences, while the second was the tunnel inspection image dataset, recording 589 image frames from a wheeled robot during an inspection process. In comparative experiments, we evaluated various keypoint algorithms, including SIFT, ORB, SURF, AKAZE, L2-Net, HardNet, GeoDesc, SuperPoint, R2D2, and DISK. The experimental results show that deep learning-based keypoint algorithms exhibit superior overall performance, with R2D2 demonstrating significant advantages over other algorithms. Additionally, we evaluated the efficiency of deep learning-based keypoint algorithms on low-power edge computing platforms, further validating their feasibility in industrial applications.

     

/

返回文章
返回