MAC-I2P: I2P Registration with Modality Approximation and Cone-Block-Point Matching

Yunda Sun, Lin Zhang, Shengjie Zhao
Tongji University,

MAC-I2P estimate the relative pose between images and point clouds.

Overview

Interpolate start reference image.

MAC-I2P is composed of two components: modality approximation and cone-block-point matching. First, the modality discrepancies are mitigated by introducing image depth estimation and point cloud voxelization. Subsequently, cross-modality feature embedding is employed to extract the cross-modality features of both image and point cloud. After obtaining the cross-modality features, pixel-point correspondences are established by cone-block-point matching. At last, the relative pose is inferred through the pose estimation.

Related Links

The dataset processing can be referred to DeepI2P.

We thank the authors of DeepI2P, CorrI2P, and VP2P for their public code.