Online Camera Pose Optimization for the Surround-view System

Xiao Liu, Lin Zhang*, Ying Shen, Shaoming Zhang, and Shengjie Zhao
Tongji University, China


Introduction

This is the website of our paper "Online Camera Pose Optimization for the Surround-view System", published in ACM Multimedia 2019.

Surround view system is an important information media for drivers to monitor the driving environment. A typical surround view system consists of four to six fsheye cameras arranged around the vehicle. From these camera inputs, a top-down image of ground around the vehicle, namely the surround view image can be generated with well calibrated camera poses. Although existing surround view system solutions can estimate camera poses accurately in ofine environment, the problem of correcting the camera pose change in online environment is still a research gap. In this paper, we propose a camera pose optimization method for surround view system in online environment. Our method consists of two models: Ground Model and Ground-Camera Model, both of which correct the camera poses by minimizing photometric errors between ground projections of adjacent cameras. Experiments show that our method can effectively correct the geometric misalignment of the surround view image caused by camera pose changes. Since our method is highly automated with low requirement of calibration site and manual operation, it has wide application scenario and is convenient for the end users. To make our results fully reproducible, the dataset and the relevant source code have been made publicly available on this website.


Source Codes

1. code.zip

This is the code of Ground Model and Ground-Camera Model. The code can be compiled with cmake. The prerequisite of compiling can be found in CMakeLists.txt.

2. test_cases.zip

These are some surround-view images for testing. Images in ALL/ are captured by the Front, Left, Back, Right camera respectively. Same index means the images are captured at the same time. Images in surround view/ are the surround-view images corresponded to the images in ALL/.

3. result_examples.zip

Results of the test cases before and after being processed by our algorithm.


Last update: Aug. 14, 2019