Sigma-FP: 3D Floor Plan Reconstruction

A 3D reconstruction method to obtain the floor plan including openings (i.e. doors and windows) of multi-room environments from a sequence of RGB-D images captured by a mobile robot.

Abstract

This work presents a novel 3D reconstruction method to obtain the floor plan of a multi-room environment from a sequence of RGB-D images captured by a wheeled mobile robot. For each input image, the planar patches of visible walls are extracted and subsequently characterized by a multivariate Gaussian distribution in the convenient Plane Parameter Space. Then, accounting for the probabilistic nature of the robot localization, we transform and combine the planar patches from the camera frame into a 3D global model, where the planar patches include both the plane estimation uncertainty and the propagation of the robot pose uncertainty. Additionally, processing depth data, we detect openings (doors and windows) in the wall, which are also incorporated in the 3D global model to provide a more realistic representation. Experimental results, in both real-world and synthetic environments, demonstrate that our method outperforms state-of-the-art methods, both in time and accuracy, while just relying on Atlanta world assumption.

Demonstration Video

Code Repository

The code of Sigma-FP is available as a ROS package at https://github.com/MAPIRlab/Sigma-FP.

Similar Posts