I am Jesus Briales, a researcher in the Machine Perception and Intelligent Robotics group (MAPIR) at the University of Malaga (Spain). My research interests lie in the area of computer vision and include:
Visual odometry, SLAM, Structure from Motion.
Sensor fusion.
Convex relaxations, Global optimization, Riemannian manifolds.
I have been doing research since October 2013 when I joined the MAPIR group as a Research Assistant. I received my Bacherlor’s and Master’s degree in Industrial Engineering (a general engineering which covers mechanics, electricity, electronic, computer science, etc.) from the University of Malaga in 2014. Since October 2015 I hold a FPU grant from the Spanish government to pursue a PhD in Computer Vision under the supervision of Prof. Javier Gonzalez-Jimenez. From March to July 2017 I was a guest researcher at the Computer Vision group of Chalmers University (Sweden), under the supervision of Prof. Fredrik Kahl. From January to July 2018 I was an intern at Oculus Research, under the supervision of Hauke Strasdat.
Contents
Research (from most recent to oldest)
Global optimality in registration problems:
Registration is a fundamental problem in Computer Vision, where we seek in general to align several models/measurements. Models generated by state-of-the-art methods consist of multiple kind of features (planes, lines, points), and no closed-form solution exists for the corresponding multi-modal registration problem.
Rigid registration: For rigid registration problems, where we seek an unknown pose, Lagrangian duality can be used to find the globally optimal transformation aligning a general geometric model and multiple measurements. In “Convex Global 3D Registration with Lagrangian Duality” (CVPR17) we present a novel relaxation strategy (based on Lagrangian duality) that (empirically) returned the global solution for the original registration problem in all evaluated cases for a wide variety of problems. One of the key aspects in this approach was the exploitation of redundant constraints in the context of rotations, an overlooked aspect that turns essential for effectively relaxing rotation constraints.
Global optimality of solutions in SLAM:
State-of-the-art approaches for SLAM take a graph-based approach that seeks the best model from the consensus of many available measurements from different devices. This problem becomes hard due to both the inherent non-linearities in the problem as well as the scalability issues with map size. As a result, we end up with a high-dimensional non-linear problem that is addressed through local iterative optimization techniques.
Pose Graph Optimization (PGO): For the case of PGO problems, Lagrangian duality makes it possible to characterize the global optimal solution of PGO when strong duality is fulfilled (and this happens very often). In “Fast Global Optimality Verification in 3D SLAM” (IROS16) we proposed a novel formulation of the SLAM problem and exploited it to verify optimality much faster than the contemporary state-of-the-art method. Then, in “Initialization of 3D Pose Graph Optimization using Lagrangian duality” (ICRA17) we used this same formulation to recover the globally optimal solution to PGO if there is strong duality, or a remarkably good initialization otherwise. Our last work “Cartan-Sync: Fast and Global SE(d)-Synchronization” (under review in RAL) provides a fast and scalable way to solve the underlying dual problem, so that solving PGO globally becomes affordable in real applications.
Line-based monocular odometry:
Most state-of-the-art odometry and SLAM pipelines use point features only, so their behavior may degrade in low-textured scenarios. Human-made scenarios are structured and provide a lot of information as line segments.
The introduction of line segments in traditional odometry pipelines rendered previous proposals notably slow. In “PL-SVO: Semi-Direct Monocular Visual Odometry by Combining Points and Line Segments” (IROS16) we propose an extension of a successful semi-direct approach, SVO, that exploits both point and line segment features. It works in a wider variety of scenarios and, very important, it keeps real-time performance.
In “A minimal closed-form solution for the Perspective Three orthogonal Angles (P3oA) problem. Application to visual odometry” (JMIV16) we provide a simple closed-form solution to the Perspective Three orthogonal Angles (P3oA) problem: given the projection of three orthogonal lines in a calibrated camera, find their 3D directions. Upon this solution, an algorithm for the estimation of the camera relative rotation between two frames is proposed.
Extrinsic sensor calibration: Laser and camera
Robots are often equipped with 2D laser-rangefinders (LRFs) and cameras since they complement well to each other. In order to correctly combine measurements from both sensors a precise estimation of their relative pose (or extrinsic calibration) is required.
In “Extrinsic Calibration of a 2D Laser-Rangefinder and a Camera based on Scene Corners” (ICRA15) we proposed a novel approach for this calibration problem that exploits the geometric information gathered from multiple observations of a Manhattan-like structured environment, circumventing the necessity of an on-purpose calibration pattern. Then, in “A minimal solution for the Calibration of a 2D Laser-Rangefinder and a Camera based on Scene Corners” (IROS15) we contributed a closed-form solution for the problem above when using the minimal amount of data, which comes down to barely one single observation of an orthogonal trihedron.
Publications
Journals (4)
2022
M. Garcia-Salguero, J. Briales, J. Gonzalez-Jimenez
@article{garciasalguero2022,
title = {A Tighter Relaxation for the Relative Pose Problem Between Cameras},
author = {Garcia-Salguero, Mercedes and Briales, Jesus and Gonzalez-Jimenez, Javier},
url = {https://mapir.isa.uma.es/papersrepo/2022/2022_mercedes_JMIV_tighter_rel_rpp_paper.pdf},
doi = {10.1007/s10851-022-01085-z},
year = {2022},
date = {2022-01-01},
journal = {Journal of Mathematical Imaging and Vision},
number = {64},
pages = {493-505},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
@article{garciasalguero2021,
title = {Certifiable relative pose estimation},
author = {Garcia-Salguero, Mercedes and Briales, Jesus and Gonzalez-Jimenez, Javier},
url = {https://arxiv.org/pdf/2003.13732.pdf},
doi = {10.1016/j.imavis.2021.104142},
issn = {0262-8856},
year = {2021},
date = {2021-02-01},
journal = {Image and Vision Computing},
number = {63},
abstract = {In this paper we present the first fast optimality certifier for the non-minimal version of the Relative Pose problem for calibrated cameras from epipolar constraints. The proposed certifier is based on Lagrangian duality and relies on a novel closed-form expression for dual points. We also leverage an efficient solver that performs local optimization on the manifold of the original problem's non-convex domain. The optimality of the solution is then checked via our novel fast certifier. The extensive conducted experiments demonstrate that, despite its simplicity, this certifiable solver performs excellently on synthetic data, repeatedly attaining the (certified a posteriori) optimal solution and shows a satisfactory performance on real data.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
In this paper we present the first fast optimality certifier for the non-minimal version of the Relative Pose problem for calibrated cameras from epipolar constraints. The proposed certifier is based on Lagrangian duality and relies on a novel closed-form expression for dual points. We also leverage an efficient solver that performs local optimization on the manifold of the original problem's non-convex domain. The optimality of the solution is then checked via our novel fast certifier. The extensive conducted experiments demonstrate that, despite its simplicity, this certifiable solver performs excellently on synthetic data, repeatedly attaining the (certified a posteriori) optimal solution and shows a satisfactory performance on real data.
@article{briales17RAL,
title = {Cartan-Sync: Fast and Global SE(d)-Synchronization},
author = {Briales, Jesus and Gonzalez-Jimenez, Javier},
url = {https://mapir.isa.uma.es/wp-content/uploads/publicaciones/legacy/jbriales/publications/RAL17%2Bsupp.pdf},
doi = {10.1109/LRA.2017.2718661},
year = {2017},
date = {2017-01-01},
journal = {Robotics and Automation Letters},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
@article{briales2015p3oa,
title = {A minimal closed-form solution for the Perspective Three orthogonal Angles (P3oA) problem. Application to visual odometry.},
author = {Briales, Jesus and Gonzalez-Jimenez, Javier},
url = {https://mapir.isa.uma.es/wp-content/uploads/publicaciones/legacy/jbriales/publications/JMIV16.pdf},
doi = {10.1007/s10851-015-0620-x},
year = {2016},
date = {2016-07-01},
journal = {Journal of Mathematical Imaging and Vision},
volume = {55},
number = {3},
pages = {266-283},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
@inproceedings{BrialesIROS16,
title = {Fast Global Optimality Verification in 3D SLAM},
author = {Briales, Jesus and Gonzalez-Jimenez, Javier},
url = {https://mapir.isa.uma.es/wp-content/uploads/publicaciones/legacy/jbriales/publications/IROS16.pdf},
doi = {10.1109/IROS.2016.7759681},
year = {2016},
date = {2016-10-01},
booktitle = {Int. Conf. on Intelligent Robots and Systems (IROS)},
pages = {4630-4636},
address = {Daejeon, Korea},
organization = {IEEE/RSJ},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
@inproceedings{briales2015minCalib,
title = {A minimal solution for the Calibration of a 2D Laser-Rangefinder and a Camera based on Scene Corners},
author = {Briales, Jesus and Gonzalez-Jimenez, Javier},
url = {https://mapir.isa.uma.es/wp-content/uploads/publicaciones/legacy/jbriales/publications/IROS15.pdf},
doi = {10.1109/IROS.2015.7353625},
year = {2015},
date = {2015-10-01},
booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2015},
pages = {1891 - 1896},
address = {Hamburg, Germany},
organization = {IEEE},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
@inproceedings{gomez2015calib,
title = {Extrinsic Calibration of a 2D Laser-Rangefinder and a Camera based on Scene Corners},
author = {Gomez-Ojeda, Ruben and Briales, Jesus and Fernández-Moral, Eduardo and Gonzalez-Jimenez, Javier},
url = {https://mapir.isa.uma.es/wp-content/uploads/publicaciones/legacy/rgomez/publications/icra15extrinsic.pdf},
doi = {10.1109/ICRA.2015.7139700},
year = {2015},
date = {2015-01-01},
booktitle = {IEEE International Conference on Robotics and Automation (ICRA)},
pages = {3611--3616},
address = {Seattle, USA},
organization = {IEEE},
abstract = {Robots are often equipped with 2D laser-
rangefinders (LRFs) and cameras since they complement well
to each other. In order to correctly combine measurements from
both sensors, it is required to know their relative pose, that is, to
solve their extrinsic calibration. In this paper we present a new
approach to such problem which relies on the observations of
an orthogonal trihedron which is profusely found as corners in
human-made scenarios. Thus, the method does not require any
specific pattern, which turns the calibration process fast and
simpler to perform. The estimated relative pose has proven
to be also very precise since it uses two different types of
constraints, line-to-plane and point-to-plane, as a result of a
richer configuration than previous proposals that relies on plane
or V-shaped patterns. Our approach is validated with synthetic
and real experiments, showing better performance than the
state-of-art methods.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Robots are often equipped with 2D laser-
rangefinders (LRFs) and cameras since they complement well
to each other. In order to correctly combine measurements from
both sensors, it is required to know their relative pose, that is, to
solve their extrinsic calibration. In this paper we present a new
approach to such problem which relies on the observations of
an orthogonal trihedron which is profusely found as corners in
human-made scenarios. Thus, the method does not require any
specific pattern, which turns the calibration process fast and
simpler to perform. The estimated relative pose has proven
to be also very precise since it uses two different types of
constraints, line-to-plane and point-to-plane, as a result of a
richer configuration than previous proposals that relies on plane
or V-shaped patterns. Our approach is validated with synthetic
and real experiments, showing better performance than the
state-of-art methods.
@phdthesis{briales2021,
title = {Global Optimality via Tight Convex Relaxations for Pose Estimation in Geometric 3D Computer Vision},
author = {Briales, Jesus and Gonzalez-Jimenez, Javier},
url = {https://hdl.handle.net/10630/22918},
year = {2021},
date = {2021-01-01},
school = {University of Málaga},
keywords = {},
pubstate = {published},
tppubtype = {phdthesis}
}