ARPEGGIO: Advanced Robotic Perception for Mapping and Localization
(Sep’21–Feb’25)
National Project

Mapping and localization (M&L) are two fundamental pillars to achieve effective, intelligent mobile robots. Though conceptually these two problems are now well understood, and good realizations are available to the robotics community, critical issues are still to be solved to reach the degree of robustness and dependability that real applications demand. This project will investigate improvements of existing methods as well as novel approaches toward this aim from both the geometric and the semantic perspectives. At the geometric level, we will investigate:

  1. Appearance-based M&L, a challenging approach that models the environment with a collection of geo-tagged holistic image descriptors from which localization is performed through the regression of a query image descriptor with a subset of such map.
  2. Direct, dense registration methods to exploit the new generation of digital and solid-state 3D Lidars.
  3. Mathematical tools to guarantee the optimality of the solutions computed at the back-end of a variety of M&L subproblems (relative pose between cameras, 3D point registration, or graph-pose optimization).

As for the semantic standpoint, the robot will adopt an active vision strategy to gain effectiveness and efficiency when building semantic models of the robot environment.

REFERENCE: PID2020-117057GB-I00
FUNDED BY: Ministerio de Ciencia e Innovación
PERIOD: Sep 2021 – Aug 2024 (extended to Feb 2025)
PRINCIPAL RESEARCHER: JAVIER GONZÁLEZ-JIMÉNEZ
INSTITUTION: Unversity of Málaga

Publications

Publications in the scope of this project:

Journals (14)

2026

J.L. Matez-Bandera, P. Ojeda, J. Monroy, J. Gonzalez-Jimenez, J.R. Ruiz-Sarmiento

Voxeland: Probabilistic Instance-Aware Semantic Mapping with Evidence-based Uncertainty Quantification

Robotics and Autonomous Systems, vol. 205, pp. 105668, 2026. Q1 · T1

2025

J.L. Matez-Bandera, A. Jaenal, C. Gómez, A. C. Hernandez, J. Monroy, J. Araújo, J. Gonzalez-Jimenez

Cross-Detector Visual Localization with Coplanarity Constraints for Indoor Environments

MDPI Sensors, 2025. Q2 · T1

2024

A. Jaenal, J.R. Ruiz-Sarmiento, J. Gonzalez-Jimenez

MachNet, a general Deep Learning architecture for Predictive Maintenance within the industry 4.0 paradigm

Engineering Applications of Artificial Intelligence, vol. 127, pp. 107365, 2024, ISSN: 0952-1976. Q1 · T1

2023

A. Galeote-Luque, J.R. Ruiz-Sarmiento, J. Gonzalez-Jimenez

GND-LO: Ground Decoupled 3D Lidar Odometry Based on Planar Patches

IEEE Robotics and Automation Letters, vol. 8, no. 11, pp. 6923 - 6930, 2023. Q2 · T1

G. Ambrosio, J.R. Ruiz-Sarmiento, J. Gonzalez-Jimenez

The Robot@Home2 dataset: A new release with improved usability tools

SoftwareX, vol. 23, pp. 101490, 2023, ISSN: 2352-7110. Q2 · T2

M. Garcia-Salguero, J. Gonzalez-Jimenez

Certifiable solver for real-time N-view triangulation

IEEE Robotics and Automation Letters, vol. 8, no. 4, pp. 1999-2005, 2023, ISSN: 2377-3766. Q2 · T1

M. Garcia-Salguero, J. Gonzalez-Jimenez

Fast certifiable relative pose estimation with gravity prior

Artificial Intelligence, 2023. Q1 · T1

2022

J.L. Matez-Bandera, J. Monroy, J. Gonzalez-Jimenez

Sigma-FP: Robot Mapping of 3D Floor Plans with an RGB-D Camera under Uncertainty

IEEE Robotics and Automation Letters, 2022. Q2 · T2

M. Garcia-Salguero, J. Gonzalez-Jimenez

Certifiable algorithms for the two-view planar triangulation problem

Computer Vision and Image Understanding, 2022. Q2 · T2

J.L. Matez-Bandera, D. Fernandez-Chaves, J.R. Ruiz-Sarmiento, J. Monroy, N. Petkov, J. Gonzalez-Jimenez

LTC-Mapping, Enhancing Long-term Consistency of Object-oriented Semantic Maps in Robotics

MDPI Sensors, vol. 22, no. 14, 2022, ISSN: 1424-8220. Q2 · T2

D. Fernandez-Chaves, J.R. Ruiz-Sarmiento, A. Jaenal, N. Petkov, J. Gonzalez-Jimenez

Robot@VirtualHome, an ecosystem of virtual environments and tools for realistic indoor robotic simulation

Expert Systems with Applications, vol. 208, pp. 117970, 2022, ISSN: 0957-4174. Q1 · T1

2021

J.L. Matez-Bandera, J. Monroy, J. Gonzalez-Jimenez

Efficient semantic place categorization by a robot through active line-of-sight selection

Knowledge-Based Systems, vol. 240, 2021, ISSN: 0950-7051. Q1 · T1

P. Ojeda, J. Monroy, J. Gonzalez-Jimenez

A Simulation Framework for the Integration of Artificial Olfaction into Multi-Sensor Mobile Robots

MDPI Sensors, vol. 21, no. 6, pp. 2041, 2021, ISSN: 1424-8220. Q2 · T1

P. Ojeda, J. Monroy, J. Gonzalez-Jimenez

Information-driven Gas Source Localization Exploiting Gas and Wind Local Measurements for Autonomous Mobile Robots

IEEE Robotics and Automation Letters (RAL), vol. 6, no. 2, pp. 1320-1326, 2021. Q2 · T2

Book Chapters (1)

2021

A.M. Burgueño, J.R. Ruiz-Sarmiento, J. Gonzalez-Jimenez

Autonomous Docking of Mobile Robots by Reinforcement Learning Tackling the Sparse Reward Problem

vol. 12862, Chapter Advances in Computational Intelligence, pp. 392-403, Springer International Publishing, Cham, 2021, ISBN: 978-3-030-85099-9.

Conferences (3)

2023

M. Luperto, J.L. Matez-Bandera, T. Piotr Kucner, M. Antonazzi, G. Somaschini, J. Monroy, J. Gonzalez-Jimenez, N. Basilico

Ensuring the Consistency of Heterogeneous World Representations Using Structural Features

International Conference on Robotics and Automation (ICRA), 2023.

A.J. Pérez Bazuelo, J.R. Ruiz-Sarmiento, G. Ambrosio, J. Gonzalez-Jimenez

Towards a Voxelized Semantic Representation of the Workspace of Mobile Robots

Advances in Computational Intelligence. IWANN, pp. 194–205, Springer Nature, Switzerland, 2023, ISBN: 978-3-031-43078-7.

2021

D. Fernandez-Chaves, J.L. Matez-Bandera, J.R. Ruiz-Sarmiento, J. Monroy, N. Petkov, J. Gonzalez-Jimenez

Exploiting Spatio-Temporal Coherence for Video Object Detection in Robotics

International Conference on Computer Analysis of Images and Patterns (CAIP), 2021.

National conferences (4)

2024

J. Moncada-Ramirez, J.R. Ruiz-Sarmiento, J.L. Matez-Bandera, J. Gonzalez-Jimenez

Large Models for Semantic Mapping in Mobile Robotics

XLV Jornadas de Automática, Málaga (Spain), 2024.

G. Ambrosio, J.L. Matez-Bandera, J.R. Ruiz-Sarmiento, J. Gonzalez-Jimenez

Linux Container-based Environment for the Development of Robotic Applications

XLV Jornadas de Automática, Málaga (Spain), 2024.

A. Cañete, E. Quemada-Torres, J.R. Ruiz-Sarmiento, F.A. Moreno, J. Gonzalez-Jimenez

Multimodal System for the Orientation of Mobile Robots Towards its Interlocutor

XLV Jornadas de Automática, Málaga (Spain), 2024.

P. Ojeda, J. Monroy, J. Gonzalez-Jimenez

Localización de emisiones de metano combinando un sensor TDLAS y un robot móvil

Jornadas Automática CEA, Málaga, 2024.

Similar Posts