{"id":3945,"date":"2024-09-03T12:03:24","date_gmt":"2024-09-03T12:03:24","guid":{"rendered":"https:\/\/mapir.isa.uma.es\/mapirwebsite\/?p=3945"},"modified":"2025-10-02T11:21:20","modified_gmt":"2025-10-02T11:21:20","slug":"mindmaps-semantic-topometric-maps-as-models-of-the-environment-for-intelligent-robots-sep24-aug27national-project","status":"publish","type":"post","link":"https:\/\/mapir.isa.uma.es\/mapirwebsite\/?p=3945","title":{"rendered":"MINDMAPS: Semantic Topometric Maps as Models of the Environment for Intelligent Robots <div style=\"color:gray; font-weight: normal\">(Sep&#8217;24\u2013Aug&#8217;27)<br>National Project<\/div>"},"content":{"rendered":"\n<p>Intelligent mobile robots, much like humans, require a detailed and comprehensive map of their environment to make grounded decisions, reason effectively, and interact naturally with people. These models, denominated maps in robotics, are an essential component of the robot&#8217;s cognitive abilities. This project aims to investigate how advanced deep learning techniques applied to images, such as object recognition, scene classification, and natural language processing (NLP), can be used to create such maps. Our research will focus on several issues. First, by combining data from depth sensors and cameras, we will tackle how to transition from image object recognition to situating semantic objects in 3D space while maintaining spatial and temporal coherence across different locations, times, and sensors. This is challenging since we need to cope with the uncertainty in the robot pose and the sensor measurements, occlusions, partial views, illumination changes, dynamic objects, etc. Once we have semantic entities in space, we want to organize them into topological structures based on graphs of objects and places to overcome the drawbacks of a monolithic world representation (with a single reference frame) when the environment grows. These drawbacks include spatial inconsistencies, precision drift, path\/task planning inefficiency, or the high computational complexity of data analysis. We refer to such world models as Semantic Topometric maps or STM-maps. Furthermore, we will develop a software architecture distributed between the robot, the edge and the cloud. This architecture will help in the efficient creation, maintenance, and exploitation of STM-maps, which could be fed into state-of-the-art world representation frameworks like Unity 3D for real-time visualization and simulation. This is a bold initiative that could make a first step towards robotic digital-twin models.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote\"><p><strong>REFERENCE:&nbsp;<\/strong>PID2023-148191NB-I00<br><strong>FUNDED BY:&nbsp;<\/strong>Ministerio de Ciencia e Innovaci\u00f3n<br><strong>PERIOD:&nbsp;<\/strong>Sep 2024 \u2013 Aug 2027<br><strong>PRINCIPAL RESEARCHERS:&nbsp;<\/strong><a rel=\"noreferrer noopener\" href=\"https:\/\/mapir.isa.uma.es\/jgonzalez\" target=\"_blank\">JAVIER GONZ\u00c1LEZ JIM\u00c9NEZ<\/a> and <a rel=\"noreferrer noopener\" href=\"https:\/\/mapir.isa.uma.es\/jotaraul\" data-type=\"URL\" target=\"_blank\"> JOS\u00c9 RA\u00daL RUIZ SARMIENTO<\/a><br><strong>INSTITUTION:&nbsp;<\/strong>University of M\u00e1laga<\/p><\/blockquote>\n\n\n\n<h2>Publications<\/h2>\n\n\n\n<p>Publications in the scope of this project:<\/p>\n\n\n\n<iframe loading=\"lazy\" style=\"line-height: 1.3em;\" src=\"https:\/\/mapir.uma.es\/mapirpubsite\/index.php\/export\/bytopic\/113\/1\/aigaion_pubs_for_joomlawrapper.css\/none\/mapir_formatted_list\/type\/none\" width=\"100%\" height=\"600\" frameborder=\"0\"><p>The list is loaded from another server. If you see this, there has been a problem.<\/p><\/iframe>\n","protected":false},"excerpt":{"rendered":"<p>Intelligent mobile robots, much like humans, require a detailed and comprehensive map of their environment to make grounded decisions, reason effectively, and interact naturally with people. These models, denominated maps in robotics, are an essential component of the robot&#8217;s cognitive abilities. This project aims to investigate how advanced deep learning techniques applied to images, such&#8230;<\/p>\n","protected":false},"author":4,"featured_media":3967,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false},"categories":[5,50],"tags":[],"_links":{"self":[{"href":"https:\/\/mapir.isa.uma.es\/mapirwebsite\/index.php?rest_route=\/wp\/v2\/posts\/3945"}],"collection":[{"href":"https:\/\/mapir.isa.uma.es\/mapirwebsite\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mapir.isa.uma.es\/mapirwebsite\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mapir.isa.uma.es\/mapirwebsite\/index.php?rest_route=\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/mapir.isa.uma.es\/mapirwebsite\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3945"}],"version-history":[{"count":5,"href":"https:\/\/mapir.isa.uma.es\/mapirwebsite\/index.php?rest_route=\/wp\/v2\/posts\/3945\/revisions"}],"predecessor-version":[{"id":4276,"href":"https:\/\/mapir.isa.uma.es\/mapirwebsite\/index.php?rest_route=\/wp\/v2\/posts\/3945\/revisions\/4276"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mapir.isa.uma.es\/mapirwebsite\/index.php?rest_route=\/wp\/v2\/media\/3967"}],"wp:attachment":[{"href":"https:\/\/mapir.isa.uma.es\/mapirwebsite\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3945"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mapir.isa.uma.es\/mapirwebsite\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3945"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mapir.isa.uma.es\/mapirwebsite\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3945"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}