Context: 3D Mobile mapping
Mines ParisTech has developed a technique for 3D mobile mapping, integrated in a platform called L3D2 [GOULETTE06]. L3D2 is a vehicle equipped with a precise geographical location system (GPS, IMU), a laser scanner attached to the rear of the vehicle, and cameras. This device collects 3D point clouds from urban and road environments, describing with precision the elements present along the traveled paths (roads, roundabouts, facades, trees, cars, etc.). 3D models of the scanned scenes are obtained after processing the acquired point clouds.
The image below shows an original 3D point cloud produced by the MINES ParisTech system in a Parisian street. The great number of geometric details visible in the data can be observed. On the right, the urban scene has been automatically segmented and classified.
Many applications based on relevant information extracted from 3D point clouds are possible. Scene understanding or scene change detection algorithms provide key inputs for real life applications.
The Center for Mathematical Morphology (CMM) of MINES ParisTech has an advanced expertise in the field of 3D point clouds classification [SERNA14], having obtained the best results of the state of the art in the benchmark TerraMobilita / iQmulus [VALLET15].
This PhD work will be done in close collaboration with the start-up Terra 3D, spin-off of MINES ParisTech research work on mobile mapping systems and 3D point cloud processing. The start-up transfers the research results of the laboratories CAOR and CMM of MINES ParisTech, resulting from several research projects.
The objective of this thesis is to integrate multi-spectral data in order to improve the robustness of the semantization methods. Indeed, this information will allow a better discrimination of certain materials and thus help to remove ambiguities. It will thus be possible not only to identify the different materials, but also to determine their concentrations, adding a quantitative dimension to the description of the scene. It will also be possible to provide additional information needed for simulation purposes. For example, most analysis methods only distinguish the ground from the rest of the scene, whereas realistic rendering requires a different material to be assigned to the ground marking. MINES ParisTech has been studying hyper-spectral data for about ten years and has the required expertise to address this topic [VELASCO13]. The proposed thesis aims to push the scientific limits of these problems and to develop concrete applications. This thesis will explore the interaction between deep learning techniques and geometric approaches for automatic scene semantization.
This work will be part of the FUI REPLICA, a French federator project, in which the key actors (optis, Renault, PSA among others) collaborate in the global market for autonomous vehicle testing simulation tools.
(c) GdR 720 ISIS - CNRS - 2011-2018.