On the importance of the RGB-D sensor model in the CNN-based robotic perception
[ 1 ] Instytut Robotyki i Inteligencji Maszynowej, Wydział Automatyki, Robotyki i Elektrotechniki, Politechnika Poznańska | [ S ] student | [ P ] employee
[2.2] Automation, electronics, electrical engineering and space technology
2023
chapter in monograph / paper
english
- robotics
- RGB-D camera
- neural perception
- robotyka
- kamera RGB-D
- percepcja neuronowa
EN Mobile and manipulation robots operating indoors use RGB-D cameras as the environment perception sensors. To process data from RGB and depth cameras neural networks are applied. These neural-based systems are trained using synthetic datasets due to the difficulties of obtaining ground truth data on real robots. As a result, the neural model used on the real robot does not produce satisfactory performance due to the differences between the images used during training and the inference. In this paper, we show the importance of depth sensor modeling while training the neural network on a synthetic dataset. We show that the obtained neural model can be used on the real robot and process the data from the real RGB-D camera.
495 - 499
open repository
final published version
at the time of publication
20