Robust 3D Object Detection from LiDAR Point Cloud Data with Spatial Information Aggregation

  1. Nerea Aranjuelo 12
  2. Guus Engels 2
  3. Luis Unzueta 2
  4. Ignacio Arganda-Carreras 134
  5. Marcos Nieto 2
  6. Oihana Otaegui 2
  1. 1 Universidad del País Vasco/Euskal Herriko Unibertsitatea
    info

    Universidad del País Vasco/Euskal Herriko Unibertsitatea

    Lejona, España

    ROR https://ror.org/000xsnr85

  2. 2 Vicomtech, Basque Research and Technology Alliance (BRTA, San Sebastian)
  3. 3 Ikerbasque, Basque Foundation for Science (Bilbao)
  4. 4 Donostia International Physics Center
    info

    Donostia International Physics Center

    San Sebastián, España

    ROR https://ror.org/02e24yw40

Libro:
15th International Conference on Soft Computing Models in Industrial and Environmental Applications (SOCO 2020): Burgos, Spain ; September 2020
  1. Álvaro Herrero (coord.)
  2. Carlos Cambra (coord.)
  3. Daniel Urda (coord.)
  4. Javier Sedano (coord.)
  5. Héctor Quintián (coord.)
  6. Emilio Corchado (coord.)

Editorial: Springer Suiza

ISBN: 978-3-030-57801-5 978-3-030-57802-2

Año de publicación: 2021

Páginas: 813-823

Congreso: International Conference on Soft Computing Models in Industrial and Environmental Applications SOCO (15. 2020. Burgos)

Tipo: Aportación congreso

Resumen

Current 3D object detectors from Bird’s Eye View (BEV) LiDAR point cloud data rely on Convolutional Neural Networks (CNNs), which have originally been designed for camera images. Therefore, they look for the same target features, regardless of the position of the objects with respect to the sensor. Discarding this spatial information makes 3D object detection unreliable and not robust, because objects in LiDAR point clouds contain distance dependent features. The position of a group of points can be decisive to know if they represent an object or not. To solve this, we propose a network extension called FeatExt operation that enables the model to be aware of both the target objects features and their spatial location. FeatExt operation expands a group of feature maps extracted from a BEV representation to include the distance to a specific position of interest in the scene, in this case the distance with respect to the LiDAR. When adding the proposed operation to a baseline network in an intermediate fusion fashion, it shows up to an 8.9 average precision boost in the KITTI BEV benchmark. Our proposal can be easily added to improve existing object detection networks.