Pose-rcnn: Joint object detection and pose estimation using 3d object proposals

Top: a lidar point cloud with clustered points enclosed in 3D boxes labeled vehicle and bike; bottom: the corresponding camera image of a residential street with parked cars and a cyclist outlined by white boxes.

Abstract

This paper presents a novel approach for joint object detection and orientation estimation in a single deep convolutional neural network utilizing proposals calculated from 3D data. For orientation estimation, we extend a R-CNN like architecture by several carefully designed layers. Two new object proposal methods are introduced, to make use of stereo as well as lidar data. Our experiments on the KITTI dataset show that by combining proposals of both domains, high recall can be achieved while keeping the number of proposals low. Furthermore, our method for joint detection and orientation estimation outperforms state of the art approaches for cyclists on the easy test scenario of the KITTI test dataset.

Citation

@inproceedings{Braun2016Posercnn,
title = {Pose-rcnn: Joint object detection and pose estimation using 3d object proposals},
author = {Markus Braun and Qing Rao and Yikang Wang and Fabian B Flohr},
year  = {2016},
date = {2016-01-01},
booktitle = {IEEE International Conference on Intelligent Transportation Systems (ITSC)},
pages = {1546--1551},
publisher = {IEEE},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}