Taking a Deeper Look at Pedestrians

Jan Hosang, Mohamed Omran, Rodrigo Benenson, and Bernt Schiele

Abstract — In this paper we study the use of convolutional neural networks (convnets) for the task of pedestrian detection. Despite their recent diverse successes, convnets historically underperform compared to other pedestrian detectors. We deliberately omit explicitly modelling the problem into the network (e.g. parts or occlusion modelling) and show that we can reach competitive performance without bells and whistles. In a wide range of experiments we analyse small and big convnets, their architectural choices, parameters, and the influence of different training data, including pre-training on surrogate tasks.

We present the best convnet detectors on the Caltech and KITTI dataset. On Caltech our convnets reach top performance both for the Caltech1x and Caltech10x training setup. Using additional data at training time our strongest convnet model is competitive even to detectors that use additional data (optical flow) at test time.

Paper on arXiv.

@INPROCEEDINGS{Hosang2015cvpr,
  author = {J. Hosang and R. Benenson and M. Omran and B. Schiele},
  title = {Taking a Deeper Look at Pedestrians},
  booktitle = {CVPR},
  year = {2015}
}

Data & Downloads

Proposals used for training and testing

Caltech
- Roidb format for R-CNN: Caltech10x train, test
Kitti proposals

Models

Alexnet trained from scratch on Caltech10x (warp, ~27.5% MR): caffe net, prototxt
Alexnet finetuned on Caltech 10x (warp, ~23.3% MR): caffe net, prototxt
Alexnet finetuned on Caltech 10x (square, ~21.4% MR): caffe net, prototxt

Data & Downloads

Proposals used for training and testing

Models

Detections