Finding People in Archive Films through Tracking

Xiaofeng Ren. 11 December, 2007.
Communicated by Pedro Felzenszwalb.


The goal of this work is to find all people in archive films. Challenges include low image quality, motion blur, partial occlusion, non-standard poses and crowded scenes. We base our approach on face detection and take a tracking/temporal approach to detection. Our tracker operates in two modes, following face detections whenever possible, switching to low-level tracking if face detection fails. With temporal correspondences established by tracking, we formulate detection as an inference problem in one-dimensional chains/tracks. We use a conditional random field model to integrate information across frames and to re-score tentative detections in tracks. Quantitative evaluations on full-length archive films show that the CRF-based temporal detector greatly improves face detection, increasing the precision for about 30% (suppressing isolated false positives) and at the same time boosting recall for over 10% (recovering difficult cases where face detectors fail).Figure 1. Archive films such as Casablanca offer an interesting and challenging setting for finding and tracking people. In this work we seek to find all people in such archive films, the groundtruth of which is visualized in these examples.

Original Document

The original document is available in PDF (uploaded 11 December, 2007 by Pedro Felzenszwalb).