Header logo is ei

Classification of natural scenes: Critical features revisited




Human observers are capable of detecting animals within novel natural scenes with remarkable speed and accuracy. Despite the seeming complexity of such decisions it has been hypothesized that a simple global image feature, the relative abundance of high spatial frequencies at certain orientations, could underly such fast image classification (A. Torralba & A. Oliva, Network: Comput. Neural Syst., 2003). We successfully used linear discriminant analysis to classify a set of 11.000 images into “animal” and “non-animal” images based on their individual amplitude spectra only (Drewes, Wichmann, Gegenfurtner VSS 2005). We proceeded to sort the images based on the performance of our classifier, retaining only the best and worst classified 400 images (“best animals”, “best distractors” and “worst animals”, “worst distractors”). We used a Go/No-go paradigm to evaluate human performance on this subset of our images. Both reaction time and proportion of correctly classified images showed a significant effect of classification difficulty. Images more easily classified by our algorithm were also classified faster and better by humans, as predicted by the Torralba & Oliva hypothesis. We then equated the amplitude spectra of the 400 images, which, by design, reduced algorithmic performance to chance whereas human performance was only slightly reduced (cf. Wichmann, Rosas, Gegenfurtner, VSS 2005). Most importantly, the same images as before were still classified better and faster, suggesting that even in the original condition features other than specifics of the amplitude spectrum made particular images easy to classify, clearly at odds with the Torralba & Oliva hypothesis.

Author(s): Drewes, J. and Wichmann, FA. and Gegenfurtner, K.
Journal: Journal of Vision
Volume: 6
Number (issue): 6
Pages: 561
Year: 2006
Month: June
Day: 0

Department(s): Empirical Inference
Bibtex Type: Poster (poster)

Digital: 0
DOI: 10.1167/6.6.561
Event Name: 6th Annual Meeting of the Vision Sciences Society (VSS 2006)
Event Place: Sarasota, FL, USA
Language: en
Organization: Max-Planck-Gesellschaft
School: Biologische Kybernetik

Links: Web


  title = {Classification of natural scenes: Critical features revisited},
  author = {Drewes, J. and Wichmann, FA. and Gegenfurtner, K.},
  journal = {Journal of Vision},
  volume = {6},
  number = {6},
  pages = {561},
  organization = {Max-Planck-Gesellschaft},
  school = {Biologische Kybernetik},
  month = jun,
  year = {2006},
  month_numeric = {6}