Header logo is ei

Classification of Natural Scenes: Critical Features Revisited




Human observers are capable of detecting animals within novel natural scenes with remarkable speed and accuracy. Despite the seeming complexity of such decisions it has been hypothesized that a simple global image feature, the relative abundance of high spatial frequencies at certain orientations, could underly such fast image classification [1]. We successfully used linear discriminant analysis to classify a set of 11.000 images into “animal” and “non-animal” images based on their individual amplitude spectra only [2]. We proceeded to sort the images based on the performance of our classifier, retaining only the best and worst classified 400 images ("best animals", "best distractors" and "worst animals", "worst distractors"). We used a Go/No-go paradigm to evaluate human performance on this subset of our images. Both reaction time and proportion of correctly classified images showed a significant effect of classification difficulty. Images more easily classified by our algorithm were also classified faster and better by humans, as predicted by the Torralba & Oliva hypothesis. We then equated the amplitude spectra of the 400 images, which, by design, reduced algorithmic performance to chance whereas human performance was only slightly reduced [3]. Most importantly, the same images as before were still classified better and faster, suggesting that even in the original condition features other than specifics of the amplitude spectrum made particular images easy to classify, clearly at odds with the Torralba & Oliva hypothesis.

Author(s): Drewes, J. and Wichmann, FA. and Gegenfurtner, KR.
Volume: 9
Pages: 92
Year: 2006
Month: March
Day: 0

Department(s): Empirical Inference
Bibtex Type: Poster (poster)

Digital: 0
Event Name: 9th T{\"u}bingen Perception Conference (TWK 2006)
Event Place: T{\"u}bingen, Germany
Language: en
Organization: Max-Planck-Gesellschaft
School: Biologische Kybernetik

Links: Web


  title = {Classification of Natural Scenes: Critical Features Revisited},
  author = {Drewes, J. and Wichmann, FA. and Gegenfurtner, KR.},
  volume = {9},
  pages = {92},
  organization = {Max-Planck-Gesellschaft},
  school = {Biologische Kybernetik},
  month = mar,
  year = {2006},
  month_numeric = {3}