Shape from texture without boundaries

Anthony Lobay, D. A. Forsyth

Research output: Contribution to journalArticlepeer-review


We describe a shape from texture method that constructs an estimate of surface geometry using only the deformation of individual texture elements. Our method does not need to use either the boundary of the observed surface or any assumption about the overall distribution of elements.The method assumes that surface texture elements are drawn from a number of different types, each of fixed shape. Neither the shape of the elements nor the number of types need be known in advance. We show that, with this assumption and assuming a generic, scaled orthographic view and texture, each type of texture element can be reconstructed in a frontal coordinate system from image instances. Interest-point methods supply a method of simultaneously obtaining instances of each texture element automatically and defining each type of element. Furthermore, image instances that have been marked in error can be identified and ignored using the Expectation-Maximization algorithm. A further EM procedure yields a surface reconstruction and a relative irradiance map from the data. We provide numerous examples of reconstructions for images of real scenes, show a comparison between our reconstruction and range maps, and demonstrate that the reconstructions display geometric and irradiance phenomena that can be observed in the original image.

Original languageEnglish (US)
Pages (from-to)71-91
Number of pages21
JournalInternational Journal of Computer Vision
Issue number1
StatePublished - Apr 2006
Externally publishedYes


  • Auto-calibration
  • Computer vision
  • Interest point methods
  • Shape from texture
  • Structure from motion
  • Surface fitting
  • Texture

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Shape from texture without boundaries'. Together they form a unique fingerprint.

Cite this