• Home
  • Labs
    • Computation Vision Recognition Lab
    • Image Analysis Lab
    • Motion Capture Lab
    • Multimedia Lab
    • Medical Imaging Lab
    • Virtual Reality Lab
    • Visual Analytics Lab
    • Visualization Lab
    • Vison Group
  • Members
  • Publications
  • Intranet
    • Publications
    • Authors
    • Labs
    • Projects
 

Estimation of multiple directional light sources for synthesis of augmented reality images

Yang Wang, Dimitris Samaras
Graph. Models, Volume 65, Number 4, page 185-205 - jul 2003
Download the publication : 189GM2003.pdf [457Ko]  

Abstract

We present a new method for the detection and estimation of multiple directional illuminants, using a single image of any object with known geometry and Lambertian reflectance. We use the resulting highly accurate estimates to modify virtually the illumination and geometry of a real scene and produce correctly illuminated Augmented Reality images. Our method obviates the need to modify the imaged scene by inserting calibration objects of any particular geometry, relying instead on partial knowledge of the geometry of the scene. Thus, the recovered multiple illuminants can be used both for image-based rendering and for shape reconstruction. Our method combines information both from the shading of the object and from shadows cast on the scene by the object. Initially, we use a method based on shadows and a method based on shading independently. The shadow-based method utilizes brightness variation inside the shadows cast by the object, whereas the shading-based method utilizes brightness variation on the directly illuminated portions of the object. We demonstrate how the two sources of information complement each other in a number of occasions. We then describe an approach that integrates the two methods, with results superior to those obtained if the two methods are used separately. The resulting illumination information can be used (i) to render synthetic objects in a real photograph with correct illumination effects, and (ii) to virtually relight the scene.

Images and movies

189GM2003.jpg [51Ko]
default.jpg [4Ko]
 

BibTex references

@Article {WS03,
  author       = "Wang, Yang and Samaras, Dimitris",
  title        = "Estimation of multiple directional light sources for synthesis of augmented reality images",
  journal      = "Graph. Models",
  number       = "4",
  volume       = "65",
  pages        = "185--205",
  month        = "jul",
  year         = "2003",
  publisher    = "Academic Press Professional, Inc. San Diego, CA, USA",
  keywords     = "calibration, illumination estimation, shading and color, surface geometry, texture",
  url          = "http://cvc.cs.stonybrook.edu/Publications/2003/WS03"
}

Other publications in the database

» Yang Wang
» Dimitris Samaras
 
Department of Computer Science • Stony Brook University, Stony Brook, NY 11794-4400 • 631-632-8470 or 631-632-8471

 Stony Brook University Home Page    |    Search Stony Brook   |   SOLAR