Omnidirectional Stereo Imaging
|
|
|
|
|
An Omnistereo panorama consists of a pair of panoramic images, where one panorama is for the left eye and another
panorama is for the right eye. The panoramic stereo pair provides a stereo sensation up to a full 360 degrees. Omnistereo panoramas
cannot be photographed by two omnidirectional cameras from two viewpoints, but can be constructed by mosaicing together images
from a rotating stereo pair. A more convenient approach to generate omnistereo panoramas is by mosaicing images from a single
rotating camera. This approach also enables the control of stereo disparity, giving larger baselines for faraway scenes, and a smaller
baseline for closer scenes. Capturing panoramic omnistereo images with a rotating camera makes it impossible to capture dynamic
scenes at video rates and limits omnistereo imaging to stationary scenes. We, therefore, present two possibilities for capturing
omnistereo panoramas using optics without any moving parts. A special mirror is introduced such that viewing the scene through this
mirror creates the same rays as those used with the rotating cameras. A lens for omnistereo panorama is also introduced. The designs
of the mirror and of the lens are based on curves whose caustic is a circle. Omnistereo panoramas can also be rendered by computer
graphics methods to represent virtual environments.
|
|
Patents
"System and method for facilitating the adjustment of disparity in a stereoscopic panoramic image pair,"
S.Peleg, M. Ben-Ezra, and Y. Pritch
US Papent No. 6,831,677, December 2004
[PDF]
"Stereo panoramic camera arrangements for recording panoramic images useful in a stereo panoramic image pair,"
S.Peleg, M. Ben-Ezra, and Y. Pritch
US Papent No. 6,795,109, September 2004
[PDF]
"System and method for generating and displaying panoramic images and movies,"
S.Peleg, M. Ben-Ezra, and R.S. Rosenschein
US Papent No. 6,665,003, December 2003
[PDF]
|
|
Publications
"Optics for OmniStereo Imaging,"
Y. Pritch, M. Ben-Ezra, and S. Peleg,
in L.S. Davis (Editor), Foundations of Image Understanding, Kluwer Academic, pp. 447-467, 2001.
[PDF]
"Panoramic Imaging with Horizontal Stereo,"
S. Peleg, M. Ben-Ezra, and Y. Pritch,
in Panoramic Vision: Sensors, Theory, Applications, Springer New York, pp. 143-160, 2001.
"Omnistereo: Panoramic Stereo Imaging,"
S. Peleg, M. Ben-Ezra, Y. Pritch,
IEEE Transactions on Pattern Analysis and Machine Intelligence,
Vol.23, No.3, pp.279-290, March, 2001.
[PDF]
"Cameras for Stereo Panoramic Imaging,"
S. Peleg, Y. Pritch, and M. Ben-Ezra,
In Proc. IEEE Computer Vision and Pattern Recognition (CVPR), Hilton Head Island, South Carolina, I:208-214, June 2000.
[PDF]
"Stereo Panorama with a Single Camera,"
Shmuel Peleg and Moshe Ben-Ezra,
In Proc. IEEE Computer Vision and Pattern Recognition (CVPR), Ft. Collins, Colorado, I:395-401, June 1999.
[PDF]
"Automatic Disparity Control in Stereo Panoramas (OmniStereo),"
Y. Pritch, M. Ben-Ezra, and S. Peleg,
In Workshop on Omnidirectional Vision, Hilton Head Island, South Carolina, p.54, June 2000.
[PDF]
|
|
|
Pictures
|
The Problem:
No arrangement of two single-viewpoint images can give stereo
in all viewing directions. For upward viewing, the two cameras should be
separated horizontally and for sideways viewing, the two cameras
should be separated vertically.
|
|
|
|
OmniStereo:
Stereo Panoramas can be created using images captured with a
regular camera rotating about an axis behind it. Pasting together strips
taken from each image approximates the panoramic image cylinder.
When the strips are taken from the center of the images an ordinary
panorama is obtained. When the strips are taken from the left side of
each image, the viewing direction is tilted counterclockwise from the
image surface, obtaining the right-eye panorama. When the strips are
taken from the right side of each image, the left-eye panorama is
obtained.
|
|
|
|
|
|
|
Tower of David (Jerusalem, Israel).
360 Degrees Stereo-Panoramic image (5163x480 pixels)
Anaglyph Stereo Image. View using red/green glasses.
© HumanEyes Technologies Ltd.
|
|
|
|
|
|
|
Palladio's Il Redentore in Venice
360 Degrees Stereo-Panoramic rendered image from 3D model (by Nathan G B O'Brien) (1110x175 pixels)
Anaglyph Stereo Image. View using red/green glasses.
|
|
|
|
Videos
|
|
|
|
|
|
Related Sites
HumanEyes Technologies Ltd.
|
|
|
|
