eScience Home | ANU Home | Search FEIT | Search ANU
The Australian National University
Faculty of Engineering and Information Technology (FEIT)
Dept. of Computer Science (DCS)

eScience M12/6703 Project


Title : 3D omnistereo panorama generation from a monocular video sequence

  • Status : in progress

  • Student : Zhiyu Ning, u4146446

  • Tutor/Client : Hongdong Li

  • Period : 2006 S2

  • Keywords : Omnistereo, panorama, computer vision

  • Report (link to the final report)


Description

An Omnistereo panorama consists of a pair of panoramic images, where one panorama is for the left eye and another panorama is for the right eye. The panoramic stereo pair provides a stereo sensation up to a full 360 degrees. Omnistereo panoramas cannot be photographed by two omnidirectional cameras from two viewpoints, but can be constructed by stitching together images from a rotating stereo pair. A more convenient approach to generate omnistereo panoramas is by stitching images from a single rotating camera.

Specifically, a stereo panoramas is created using images captured with a regular camera rotating about an axis behind it. Pasting together strips taken from each image approximates the panoramic image cylinder. When the strips are taken from the centre of the images an ordinary panorama is obtained. When the strips are taken from the left side of each image, the viewing direction is tilted counter-clockwise from the image surface, obtaining the right-eye panorama. When the strips are taken from the right side of each image, the left-eye panorama is obtained.

The major tasks involved in this research project include the implementing and extending the method of X-slit camera proposed in the following reference. The major extension will be a simplified model of the X-slit camera by using line-geometry derivation

The student is expected to have programming experiences with Matlab or C/C++, have basic knowledge of image processing/computer vision, have a good grasp of linear algebra or linear system theories. The student will be working closely with the supervisor and PhD students. . At the end of the project, a detailed technical report (research thesis) and a demonstrable algorithm are aimed. Besides, a formal technical publication is expected.

More Information

(adapted from IEEE-PAMI-23-3, reference: "Omnistereo: Panoramic Stereo Imaging", M. Ben-Ezra, Y. Pritch and S. Peleg, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.23, No.3, pp.279-290, March, 2001.)