Panorama on Android Device Using Light Field Imaging

-
Panorama on Android Device Using Light Field Imaging

Output



Motivation

Current 360 degree camera create panorama enabling users to rotate views around. However,it has to stay in a fixed position, which is the center of the scene. We propose to solve this problem by using light field (LF) imaging technology to add translation capability to conventional panorama, since the LF’s ability of refocusing, linear translation and depth sensing has been proved in 2D planar case. ​Our goal is to create a translation-capable panorama on Android device.

Our approach

Our approach towards a translation-capable panorama includes following steps:
Step 1: Capture the entire scene by placing a Lytro camera in the center and rotate around
Step 2: Keep the focus of light field images at 2m, using standard stitching algorithm and depth
estimate to create a RGB-D panorama with camera positioned in the center of the scene
Step 3: Keep the focus and virtually move the camera position, calculate the corresponding set
of images and stitch them to get another panorama.
Step 4: Step 3 gives us multiple panoramas at discrete positions which we will store on an
Android device. To get continuous translation in a panorama, we will interpolate the images
between different camera positions based on the depth information. (Doing interpolation instead
of directly calculation in order to save computational power to make it a real running App on
Android device).
Step 5: Transform this translation-capable panorama into a virtual reality setting. (optional)
We think the most challenging parts are the panorama reconstruction algorithms at virtual
camera position and the depth-based interpolation between neighboring panoramas.
We are using an Android Device; and thanks to Dr. Dansereau’s advice, we may also need a
depth camera for more accurate depth sensing.

Reference

1. Mukati, M. Umair, and Bahadir K. Gunturk. "Light field registration: A multi-view geometry
approach." Signal Processing and Communication Application Conference (SIU), 2016 24th.
IEEE, 2016.
2. Todt, Severin, et al. Fast (spherical) light field rendering with per-pixel depth. Technical
report, University of Siegen, Germany, 2007. 5, 2007.

3. Xue, Zhou, et al. "Light field panorama by a plenoptic camera." IS&T/SPIE Electronic
Imaging. International Society for Optics and Photonics, 2014.
4. Birklbauer, Clemens, and Oliver Bimber. "Panorama light-field imaging." Computer Graphics
Forum. Vol. 33. No. 2. 2014.

FOR BASE PAPER PLEASE MAIL US

DOWNLOAD SOURCE CODE CLICK HERE

Comments

Post a Comment

Popular posts from this blog

Using Image Processing to Identify and Score Darts thrown into a Dartboard

-
Image
✔️Using Image Processing to Identify and Score Darts thrown into a Dartboard ✔️Introduction The game of darts is a throwing sport in which participants toss projectiles into a circular target  attached to a vertical surface. The target is divided into many regions which correspond to different point and multiplier values. Darts is commonly played across North America and Europe and is a popular past time for many so an application that allows players to more conveniently keep score would be widely  beneficial. “Darts” is a general term for a targeting game following this basic premise and many game variations exist within this archetype; all utilizing the standard dart projectiles with a regulation dart board. Each game variant may have different objectives for which players to aim but identifying the region in  which the dart has hit in the dartboard is necessary for proper scoring. This project proposes the use of image processing to identify thrown da...
Read more

Create Pointillism Art with 3 Primary Colors from Natural Images

-
Image
Create Pointillism Art with 3 Primary Colors from Natural Images Description Pointillism is a branch of impressionism that can be dated back to the late 19th century. It is a painting technique that only uses tiny, distinct dots to form patterns of color. It enjoys a duality in being both discrete up close (the dots) and continuous from distance (the patterns). Combining this artistic inspiration with the techniques of digital image processing, we want to develop a special image filter that creates pointillism art from ordinary digital images. Plan he process of creating pointillism art will be as followed: (1) We take an image. (2) We will apply various image processing techniques to our image, such as blurring the image with a structuring element that is larger and proportional to the size of the dots we want to use in our pointil...
Read more

Chess Board Detection

-
Image
 Chess Board Detection ✔️  Introduction Chinese chess is one of the most popular board games in China. It is a two-player strategy board  game set up with 32 chess pieces on a board nine lines wide and ten lines long. The chess pieces  are all of the same flat circular disk shape. Each piece is labeled with a Chinese character to  represent one of the seven types. The color of the piece indicates the player‘s ownership. ✔️ Project Goal The goal of the proposed project is to correctly recognize the state of a Chinese chess game by  processing the images captured by the camera of an Android mobile phone. With the essential  information extracted from the images, we will be able to save and share the record of a game  very efficiently. ✔️ Work Flow To reach the goal, we need to detect the chess board, identify the location of each chess piece and  recognize the type of the piece. Chess Board Detection To ext...
Read more