Virtual Graffiti

-
✔️Virtual Graffiti 




✔️Project Description:

The goal of this project is produce an augmented reality system where a user may select
some distinguishable, flat, rectangular, mostly uniform-colored object (e.g. a piece of
paper) in a live video feed and overlay a desired image onto that selected surface.

✔️Motivation:

This project has uses in previewing images as they might appear on a surface such as a
piece of paper, a poster, a billboard, etc. It can also used as an aid for aspiring artists to
learn the basics of drawing, as they can overlay a selected image on a piece of paper and
trace its outline--especially if the image has been passed through an edge detector.

✔️Methods:

To initially identify the flat surface, we will use the Android device’s touch screen
capability to allow the user to make a selection on the live feed. The flat object will be
segmented using color thresholding and then isolated using a connected components
algorithm.The user selects an image from their personal library to transform and overlay onto the surface.The next step is to determine the homography transform from the original (rectangular) image to the rectangular surface of interest. This will be calculated by first locating the corners of the surface with a Harris corner detector [3] and then calculating the
homography from the image to the found corners using OpenCV.Once this is complete, we perform the transformation and overlay the user-selected image onto the live feed.To handle the camera/phone movement, we will use object tracking (KLT feature tracker[1,2]) to keep track of the region containing the surface so as to maintain correct region thresholding and keep the image overlaid in the correct location.

✔️Possible Extensions:

Possible extensions to this project include: expanding the transformation to other types of
surfaces, utilizing different image segments and overlaying textures to more general
surfaces (not necessarily rectangular), or simply overlaying colors on different image
segments to preview paint colors.

✔️References:

[1] Bruce D. Lucas and Takeo Kanade. An Iterative Image Registration Technique with an
Application to Stereo Vision. International Joint Conference on Artificial Intelligence, pages
674-679, 1981.
[2] Carlo Tomasi and Takeo Kanade. Detection and Tracking of Point Features. Carnegie Mellon University Technical Report CMU-CS-91-132, April 1991.
[3] Harris, Chris, and Mike Stephens. "A combined corner and edge detector." Alvey vision
conference. Vol. 15. 1988.
[4] Jianbo Shi and Carlo Tomasi. Good Features to Track. IEEE Conference on Computer Vision and Pattern Recognition, pages 593-600, 1994.


✔️PROJECT SOURCE CODE CLICK HERE

Comments

Post a Comment

Popular posts from this blog

Light Field Images for Background Removal

-
Image
Light Field Images for Background Removal OUTPUT OVERVIEW Standard edge detection or foreground/background separation techniques, such as Otzu’smethod, require color or intensity differences between the background and regions that need tobe separated. For example, green screens are routinely set up as the background in a scene so thatthere is a clear difference in color between the background and foreground.Light filed images, captured in 4D and passively containing depth information for thescene can be used to approximate this effect. Depth estimation in the scene alone could provide a metric to separate the foreground and background, but more sophisticated methods are available.Considering the edge detection from a single image from a single viewpoint and analyzing the depths from the light field around the edges in that image, occluded edges and intensity or color edges can be distinguished. Along with the rest of the depth information this can allow the foreground and b
Read more

Using Image Processing to Identify and Score Darts thrown into a Dartboard

-
Image
✔️Using Image Processing to Identify and Score Darts thrown into a Dartboard ✔️Introduction The game of darts is a throwing sport in which participants toss projectiles into a circular target  attached to a vertical surface. The target is divided into many regions which correspond to different point and multiplier values. Darts is commonly played across North America and Europe and is a popular past time for many so an application that allows players to more conveniently keep score would be widely  beneficial. “Darts” is a general term for a targeting game following this basic premise and many game variations exist within this archetype; all utilizing the standard dart projectiles with a regulation dart board. Each game variant may have different objectives for which players to aim but identifying the region in  which the dart has hit in the dartboard is necessary for proper scoring. This project proposes the use of image processing to identify thrown darts and to det
Read more

Digital Make up Face Generation

-
Image
Digital Make up Face Generation Goal Current make-up applications rely on using photoshop tools to apply makeup on the target's digital  faces and generate results. While these applications allow customization, a customer who wants to  quickly decide on the type of makeup kit to buy at a store will not find it useful. The customer might just  want to find out how the make-up look on the cover or billboard will look like on her face. The goal of  this project is to use an existing reference image of another subject with a make-up applied, and  transfer the reference's make up on the target's face. The application can be further extended to photo  retouching and illumination transfer from the reference image to the target. Methodology In order to transfer the make-up from the reference onto target in a pixel by pixel basis, the areas of  interest must align. Face features such as eyes, nose, mouth and contours of the face, will be recognized  using Active Shape
Read more